Filtering process based on loop reshaping

Abstract

A method for video processing is provided, comprising: determining, for a current video block of a current video region of a video, a parameter of a coding mode of the current video block based on one or more parameters of a coding mode of a previous video region; and based on the determining, performing coding on the current video block to generate a coded representation of the video, and wherein the parameter of the coding mode is included in a parameter set in the coded representation of the video, and wherein performing coding comprises transforming a representation of the current video block in a first domain to a representation of the current video block in a second domain, and wherein the current video block is constructed based on the first domain and the second domain during the performing coding using the coding mode, and / or chroma residuals are scaled in a manner dependent on luma.

Description

[0001] Cross-references to related applications

[0002] In accordance with applicable patent law and / or the rules of the Paris Convention, this application aims to promptly claim priority and benefits to International Patent Application No. PCT / CN2019 / 074437, filed February 1, 2019; International Patent Application No. PCT / CN2019 / 078185, filed March 14, 2019; and International Patent Application No. PCT / CN2019 / 079393, filed March 23, 2019. For all purposes under the law, the entire disclosure of the foregoing applications is incorporated by reference as part of the disclosure of this application. Technical Field

[0003] This patent document relates to video processing technologies, equipment, and systems. Background Technology

[0004] Despite advancements in video compression technology, digital video still accounts for the largest share of bandwidth usage on the internet and other digital communication networks. As the number of networked user devices capable of receiving and displaying video increases, the bandwidth demand for digital video is expected to continue to grow. Summary of the Invention

[0005] This paper describes devices, systems, and methods related to digital video processing, and specifically, to in-loop reshaping (ILR) for video processing. The described methods can be applied to both existing video processing standards (e.g., High Efficiency Video Coding (HEVC)) and future video processing standards, or to video processors that include video codecs.

[0006] In one representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a motion information refinement process based on samples in a first or second domain for a conversion between a current video block and a codec representation of the video; and performing the conversion based on the result of the motion information refinement process, wherein during the conversion, samples are obtained from a first prediction block in the first domain using unrefined motion information for the current video block, at least a second prediction block is generated in the second domain using refined motion information for determining a reconstructed block, and reconstructed samples of the current video block are generated based on at least the second prediction block.

[0007] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes: performing a conversion between a current video block and a codec representation of the video, wherein during the conversion, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, wherein parameters derived by the codec tool using at least a first set of sample points in a video region of the video and a second set of sample points in a reference image of the current video block are applied during the conversion, and wherein the domains of the first and second sample points are aligned.

[0008] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining parameters of the encoding / decoding mode for a current video block of a current video region of a video, based on one or more parameters of the encoding / decoding mode of a previous video region; and performing encoding / decoding on the current video block based on the determination to generate an encoding / decoding representation of the video, wherein the parameters of the encoding / decoding mode are included in a parameter set in the encoding / decoding representation of the video, and wherein performing encoding / decoding includes transforming the representation of the current video block in a first domain to a representation of the current video block in a second domain, and wherein during the encoding / decoding process using the encoding / decoding mode, the current video block is constructed based on the first and second domains, and / or the chroma residual is scaled in a luminance-dependent manner.

[0009] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: receiving a codec representation of a video including a set of parameters, wherein the set of parameters includes parameter information of a codec mode; and performing decoding of the codec representation using the parameter information to generate a current video block of a current video region from the codec representation, wherein the parameter information of the codec mode is based on one or more parameters of a codec mode of a previous video region, wherein, in the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0010] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes performing a conversion between a current video block and a codec representation of the video, wherein the conversion includes applying a filtering operation to a prediction block in a first domain or a second domain different from the first domain.

[0011] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes: performing a conversion between a current video block and a codec representation of the video, wherein during this conversion, a final reconstructed block is determined for the current video block, and wherein a temporary reconstructed block is generated using a prediction method and represented in a second domain.

[0012] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block of a video region and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the parameter set in the codec representation includes parameter information of the codec mode.

[0013] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block, which is a chroma block, and a codec representation of the video, wherein during the conversion, the current video block is constructed based on a first domain and a second domain, and wherein the conversion further includes applying a forward shaping process and / or a reverse shaping process to one or more chroma components of the current video block.

[0014] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes performing a conversion between a current video chroma block and a codec representation of the video, wherein performing the conversion includes determining, based on rules, whether luminance-dependent chroma residual scaling (LCRS) is enabled or disabled, and reconstructing the current video chroma block based on that determination.

[0015] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes: for a conversion between a current video block and a codec representation of the video, determining whether to disable the use of a codec mode based on one or more coefficient values ​​of the current video block; and performing the conversion based on the determination, wherein during the conversion using the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0016] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes: a transformation between current video blocks of a video exceeding a Virtual Pipeline Data Unit (VPDU), dividing the current video block into regions; and performing the transformation by separately applying codec modes to each region, wherein during the transformation by applying the codec modes, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0017] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes: for a conversion between a current video block and a codec representation of the video, determining whether to disable the use of a codec mode based on the size or color format of the current video block; and performing the conversion based on this determination, wherein during the conversion using the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a brightness-dependent manner.

[0018] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein at least one syntax element in the codec representation provides an indication of the use of the codec mode and an indication of a shaper model.

[0019] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining that a conversion between a current video block and a codec representation of the video disables a codec mode; and conditionally skipping forward shaping and / or inverse shaping based on this determination, wherein, in the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0020] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block of a video region and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein multiple forward shaping and / or multiple inverse shaping are applied in a shaping mode of the video region.

[0021] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining that a conversion between a current video block and a codec representation of the video is enabled by a codec mode; and performing the conversion using a palette mode, wherein in the palette mode, a palette representing at least the sample values ​​is used for the current video block, and wherein, in the codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a brightness-dependent manner.

[0022] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: for a conversion between a current video block and a codec representation of the video, determining that the current video block is encoded in a palette mode, wherein in this palette mode, a palette representing at least sample values ​​is used to encode and decode the current video block; and, due to this determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on chromaticity residuals scaled in a luminance-dependent manner.

[0023] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion uses a first codec mode and a palette codec mode, wherein in the palette codec mode, a palette representing at least pixel values ​​is used to encode and decode the current video block; and performing a conversion between a second video block of a video encoded without using the palette codec mode and a codec representation of the video, wherein the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a brightness-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0024] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining a codec mode enabled for the conversion between a current video block and a codec representation of the video; and performing the conversion using an intra-frame block copy mode, wherein the intra-frame block copy mode generates a predicted block using at least block vectors pointing to an image including the current video block, and wherein, in the codec mode, the current video block is constructed based on samples in a first and a second domain, and / or the chroma residual is scaled in a brightness-dependent manner.

[0025] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: for a conversion between a current video block and a codec representation of the video, determining that the current video block is encoded / decoded in an intra-block copy (IBC) mode, wherein the IBC mode uses at least block vectors pointing to the video frame containing the current video block to generate predictive blocks for encoding / decoding the current video block; and, due to this determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luma-dependent manner.

[0026] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion uses an intra-block copy mode and a first codec mode, wherein the intra-block copy mode uses at least block vectors pointing to video frames containing the current video block to generate predicted blocks; and performing a conversion between a second video block of a video encoded and decoded without using the intra-block copy mode and a codec representation of the video, wherein the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein the first codec mode is applied differently to the first video block and the second video block.

[0027] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining a codec mode enabled for the conversion between a current video block and a codec representation of the video; and performing the conversion using a block-based incremental pulse codec modulation (BDPCM) mode, wherein, in this codec mode, the current video block is constructed based on samples in a first and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0028] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes: for a conversion between a current video block and a codec representation of the video, determining that the current video block is encoded using a block-based incremental pulse codec modulation (BDPCM) mode; and, due to this determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0029] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a first video block and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a block-based incremental pulse codec modulation (BDPCM) mode; and performing a conversion between a second video block and a codec representation of the video, wherein the second video block is encoded and decoded without using the BDPCM mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0030] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining that a transformation between a current video block and a codec representation of the video is enabled by a codec mode; and performing the transformation using a transform skip mode, wherein in this transform skip mode, the transformation of the prediction residual is skipped when encoding and decoding the current video block, wherein, in this codec mode, the current video block is constructed based on samples in a first and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0031] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: for a conversion between a current video block and a codec representation of the video, determining that the current video block is encoded in a transform-skip mode, wherein in this transform-skip mode, the transform on the prediction residual is skipped when encoding and decoding the current video block; and, due to this determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0032] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a first video block and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a transform skip mode, wherein in the transform skip mode, a transform on the prediction residual is skipped when encoding and decoding the current video block; and performing a conversion between a second video block and a codec representation of the video, wherein the second video block is encoded and decoded without using the transform skip mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0033] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining a codec mode enabled for the conversion between a current video block and a codec representation of the video; and performing the conversion using an intra-frame pulse codec modulation mode, wherein the current video block is encoded and decoded without applying transform and transform-domain quantization, wherein, in this codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0034] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: for a conversion between a current video block and a codec representation of the video, determining that the current video block is encoded / decoded in an intra-frame pulse codec modulation mode, wherein the current video block is encoded / decoded in this intra-frame pulse codec modulation mode without the application of transform and transform-domain quantization; and, due to this determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0035] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a first video block and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and an intra-pulse codec modulation mode, wherein the current video block is encoded and decoded without the application of transform and transform-domain quantization in the intra-pulse codec modulation mode; and performing a conversion between a second video block and a codec representation of the video, wherein the second video block is encoded and decoded without the use of the intra-pulse codec modulation mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0036] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: determining a codec mode enabled for the conversion between a current video block and a codec representation of the video; and performing the conversion using a modified transform quantization bypass mode, wherein the current video block is losslessly encoded and decoded without transform and quantization, wherein in this codec mode, the current video block is constructed based on samples in a first and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0037] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: for a conversion between a current video block and a codec representation of the video, determining that the current video block is encoded / decoded in a transform-quantization bypass mode, wherein in this transform-quantization bypass mode, the current video block is losslessly encoded / decoded without transform and quantization; and, due to this determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0038] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a first video block and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a transform quantization bypass mode, wherein in the transform quantization bypass mode, the current video block is losslessly encoded and decoded without transform and quantization; and performing a conversion between a second video block and a codec representation of the video, wherein the second video block is encoded and decoded without using the transform quantization bypass mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0039] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein information for the codec mode is signaled in a parameter set different from a Sequence Parameter Set (SPS), Video Parameter Set (VPS), Picture Parameter Set (PPS), or Adaptive Parameter Set (APS) for carrying adaptive loop filtering (ALF) parameters.

[0040] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein information for the codec mode, together with adaptive loop filtering (ALF) information, is signaled in an adaptive parameter set (APS), wherein the information for the codec mode and the ALF information are included in a NAL unit.

[0041] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block of a video region and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein information for the codec mode is signaled in a first type of APS, different from a second type of adaptive parameter set (APS) used for signaling notification of adaptive loop filtering (ALF) information.

[0042] In another representative aspect, the disclosed technology can be used to provide a method for video processing. The method includes: performing a conversion between a current video block of a video region and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein the video region is not permitted to reference an adaptive parameter set or a parameter set signaled prior to a specified type of data structure used for processing the video, and wherein the specified type of data structure is signaled prior to the video region.

[0043] In another representative aspect, the disclosed technology can be used to provide a method for video processing. This method includes: performing a conversion between a current video block and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein syntax elements of a parameter set including parameters for processing the video have predefined values ​​in a consistent bitstream.

[0044] In another representative aspect, the above methods are embodied in the form of processor-executable code and stored in a computer-readable program medium.

[0045] In another representative aspect, an apparatus configured or operable to perform the methods described above is disclosed. This apparatus may include a processor programmed to implement the methods.

[0046] In another representative aspect, video decoder devices can implement the methods described herein.

[0047] The above and other aspects and features of the disclosed technology are described in more detail in the accompanying drawings, description and claims. Attached Figure Description

[0048] Figure 1 An example of constructing a Merge candidate list is shown.

[0049] Figure 2 An example of a candidate location for the airspace is shown.

[0050] Figure 3 An example of a candidate pair for which a spatial merge candidate is performed is shown.

[0051] Figure 4A and Figure 4B An example of the position of the second prediction unit (PU) based on the size and shape of the current block is shown.

[0052] Figure 5 An example of motion vector scaling for temporal Merge candidates is shown.

[0053] Figure 6 An example of candidate locations for temporal Merge candidates is shown.

[0054] Figure 7 An example of generating bidirectional prediction Merge candidates using a combination is shown.

[0055] Figure 8 An example of constructing motion vector prediction candidates is shown.

[0056] Figure 9 An example of motion vector scaling for spatial motion vector candidates is shown.

[0057] Figure 10 An example of motion prediction using the Alternative Temporal Motion Vector Prediction (ATMVP) algorithm for the Coding Unit (CU) is shown.

[0058] Figure 11 An example of a codec unit (CU) with sub-blocks and neighboring blocks is shown, used by the Spatial-Temporal Motion Vector Prediction (STMVP) algorithm.

[0059] Figure 12 An example of neighboring samples used to derive illumination compensation (IC) parameters is shown.

[0060] Figure 13A and Figure 13B Examples of simplified 4-parameter affine models and simplified 6-parameter affine models are shown respectively.

[0061] Figure 14An example of the affine motion vector field (MVF) for each sub-block is shown.

[0062] Figure 15A and Figure 15B Examples of 4-parameter affine models and 6-parameter affine models are shown respectively.

[0063] Figure 16 An example of motion vector prediction for AF_INTER from inherited affine candidates is shown.

[0064] Figure 17 An example of motion vector prediction for AF_INTER constructed from affine candidates is shown.

[0065] Figure 18A and Figure 18B Example candidate blocks and CPMV prediction values ​​for the AF_MERGE pattern are shown respectively.

[0066] Figure 19 An example of candidate positions for the affine Merge pattern is shown.

[0067] Figure 20 An example of the UMVE search process is shown.

[0068] Figure 21 An example of a UMVE search point is shown.

[0069] Figure 22 An example of decoder-side motion vector refinement (DMVR) based on bilateral template matching is shown.

[0070] Figure 23 An exemplary flowchart with an shaped decoded stream is shown.

[0071] Figure 24 An example of neighboring samples used in a bilateral filter is shown.

[0072] Figure 25 An example of a window covering two samples used in weight calculation is shown.

[0073] Figure 26 An example of a scanned pattern is shown.

[0074] Figure 27 An example of the inter-frame mode decoding process is shown.

[0075] Figure 28 Another example of the inter-frame mode decoding process is shown.

[0076] Figure 29An example of the inter-frame mode decoding process using the reconstructed filter is shown.

[0077] Figure 30 Another example of the inter-frame mode decoding process utilizing the reconstructed filter is shown.

[0078] Figure 31A and Figure 31B A flowchart of an example method for video processing is shown.

[0079] Figures 32A to 32D A flowchart of an example method for video processing is shown.

[0080] Figure 33 A flowchart of an example method for video processing is shown.

[0081] Figure 34A and Figure 34B A flowchart of an example method for video processing is shown.

[0082] Figures 35A to 35F A flowchart of an example method for video processing is shown.

[0083] Figures 36A to 36C A flowchart of an example method for video processing is shown.

[0084] Figures 37A to 37C A flowchart of an example method for video processing is shown.

[0085] Figures 38A to 38L A flowchart of an example method for video processing is shown.

[0086] Figures 39A to 39E A flowchart of an example method for video processing is shown.

[0087] Figure 40A and Figure 40B An example of a hardware platform for implementing the visual media decoding or visual media encoding technologies described in this document is shown. Detailed Implementation

[0088] Video processing methods and technologies are ubiquitous in modern technology due to the ever-increasing demand for higher resolution video. Video codecs typically consist of electronic circuitry or software that compresses or decompresses digital video and are constantly being improved to provide higher encoding and decoding efficiency. A video codec converts uncompressed video into a compressed format and vice versa. There is a complex relationship between video quality, the amount of data used to represent the video (determined by the bit rate), the complexity of the encoding and decoding algorithms, sensitivity to data loss and errors, ease of editing, random access, and end-to-end latency (delay). Compression formats typically conform to standard video compression specifications, such as the High Efficiency Video Coding (HEVC) standard (also known as H.265 or MPEG-H Part 2), the pending Versatile Video Coding standard, or other current and / or future video codec standards.

[0089] Embodiments of the disclosed techniques can be applied to existing video codec standards (e.g., HEVC, H.265) and future standards to improve compression performance. Section headings are used in this document to improve readability and do not in any way limit the discussion or embodiments (and / or implementations) to the respective sections.

[0090] 1. Example of inter-frame prediction in HEVC / H.265

[0091] In recent years, video codec standards have seen significant improvements, and now offer, in some aspects, high encoding and decoding efficiency and support for higher resolutions. Recent standards (such as HEVC and H.265) are based on a hybrid video codec architecture, which utilizes temporal prediction plus transform encoding and decoding.

[0092] 1.1 Examples of Predictive Patterns

[0093] Each inter-frame prediction unit (PU) has motion parameters for one or two lists of reference images. In some embodiments, the motion parameters include motion vectors and reference image indices. In other embodiments, the use of one of the two lists of reference images may also be signaled using inter_pred_idc. In still other embodiments, the motion vectors may be explicitly encoded as increments relative to the predicted values.

[0094] When encoding and decoding a CU in skip mode, a PU is associated with the CU and there are no significant residual coefficients, no encoded motion vector increments, or reference picture indices. A Merge mode is specified, thereby obtaining the motion parameters of the current PU from neighboring PUs, including spatial and temporal candidates. The Merge mode can be applied to any inter-frame prediction PU, not just skip mode. An alternative to the Merge mode is explicit transmission of motion parameters, where the motion vectors (more precisely, the motion vector difference (MVD) compared to the predicted motion vector values), the corresponding reference picture index for each reference picture list, and the reference picture list are explicitly signaled per PU. This type of mode is named Advanced Motion Vector Prediction (AMVP) in this document.

[0095] When signaling indicates that one of two lists of reference images should be used, a PU is generated from a sample block. This is called "one-way prediction". One-way prediction applies to both P-strips and B-strips.

[0096] When signaling indicates that two reference image lists should be used, a PU is generated from two sample blocks. This is called "bidirectional prediction". Bidirectional prediction is only applicable to B-strips.

[0097] Reference Image List

[0098] In HEVC, the term inter-frame prediction is used to describe predictions derived from data elements (e.g., sample values ​​or motion vectors) of reference images other than the currently decoded image. As in H.264 / AVC, images can be predicted from multiple reference images. The reference images used for inter-frame prediction are organized into one or more reference image lists. A reference index identifies which reference image in the list should be used to create the predicted signal.

[0099] A single list of reference images (list 0) is used for the P-strip, and two lists of reference images (list 0 and list 1) are used for the B-strip. It should be noted that the reference images included in lists 0 / 1 can be selected based on past and future images in terms of capture / display order.

[0100] 1.1.1 Implementation Examples for Constructing Candidate Merge Patterns

[0101] When predicting the PU using the Merge pattern, the indices pointing to entries in the Merge candidate list are parsed from the bitstream and used to retrieve motion information. The construction of this list can be summarized according to the following sequence of steps:

[0102] Step 1: Initial Candidate Derivation

[0103] Step 1.1: Spatial Candidate Derivation

[0104] Step 1.2: Redundancy check of airspace candidates

[0105] Step 1.3: Time-domain candidate derivation

[0106] Step 2: Add candidate insertions

[0107] Step 2.1: Create bidirectional prediction candidates

[0108] Step 2.2: Insert zero-motion candidates

[0109] Figure 1 An example of constructing the Merge candidate list based on the sequence of steps summarized above is shown. For spatial Merge candidate derivation, up to four Merge candidates are selected from candidates located at five different positions. For temporal Merge candidate derivation, up to one Merge candidate is selected from two candidates. Since the number of candidates per PU is assumed to be constant at the decoder, additional candidates are generated when the number of candidates does not reach the maximum number of Merge candidates (MaxNumMergeCand) signaled in the stripe header. Because the number of candidates is constant, the index of the best Merge candidate is encoded using Truncated Unary (TU). If the CU size is equal to 8, all PUs of the current CU share a single Merge candidate list, which is the same as the Merge candidate list for a 2N×2N prediction unit.

[0110] 1.1.2 Constructing Spatial Merge Candidates

[0111] In the derivation of the spatial Merge candidate, from the position located Figure 2 Up to four merge candidates are selected from the candidates at the positions depicted. The derivation order is A1, B1, B0, A0, and B2. Position B2 is considered only if any PU at positions A1, B1, B0, or A0 is unavailable (e.g., because it belongs to another strip or slice) or if it is intra-frame encoding / decoding. After the candidate at position A1 is added, a redundancy check is performed on the addition of the remaining candidates. This redundancy check ensures that candidates with the same motion information are excluded from the list, thereby improving encoding / decoding efficiency.

[0112] To reduce computational complexity, not all possible candidate pairs are considered in the aforementioned redundancy check. Instead, only those in... Figure 3 The pairs linked by arrows are added to the list only if the candidate used for redundancy checking does not have the same motion information. Another source of duplicate motion information is a "second PU" associated with partitions different from 2N×2N. As an example, Figure 4A and Figure 4B The second PU is depicted for N×2N and 2N×N scenarios respectively. When the current PU is segmented into N×2N, the candidate at position A1 is not considered for list construction. In some embodiments, adding this candidate may result in two prediction units having the same motion information, which is redundant for an encoding / decoding unit with only one PU. Similarly, when the current PU is segmented into 2N×N, position B1 is not considered.

[0113] 1.1.3 Constructing Temporal Merge Candidates

[0114] In this step, only one candidate is added to the list. Specifically, in the derivation of this temporal merge candidate, the scaled motion vector is derived based on the juxtaposed PU of the image that has the smallest POC difference with the current image within the given list of reference images. The list of reference images that will be used for the derivation of the juxtaposed PU is displayed in the strip header via ground signaling notification.

[0115] Figure 5 An example of the derivation of the scaled motion vector for the temporal merge candidate is shown (as indicated by the dashed line). This motion vector is scaled from the motion vector of the juxtaposed PU using POC distances tb and td, where tb is defined as the POC difference between the reference image and the current image, and td is defined as the POC difference between the reference image and the juxtaposed image. The reference image index for the temporal merge candidate is set to zero. For the B-strip, two motion vectors are obtained, one for reference image list 0 and the other for reference image list 1, and they are combined to form a bidirectional predicted merge candidate.

[0116] like Figure 6 The description describes the selection of a temporal candidate position between candidate C0 and C1 within the juxtaposed PU(Y) belonging to the reference frame. If the PU at position C0 is unavailable, intra-frame encoded, or outside the current CTU, position C1 is used. Otherwise, position C0 is used in the derivation of the temporal merge candidate.

[0117] 1.1.4 Constructing Merge Candidates for Additional Types

[0118] In addition to the spatiotemporal merge candidate, there are two additional types of merge candidates: combined bidirectional prediction merge candidates and zero merge candidates. Combined bidirectional prediction merge candidates are generated by utilizing the spatiotemporal merge candidate. Combined bidirectional prediction merge candidates are only used for B-strips. Combined bidirectional prediction candidates are generated by combining the motion parameters of the first reference image list of the initial candidate with the motion parameters of the second reference image list of the other. If these two tuples provide different motion hypotheses, they will form a new bidirectional prediction candidate.

[0119] Figure 7 An example of this process is shown, where two candidates from the original list (710, on the left) with mvL0 and refIdxL0 or mvL1 and refIdxL1 are used to create bidirectional predictive merge candidates that are added to the final list (720, on the right). There are many rules regarding combinations that are considered to generate these additional merge candidates.

[0120] Zero-motion candidates are inserted to populate the remaining entries in the Merge candidate list, thus reaching the MaxNumMergeCand capacity. These candidates have zero spatial displacement and a reference image index, which starts at zero and increases whenever a new zero-motion candidate is added to the list. The number of reference frames used for these candidates is one for unidirectional prediction and two for bidirectional prediction. In some embodiments, redundancy checks are not performed on these candidates.

[0121] 1.2 Example of Advanced Motion Vector Prediction (AMVP)

[0122] AMVP utilizes the spatiotemporal correlation between motion vectors and neighboring PUs for explicit transmission of motion parameters. A motion vector candidate list is constructed by first checking the availability of neighboring PU locations in the left and upper temporal domains, removing redundant candidates, and adding zero vectors to keep the candidate list length constant. The encoder can then select the best prediction from the candidate list and send the corresponding index indicating the selected candidate. Similar to Merge index signaling, the index of the best motion vector candidate uses truncated unary coding. In this case, the maximum value to be encoded is 2 (see...). Figure 8 The following sections provide details of the derivation process for the motion vector prediction candidates.

[0123] 1.2.1 Example of deriving AMVP candidates

[0124] Figure 8 The derivation process for motion vector prediction candidates is summarized and can be implemented for each list of reference images with refidx as input.

[0125] In motion vector prediction, two types of motion vector candidates are considered: spatial motion vector candidates and temporal motion vector candidates. For the derivation of spatial motion vector candidates, based on the previously... Figure 2 The motion vectors of each PU at the five different locations shown are used to ultimately derive two motion vector candidates.

[0126] For temporal motion vector candidate derivation, one motion vector candidate is selected from two candidates derived based on two different juxtaposition positions. After generating the first spatiotemporal candidate list, duplicate motion vector candidates in the list are removed. If the number of potential candidates is greater than two, motion vector candidates with reference image indices greater than 1 are removed from the associated reference image list. If the number of spatiotemporal motion vector candidates is less than two, additional zero motion vector candidates are added to the list.

[0127] 1.2.2 Constructing Candidate Spatial Motion Vectors

[0128] In the derivation of the spatial motion vector candidates, at most two candidates are considered from five potential candidates, and these five potential candidates are selected from those located as previously... Figure 2 The positions shown are derived from the PUs, which are the same as the positions of the motion merge. The derivation order to the left of the current PU is defined as A0, A1, and scaled A0, scaled A1. The derivation order to the top of the current PU is defined as B0, B1, B2, scaled B0, scaled B1, scaled B2. Therefore, for each side, there are four cases that can be used as motion vector candidates, two of which do not require spatial scaling, and two of which do. These four different cases are summarized as follows:

[0129] --No spatial scaling

[0130] (1) Same list of reference images and same index of reference images (same POC)

[0131] (2) Different lists of reference images but the same reference image (same POC)

[0132] --Spatial scaling

[0133] (3) Same list of reference images but different reference images (different POCs)

[0134] (4) Different lists of reference images and different reference images (different POCs)

[0135] First, check for cases without spatial scaling, then check for cases where spatial scaling is allowed. Regardless of the reference image list, consider spatial scaling when the Proof of Concept (POC) differs between the reference image of a neighboring PU and the reference image of the current PU. If all candidate PUs on the left are unavailable or intra-frame encoded / decoded, scaling of the upper motion vector is allowed to aid in the parallel derivation of left and upper motion vector candidates. Otherwise, spatial scaling of the upper motion vector is not allowed.

[0136] like Figure 9As shown in the example, for spatial scaling, the motion vectors of neighboring PUs are scaled in a manner similar to temporal scaling. One difference is that a list of reference images and the index of the current PU are given as input; the actual scaling process is the same as that for temporal scaling.

[0137] 1.2.3 Constructing Temporal Motion Vector Candidates

[0138] Apart from the derivation of the reference image index, all the procedures for deriving the temporal Merge candidate are the same as those for deriving the spatial motion vector candidate (e.g., ...). Figure 6 (As shown in the example). In some embodiments, the reference image index is signaled to the decoder.

[0139] 2. Examples of inter-frame prediction methods in the Joint Exploration Model (JEM)

[0140] In some embodiments, reference software known as the Joint Exploration Model (JEM) is used to explore future video coding and decoding techniques. In the JEM, sub-block-based prediction is employed in several coding and decoding tools, such as affine prediction, optional temporal motion vector prediction, spatiotemporal motion vector prediction, bidirectional optical flow (BIO), frame-rate up conversion (FRUC), locally adaptive motion vector resolution (LAMVR), overlapped block motion compensation (OBMC), local illumination compensation (LIC), and decoder-side motion vector refinement (DMVR).

[0141] 2.1 Example of motion vector prediction based on sub-CU

[0142] In a JEM with Quadtrees plus Binary Trees (QTBT), each CU can have at most one set of motion parameters for each prediction direction. In some embodiments, two sub-CU-level motion vector prediction methods are considered in the encoder by dividing the large CU into sub-CUs and deriving the motion information of all sub-CUs of the large CU. The Optional Temporal Motion Vector Prediction (ATMVP) method allows each CU to obtain multiple sets of motion information from multiple blocks smaller than the current CU in the juxtaposed reference image. In the Spatial-Temporal Motion Vector Prediction (STMVP) method, the motion vectors of the sub-CUs are recursively derived using temporal motion vector prediction values ​​and spatially neighboring motion vectors. In some embodiments, motion compression of the reference frame can be disabled to preserve a more accurate motion field for sub-CU motion prediction.

[0143] 2.1.1 Example of Optional Temporal Motion Vector Prediction (ATMVP)

[0144] In the ATMVP method, the temporal motion vector prediction (TMVP) method is modified by obtaining multiple sets of motion information (including motion vectors and reference indices) from blocks smaller than the current CU.

[0145] Figure 10 An example of the ATMVP motion prediction process for CU 1000 is shown. The ATMVP method predicts the motion vectors of sub-CUs 1001 within CU 1000 in two steps. The first step is to identify the corresponding block 1051 in reference image 1050 using a temporal vector. Reference image 1050 is also referred to as the motion source image. The second step is to divide the current CU 1000 into sub-CUs 1001 and obtain the motion vector and reference index of each sub-CU from the block corresponding to each sub-CU.

[0146] In the first step, reference image 1050 and the corresponding block are determined by the motion information of spatially neighboring blocks of the current CU 1000. To avoid repeated scanning of neighboring blocks, the first merge candidate in the merge candidate list of the current CU 1000 is used. The first available motion vector and its associated reference index are set as the temporal vector and index of the motion source image. In this way, the corresponding block can be identified more accurately than TMVP, where the corresponding block (sometimes called the juxtaposed block) is always located in the lower right or center position relative to the current CU.

[0147] In the second step, the corresponding block of sub-CU 1051 is identified by the temporal vector in the motion source image 1050 by adding a temporal vector to the coordinates of the current CU. For each sub-CU, the motion information of its corresponding block (e.g., the minimum motion grid covering the center sample) is used to derive the motion information of the sub-CU. After the motion information of the corresponding N×N block is identified, it is converted into the motion vector and reference index of the current sub-CU in the same way as the TMVP of HEVC, where motion scaling and other processes are applied. For example, the decoder checks whether a low-latency condition is met (e.g., the POC of all reference images of the current image is less than the POC of the current image) and may use the motion vector MVx (e.g., the motion vector corresponding to the reference image list X) to predict the motion vector MVy of each sub-CU (e.g., where X equals 0 or 1 and Y equals 1-X).

[0148] 2.1.2 Example of Space-Time Motion Vector Prediction (STMVP)

[0149] In the STMVP method, the motion vectors of the sub-CUs are recursively derived according to the raster scan order. Figure 11 An example of a CU with four sub-blocks and neighboring blocks is shown. Consider an 8×8 CU 1100, which includes four 4×4 sub-CUs A(1101), B(1102), C(1103), and D(1104). The neighboring 4×4 blocks in the current frame are labeled a(1111), b(1112), c(1113), and d(1114).

[0150] Motion derivation for sub-CU A begins by identifying its two spatial neighbors. The first neighbor is the N×N block (block c 1113) above sub-CU A1101. If block c (1113) is unavailable or intra-frame encoded, the other N×N blocks above sub-CU A (1101) are checked (from left to right, starting from block c 1113). The second neighbor is the block to the left of sub-CU A1101 (block b 1112). If block b (1112) is unavailable or intra-frame encoded, the other blocks to the left of sub-CU A1101 are checked (from top to bottom, starting from block b 1112). Motion information obtained from neighboring blocks in each list is scaled to the first reference frame for the given list. Next, the temporal motion vector prediction (TMVP) for sub-block A 1101 is derived by following the same procedure as the TMVP derivation specified in HEVC. Motion information for the juxtaposed block at block D 1104 is acquired and scaled accordingly. Finally, after retrieving and scaling the motion information, all available motion vectors are averaged separately for each reference list. The averaged motion vector is then specified as the motion vector for the current sub-CU.

[0151] 2.1.3 Example of Sub-CU Motion Prediction Mode Signaling

[0152] In some embodiments, sub-CU modes are enabled as additional Merge candidates, and no additional syntax elements are required to signal these modes. Two additional Merge candidates are added to the Merge candidate list for each CU to represent the ATMVP and STMVP modes. In other embodiments, up to seven Merge candidates can be used if the sequence parameter set indicates that ATMVP and STMVP are enabled. The encoding logic for the additional Merge candidates is the same as that for the Merge candidates in the HM, meaning that for each CU in a P-strip or B-strip, the two additional Merge candidates may require two additional RD checks. In some embodiments, such as JEM, all binary bits (bins) of the Merge index are context-coded using CABAC (Context-based Adaptive Binary Arithmetic Coding). In other embodiments, such as HEVC, only the first binary bit is context-coded, while the remaining binary bits are context-bypass coded.

[0153] 2.2 Example of Local Illumination Compensation (LIC) in JEM

[0154] Local illumination compensation (LIC) is based on a linear model of illumination variation, using a scaling factor a and an offset b. It is adaptively enabled or disabled for each inter-frame mode codec's codec unit (CU).

[0155] When LIC is applied to CU, the least squares method is used to derive parameters a and b by using the neighboring samples of the current CU and their corresponding reference samples. More specifically, as... Figure 12 As shown, the neighboring and corresponding sample points (identified by the motion information of the current CU or sub-CU) are obtained by using the secondary sampling (2:1 secondary sampling) of the CU in the reference image.

[0156] 2.2.1 Derivation of the prediction block

[0157] IC parameters are derived and applied for each prediction direction. For each prediction direction, a first prediction block is generated using the decoded motion information, and then a temporary prediction block is obtained by applying the LIC model. Finally, the final prediction block is derived using two temporary prediction blocks.

[0158] When encoding and decoding the CU in Merge mode, the LIC flag is copied from the neighboring block in a manner similar to motion information copying in Merge mode; otherwise, the LIC flag is signaled to the CU to indicate whether LIC is applicable.

[0159] When LIC is enabled for an image, additional CU-level RD checks are required to determine if LIC is suitable for the CU. When LIC is enabled for the CU, the Mean-Removed Sum of Absolute Difference (MR-SAD) and the Mean-Removed Sum of Absolute Hadamard-Transformed Difference (MR-SATD), instead of SAD and SATD, are used for integer pixel motion search and fractional pixel motion search, respectively.

[0160] To reduce coding complexity, the following coding scheme is applied in JEM: when there is no significant lighting change between the current image and its reference images, LIC is disabled for the entire image. To identify this situation, histograms of the current image and each reference image of the current image are calculated at the encoder. If the histogram difference between the current image and each reference image of the current image is less than a given threshold, LIC is disabled for the current image; otherwise, LIC is enabled for the current image.

[0161] 2.3 Examples of Inter-Frame Prediction Methods in VVC

[0162] Several new codec tools for improving inter-frame prediction exist, such as Adaptive Motion Vector Difference Resolution (AMVR) for signaling notification MVD, affine prediction mode, Triangular Prediction Mode (TPM), ATMVP, Generalized Bi-Prediction (GBI), and Bi-directional Optical Flow (BIO).

[0163] 2.3.1 Example of codec block structure in VVC

[0164] In VVC, a quadtree / binary tree / multi-tree (QT / BT / TT) structure is used to divide the image into square or rectangular blocks. In addition to QT / BT / TT, a separate tree (also known as a dual codec tree) is also used for I-frames in VVC. For the separate tree, the codec block structure is signaled separately for the luma and chroma components.

[0165] 2.3.2 Example of Adaptive Motion Vector Difference Resolution

[0166] In some embodiments, when the use_integer_mv_flag in the stripe header is equal to 0, the motion vector difference (MVD) is signaled in units of quarter-luminance samples (QMS). Local Adaptive Motion Vector Resolution (LAMVR) is introduced in JEM. In JEM, MVD can be encoded and decoded in units of quarter-luminance samples, integer luminance samples, or four luminance samples. MVD resolution is controlled at the codec unit (CU) level, and for each CU with at least one non-zero MVD component, the MVD resolution flag is conditionally signaled.

[0167] For a CU with at least one non-zero MVD component, a signaling flag is used to indicate whether quarter-luminance sample MV precision is used in the CU. When the first flag (equal to 1) indicates that quarter-luminance sample MV precision is not used, another flag is signaled to indicate whether integer luminance sample MV precision or four-luminance sample MV precision is used.

[0168] When the first MVD resolution flag of the CU is zero, or when no encoding or decoding is performed for the CU (meaning all MVDs in the CU are zero), the CU uses a quarter-lumen sample MV resolution. When the CU uses integer lumen sample MV precision or four-lumen sample MV precision, the MVPs in the CU's AMVP candidate list are rounded to the corresponding precision.

[0169] 2.3.3 Example of Affine Motion Compensation Prediction

[0170] In HEVC, only the translational motion model is applied to motion compensation prediction (MCP). However, cameras and objects can exhibit various motions, such as zooming in / out, rotation, perspective motion, and / or other irregular motions. In VVC, simplified affine transformation motion compensation prediction is applied using 4-parameter and 6-parameter affine models. Figure 13A and Figure 13B As shown, the affine motion field of the block is described by two (in a 4-parameter affine model using variables a, b, e, and f) or three (in a 6-parameter affine model using variables a, b, c, d, e, and f) control point motion vectors.

[0171] The motion vector field (MVF) of the block is described by the following equations with 4-parameter affine models and 6-parameter affine models, respectively:

[0172]

[0173]

[0174] In this article, (mvh 0,mv h 0) is the motion vector of the top-left control point (CP), and (mv h 1, MV h 1) is the motion vector of the upper right control point, and (mv h 2, MV h 2) is the motion vector of the lower left control point, where (x, y) represents the coordinates of the representative point relative to the upper left sample point within the current block. The CP motion vector can be signaled (e.g., in affine AMVP mode) or derived on the fly (e.g., in affine Merge mode). w and h are the width and height of the current block. In practice, division is implemented through right shift and rounding operations. In VTM, the representative point is defined as the center position of the sub-block; for example, when the coordinates of the upper left corner of the sub-block relative to the upper left sample point within the current block are (xs, ys), the coordinates of the representative point are defined as (xs+2, ys+2). For each sub-block (e.g., 4×4 in VTM), the motion vector of the entire sub-block is derived using the representative point.

[0175] Figure 14 An example of the affine MVF for each sub-block of block 1300 is shown, where a sub-block-based affine transformation prediction is applied to further simplify motion compensation prediction. To derive the motion vector for each M×N sub-block, the motion vector of the center sample point of each sub-block can be calculated according to equations (1) and (2) and rounded to the fractional accuracy of the motion vector (e.g., 1 / 16 in JEM). A motion compensation interpolation filter can then be applied to generate a prediction for each sub-block with the derived motion vector. The affine mode introduces an interpolation filter of 1 / 16 pixel. After MCP, the high-accuracy motion vector of each sub-block is rounded and preserved to the same accuracy as the standard motion vector.

[0176] 2.3.3.1 Example of signaling notification for affine prediction

[0177] Similar to the translational motion model, due to affine prediction, there are also two modes for signaling notification side information: AFFINE_INTER and AFFINE_MERGE modes.

[0178] 2.3.3.2 Example of AF_INTER mode

[0179] For CUs with both width and height greater than 8, the AF_INTER mode can be applied. The affine flag at the CU level is signaled in the bitstream to indicate whether the AF_INTER mode is used.

[0180] In this mode, for each list of reference images (list 0 or list 1), the affine AMVP candidate list is constructed in the following order using three types of affine motion prediction values, where each candidate includes the estimated CPMV of the current block. The best CPMV found on the encoder side (such as...) Figure 17 The difference between mv0, mv1, and mv2 in the estimated CPMV and the CPMV is signaled. Furthermore, a further signaling notification is given for the index of the affine AMVP candidate derived from the estimated CPMV.

[0181] 1) Inherited affine motion prediction values

[0182] The inspection order is similar to that of the spatial MVP in the HEVC AMVP list. First, inherited affine motion prediction values ​​from the left side of the first block derivation, which is affine-coded from {A1, A0} and has the same reference picture as the current block. Second, inherited affine motion prediction values ​​from the top side of the first block derivation, which is affine-coded from {B1, B0, B2} and has the same reference picture as the current block. Figure 16 The five blocks A1, A0, B1, B0, and B2 are depicted in the text.

[0183] Once a neighboring block is found to be encoded in affine mode, the CPMV of the codec unit covering the neighboring block is used to derive the predicted value of the CPMV for the current block. For example, if A1 is encoded in non-affine mode and A0 is encoded in 4-parameter affine mode, the inherited affine MV prediction value on the left will be derived from A0. In this case, the CPMV of the CU covering A0 (as shown in...) Figure 18B Zhongyou The upper left corner CPMV and the symbol formed by... The upper right CPMV (represented by the CPMV) is used to derive the estimated CPMV of the current block, by... This indicates the top left (coordinates (x0, y0)), top right (coordinates (x1, y1)), and bottom right (coordinates (x2, y2)) positions of the current block.

[0184] 2) Constructed affine motion prediction values

[0185] like Figure 17 As shown, the constructed affine motion predictions include control-point motion vectors (CPMVs) derived from neighboring inter-frame codec blocks with the same reference image. If the current affine motion model is a 4-parameter affine, the number of CPMVs is 2; otherwise, if the current affine motion model is a 6-parameter affine, the number of CPMVs is 3. (CPMVs are shown in the upper left corner.) The MV is derived from the first block in group {A, B, C} that is inter-coded and has the same reference picture as the current block. (CPMV in the upper right corner) The MV derivation is based on the first block in group {D, E} that is inter-coded and has the same reference image as the current block. (Lower left CPMV) The MV is derived from the first block in group {F, G} that is inter-frame encoded and decoded and has the same reference picture as the current block.

[0186] -If the current affine motion model is a 4-parameter affine, then only if and Only when both are established will the constructed affine motion predictions be inserted into the candidate list, that is, and The CPMV is used as an estimate of the top-left (coordinates (x0, y0)) and top-right (coordinates (x1, y1)) positions of the current block.

[0187] -If the current affine motion model is a 6-parameter affine, then only if and Only after all parameters are established will the constructed affine motion prediction values ​​be inserted into the candidate list, that is, and The CPMV is used as an estimate of the top-left (coordinates (x0, y0)), top-right (coordinates (x1, y1)), and bottom-right (coordinates (x2, y2)) positions of the current block.

[0188] When the constructed affine motion predictions are inserted into the candidate list, no pruning process is applied.

[0189] 3) Standard AMVP motion prediction value

[0190] Apply the following conditions until the number of affine motion predictions reaches its maximum value.

[0191] 1) If available, by setting all CPMV to equal To derive the predicted value of affine motion.

[0192] 2) If available, by setting all CPMV to equal To derive the predicted value of affine motion.

[0193] 3) If available, by setting all CPMV to equal To derive the predicted value of affine motion.

[0194] 4) If available, derive the affine motion predictions by setting all CPMVs to equal HEVC TMVP.

[0195] 5) The affine motion predictions were derived by setting all CPMVs to zero MV.

[0196] Please note, It has already been derived in the constructed affine motion prediction values.

[0197] In AF_INTER mode, when using the 4 / 6 parameter affine mode, 2 / 3 control points are required. Therefore, 2 / 3 MVD encoding / decoding is needed for these control points, such as... Figure 15A and Figure 15B As shown. In existing implementations, MV can be derived as follows, for example, it predicts mvd1 and mvd2 from mvd0.

[0198]

[0199]

[0200]

[0201] In this article, mvd i mv1 and mv1 are the predicted motion vector, motion vector difference, and motion vector of the top-left pixel (i=0), top-right pixel (i=1), or bottom-left pixel (i=2), respectively. Figure 15B As shown. In some embodiments, the sum of two motion vectors (e.g., mvA(xA, yA) and mvB(xB, yB)) is equal to the sum of the two components. For example, new MV = mvA + mvB means that the two components of the new MV are set to (xA + xB) and (yA + yB), respectively.

[0202] 2.3.3.3 Example of AF_Merge mode

[0203] When the CU is applied in AF_MERGE mode, it obtains the first block encoded and decoded in affine mode from the effective neighboring reconstructed blocks. The selection order of candidate blocks is from left, top, upper right, lower left to upper left, as follows: Figure 18A As shown (represented by A, B, C, D, E in order). For example, if the adjacent lower left block is like... Figure 18B If A0 represents the code that is encoded and decoded in affine mode, then the motion vector mv0 of the control points (CPs) at the top left, top right, and bottom left corners of the neighboring CUs / PUs containing block A is obtained. N mv1 N and mv2 N And based on mv0 N mv1 N and mv2 N Calculate the motion vector mv0 of the top left / top right / bottom left corner on the current CU / PU.C mv1 C and mv2 C (For 6-parameter affine model only). Note that in VTM-2.0, the top-left sub-block (e.g., a 4×4 block in VTM) stores mv0, and the top-right sub-block stores mv1 if the current block is affine encoded. If the current block is encoded using a 6-parameter affine model, the bottom-left sub-block stores mv2; otherwise (using a 4-parameter affine model), the LB stores mv2'. Other sub-blocks store the MV used for MCs.

[0204] After calculating the CPMV of the current CU v0 and v1 according to the affine motion model in equations (1) and (2), the MVF of the current CU can be generated. In order to identify whether the current CU is encoded and decoded in AF_MERGE mode, an affine flag can be signaled in the bitstream when at least one neighboring block is encoded and decoded in affine mode.

[0205] In some embodiments (e.g., JVET-L0142 and JVET-L0632), the affine Merge candidate list can be constructed using the following steps:

[0206] 1) Insertion of affine candidates for inheritance

[0207] Inherited affine candidates are those derived from the affine motion models of their effective neighboring affine codec blocks. The two largest inherited affine candidates are derived from the affine motion models of neighboring blocks and inserted into the candidate list. For left-side predictions, the scan order is {A0, A1}; for top-side predictions, the scan order is {B0, B1, B2}.

[0208] 2) Insertion of constructed affine candidates

[0209] If the number of candidates in the affine Merge candidate list is less than MaxNumAffineCand (set to 5 in this paper), the constructed affine candidate is inserted into the candidate list. The constructed affine candidate is one that is built by combining the neighboring motion information of each control point.

[0210] a) The motion information of the control points first comes from... Figure 19 The derivation is performed using the specified spatial and temporal neighbors. CPk (k = 1, 2, 3, 4) represents the k-th control point. A0, A1, A2, B0, B1, B2, and B3 are the spatial locations used to predict CPk (k = 1, 2, 3); T is the temporal location used to predict CP4.

[0211] The coordinates of CP1, CP2, CP3 and CP4 are (0, 0), (W, 0), (H, 0) and (W, H) respectively, where W and H are the width and height of the current block.

[0212] Motion information for each control point is obtained according to the following priority order:

[0213] For CP1, the check priority is B2→B3→A2. If B2 is available, then B2 is used. Otherwise, if B2 is available, then B3 is used. If neither B2 nor B3 is available, then A2 is used. If all three candidates are unavailable, motion information for CP1 cannot be obtained.

[0214] For CP2, the inspection priority is B1→B0.

[0215] For CP3, the inspection priority is A1→A0.

[0216] For CP4, use T.

[0217] b) Next, use combinations of control points to construct affine Merge candidates.

[0218] I. Motion information from three control points is needed to construct a 6-parameter affine candidate. The three control points can be selected from one of the following four combinations ({CP1, CP2, CP4}, {CP1, CP2, CP3}, {CP2, CP3, CP4}, {CP1, CP3, CP4}). The combinations {CP1, CP2, CP3}, {CP2, CP3, CP4}, and {CP1, CP3, CP4} will be converted into a 6-parameter motion model represented by the upper left, upper right, and lower left control points.

[0219] II. Motion information from two control points is required to construct a 4-parameter affine candidate. The two control points can be selected from one of the following six combinations ({CP1, CP4}, {CP2, CP3}, {CP1, CP2}, {CP2, CP4}, {CP1, CP3}, {CP3, CP4}). The combination {CP1, CP4}, {CP2, CP3}, {CP2, CP4}, {CP1, CP3}, and {CP3, CP4} will be converted into a 4-parameter motion model represented by the upper left and upper right control points.

[0220] III. The combinations of the constructed affine candidates are inserted into the candidate list in the following order:

[0221] {CP1, CP2, CP3}, {CP1, CP2, CP4}, {CP1, CP3, CP4}, {CP2, CP3, CP4}, {CP1, CP2}, {CP1, CP3}, {CP2, CP3}, {CP1, CP4}, {CP2, CP4}, {CP3, CP4}

[0222] i. For a combined reference list X (X is 0 or 1), the reference index with the highest usage of the control points is selected as the reference index of list X, and the scaling is directed to the motion vector of the difference reference image.

[0223] After a candidate is derived, a full pruning process is performed to check if the same candidate has already been inserted into the list. If the same candidate exists, the derived candidate is discarded.

[0224] 3) Fill with zero motion vector

[0225] If the number of candidates in the affine Merge candidate list is less than 5, a zero motion vector with a zero reference index is inserted into the candidate list until the list is full.

[0226] More specifically, for the sub-block Merge candidate list, MV is set to (0, 0) and the prediction direction is set to the 4-parameter Merge candidate from the unidirectional prediction (for P-strips) and bidirectional prediction (for B-strips) of list 0.

[0227] 2.3.4 Example of Merge with Motion Vector Difference (MMVD)

[0228] JVET-L0054 presents the Ultimate Motion Vector Expression (UMVE, also known as MMVD). UMVE, along with a proposed motion vector expression method, is used for skip or merge modes.

[0229] UMVE reuses the same Merge candidates as those included in the regular Merge candidate list in VVC. Among these Merge candidates, a basic candidate can be selected and further extended using the proposed motion vector representation method.

[0230] UMVE provides a new method for representing motion vector difference (MVD), in which MVD is represented by the starting point, motion amplitude, and motion direction.

[0231] This proposed technique uses the Merge candidate list as is. However, only candidates of the default Merge type (MRG_TYPE_DEFAULT_N) are considered for UMVE extensions.

[0232] The basic candidate index defines the starting point. The basic candidate index indicates the best candidate among the candidates in the list, as shown below.

[0233] Table 1: Basic Candidate IDX

[0234] Basic candidate IDX 0 1 2 3 Nth MVP First MVP Second MVP Third MVP Fourth MVP

[0235] If the number of basic candidates is equal to 1, then the basic candidate IDX will not be notified by signaling.

[0236] The distance index is motion amplitude information. The distance index indicates a predefined distance from the starting point. The predefined distances are shown below:

[0237] Table 2: Distance from IDX

[0238] Distance from IDX 0 1 2 3 4 5 6 7 Pixel distance 1 / 4 pixel 1 / 2 pixel 1 pixel 2 pixels 4 pixels 8 pixels 16 pixels 32 pixels

[0239] The direction index represents the direction of MVD relative to the starting point. The direction index can represent the four directions shown below.

[0240] Table 3: Directional IDX

[0241] Directional IDX 00 01 10 11 x-axis + – N / A N / A y-axis N / A N / A + –

[0242] In some embodiments, the UMVE flag is signaled immediately after the skip or merge flag is transmitted. If the skip or merge flag is true, the UMVE flag is resolved. If the UMVE flag is equal to 1, the UMVE syntax is resolved. However, if it is not 1, the AFFINE flag is resolved. If the AFFINE flag is equal to 1, it is in AFFINE mode; otherwise, the skip / merge index is resolved to the VTM's skip / merge mode.

[0243] There is no need for an additional line buffer due to UMVE candidates. This is because the software's skip / merge candidates are used directly as the base candidates. The MV supplement is determined immediately before motion compensation using the input UMVE index. There is no need to reserve a long line buffer for this.

[0244] Under the current general testing conditions, the first or second Merge candidate in the Merge candidate list can be selected as the basic candidate.

[0245] 2.3.5 Example of Decoder-Side Motion Vector Refinement (DMVR)

[0246] In bidirectional prediction, for the prediction of a block region, two prediction blocks formed using motion vectors (MV) from list 0 and MV from list 1 are combined to form a single prediction signal. In the decoder-side motion vector refinement (DMVR) method, the two motion vectors of the bidirectional prediction are further refined.

[0247] In the JEM design, motion vectors are refined through a bilateral template matching process. Bilateral template matching is applied in the decoder to perform a distortion-based search between the bilateral templates and reconstructed samples in the reference image, in order to obtain refined MV values ​​without the transmission of additional motion information. Figure 22 An example is depicted. The bilateral template is generated as a weighted combination (i.e., average) of two prediction blocks, one from initial MV0 of list 0 and the other from initial MV1 of list 1, as shown below. Figure 22 As shown. The template matching operation involves calculating a cost metric between the generated template and the sample region (around the initial prediction block) in the reference image. For each of the two reference images, the MV that produces the minimum template cost is considered the updated MV for that list, replacing the original MV. In JEM, nine MV candidates are searched for each list. The nine MV candidates include the original MV and eight surrounding MVs offset by one brightness sample from the original MV in the horizontal, vertical, or both directions. Finally, as... Figure 22 The two new MVs shown (i.e., MV0' and MV1') are used to generate the final bidirectional prediction result. The sum of absolute differences (SAD) is used as the cost metric. Note that when calculating the cost of a prediction block generated by a surrounding MV, the predicted block is actually obtained using the rounded MV (to integer pixels), not the actual MV.

[0248] To further simplify the DMVR process, JVET-M0147 proposes several changes to the design in JEM. More specifically, the DMVR design adopted by VTM-4.0 (coming soon) has the following key features:

[0249] o Premature termination between list 0 and list 1 w / (0,0) position SAD

[0250] The block size of οDMVR, W*H>=64 &&H>=8

[0251] The CU is divided into multiple DMVR 16×16 sub-blocks with CU size > 16*16.

[0252] Reference block size (W+7)*(H+7) (for brightness)

[0253] ο25-point SAD-based integer pixel search (i.e., (+-2) refinement of the search range, single stage)

[0254] ο DMVR based on bilinear interpolation

[0255] ο MVD mirroring between list 0 and list 1, allowing bidirectional matching

[0256] Sub-pixel thinning based on "parameter error surface equation"

[0257] o Brightness / Chroma MC w / Reference block fill (if needed)

[0258] ο Detailed MVs for MC and TMVP only

[0259] 2.3.6 Example of Combined Intra and Inter Prediction (CIIR)

[0260] In JVET-L0100, multi-hypothesis prediction is proposed, in which combined intra-frame and inter-frame prediction is one way to generate multiple hypotheses.

[0261] When applying multiple hypothesis prediction (MMP) to improve intra-mode, MMP combines an intra-prediction and a Merge index prediction. In the Merge CU, when a flag is true, a flag is signaled for Merge mode to select an intra-mode from the intra-candidate list. For the luma component, the intra-candidate list is derived from four intra-prediction modes: DC, planar, horizontal, and vertical, and the size of the intra-candidate list can be 3 or 4 depending on the block shape. The horizontal mode is not included in the intra-mode list when the CU width is greater than twice the CU height, and the vertical mode is removed from the intra-mode list when the CU height is greater than twice the CU width. A weighted average is used to combine an intra-prediction mode selected by the intra-mode index and a Merge index prediction selected by the Merge index. For the chroma component, DM is always applied without additional signaling. The weights used to combine the predictions are described below. Equal weights are applied when DC or planar modes are selected, or when the CB width or height is less than 4. For CBs with a width and height greater than or equal to 4, when selecting horizontal / vertical mode, a CB is first divided vertically / horizontally into four equal-area regions. Each weight set (represented as (w_intra)) i w_inter i ), where i ranges from 1 to 4 and (w_intra1, w_inter1) = (6, 2), (w_intra2, w_inter2) = (5, 3), (w_intra3, w_inter3) = (3, 5), and (w_intra4, w_inter4) = (2, 6) will be applied to the corresponding regions. (w_intra1, w_inter1) is used for the region closest to the reference sample, while (w_intra4, w_inter4) is used for the region furthest from the reference sample. The combined prediction can then be calculated by adding the two weighted predictions and shifting them right by 3 bits. Furthermore, the intra-frame prediction mode of the intra-frame assumptions of the prediction values ​​can be saved for subsequent reference by neighboring CUs.

[0262] 2.4 Loop Shaping (ILR) in JVET-M 0427

[0263] The basic idea of ​​loop shaping (ILR) is to transform the original (first domain) signal (predicted / reconstructed signal) to the second domain (shaping domain).

[0264] The loop luminance shaper is implemented as a pair of look-up tables (LUTs), but only one of the two LUTs needs to be signaled, as the other LUT can be computed from the signaled LUT. Each LUT is a one-dimensional, 10-bit, 1024-entry mapping table (1D-LUT). One LUT is a forward LUT, FwdLUT, which takes the input luminance code value Y as input. i Mapped to the changed value Y r Y r =FwdLUT[Y i Another LUT is the inverse LUT, InvLUT, which modifies the code value Y. r Mapped to ( Y represents i (Reconstructed value).

[0265] 2.4.1 Piecewise Linear (PWL) Model

[0266] In some embodiments, piecewise linear (PWL) is implemented in the following manner:

[0267] Let x1 and x2 be two input pivot points, and y1 and y2 be their corresponding output pivot points for a piece. The output value y for any input value x between x1 and x2 can be interpolated using the following equation:

[0268] y=((y2-y1) / (x2-x1))*(x-x1)+y1

[0269] In the fixed-point implementation, the equation can be rewritten as:

[0270] y=((m*x+2FP_PREC-1)>>FP_PREC)+c

[0271] Where m is a scalar, c is the offset, and FP_PREC is a constant value specifying precision.

[0272] Please note that in the CE-12 software, the PWL model is used to pre-compute the FwdLUT and InvLUT mapping tables with 1024 entries; however, the PWL model also allows for implementations that can compute the same mapping values ​​on the fly without pre-compiling the LUTs.

[0273] 2.4.2 Test CE12-2

[0274] 2.4.2.1 Brightness Shaping

[0275] Test 2 of loop luminance shaping (i.e., the proposed CE12-2) provides a pipeline with lower complexity that also eliminates the decoding latency of block-by-block intra-prediction in inter-strip reconstruction. Intra-prediction is performed in the shaping domains of both inter-frame and intra-strip structures.

[0276] Regardless of the stripe type, intra-frame prediction is always performed in the integer domain. With this arrangement, intra-frame prediction can begin immediately after the previous TU reconstruction is complete. This arrangement also provides a unified process for intra-frame modes, rather than relying on stripes. Figure 23 A block diagram of the pattern-based CE12-2 decoding process is shown.

[0277] CE12-2 also uses a 16-segment piecewise linear (PWL) model for luminance and chrominance residual scaling tests, instead of the 32-segment PWL model of CE12-1.

[0278] Inter-frame strip reconstruction using a loop luminance shaper in CE12-2 (light green shaded blocks indicate signals in the shaping domain: luminance residual; intra-frame luminance prediction; and intra-frame luminance reconstruction).

[0279] 2.4.2.2 Luma-dependent Chroma Residue Scaling (LCRS)

[0280] Luminance-dependent chroma residual scaling is a multiplication process implemented using fixed-point integer arithmetic. Chroma residual scaling compensates for the interaction between the luminance and chroma signals. Chroma residual scaling is applied at the TU level. More specifically, it applies in the following cases:

[0281] For intra-frame measurements, the reconstructed brightness is averaged.

[0282] For inter-frame measurements, the predicted brightness is averaged.

[0283] The average index is used to identify the PWL model. This index identifies the scaling factor cScaleInv. The chromaticity residual is multiplied by this number.

[0284] Note that the chroma scaling factor is calculated based on the predicted luminance value from the forward mapping, not the reconstructed luminance value.

[0285] 2.4.2.3 Signaling notification of ILR side information

[0286] Parameters (currently) are sent in the fragment group header (similar to ALF). These reportedly require 40-100 bits. Fragments can be another way to represent an image. The table below is based on JVET-L1001 version 9. Added syntax is highlighted in italics.

[0287] 7.3.2.1 Sequence Parameter Set RBSP Syntax

[0288]

[0289]

[0290] 7.3.3.1 Generalized piece group header syntax

[0291]

[0292] Add a new syntax sheet group shaper model:

[0293]

[0294] Add the following semantics to the generalized sequence parameter set RBSP semantics:

[0295] A value of 1 for `sps_reshaper_enabled_flag` specifies that a shaper is used in a Coded Video Sequence (CVS). A value of 0 for `sps_reshaper_enabled_flag` specifies that a shaper is not used in a CVS.

[0296] Add the following semantics to the fragment header syntax.

[0297] A tile_group_reshaper_model_present_flag value of 1 indicates that tile_group_reshaper_model() exists in the tile group header. A tile_group_reshaper_model_present_flag value of 0 indicates that tile_group_reshaper_model() does not exist in the tile group header. When tile_group_reshaper_model_present_flag does not exist, it is inferred to be equal to 0.

[0298] A tile_group_reshaper_enabled_flag value of 1 indicates that the shaper is enabled for the current tile group. A tile_group_reshaper_enabled_flag value of 0 indicates that the shaper is not enabled for the current tile group. When tile_group_reshaper_enable_flag does not exist, it is inferred to be equal to 0.

[0299] `tile_group_reshaper_chroma_residual_scale_flag` equals 0 and indicates that chroma residual scaling is enabled for the current tile group. A value of 0 for `tile_group_reshaper_chroma_residual_scale_flag` indicates that chroma residual scaling is not enabled for the current tile group. When `tile_group_reshaper_chroma_residual_scale_flag` does not exist, it is inferred to be equal to 0.

[0300] Add the `tile_group_reshaper_model()` syntax.

[0301] `reshape_model_min_bin_idx` specifies the minimum binary bit (or segment) index to use during the shaper construction process. The value of `reshape_model_min_bin_idx` should be in the range of 0 to `MaxBinIdx`, inclusive. The value of `MaxBinIdx` should be equal to 15.

[0302] `reshape_model_delta_max_bin_idx` specifies the maximum allowed binary bit (or segment) index `MaxBinIdx` minus the maximum binary bit index to be used during the shaper construction process. The value of `reshape_model_max_bin_idx` is set to equal to `MaxBinIdx – reshape_model_delta_max_bin_idx`.

[0303] The increment of 1 in `reshaper_model_bin_delta_abs_cw_prec_minus1` specifies the number of bits used to represent the syntax `reshape_model_bin_delta_abs_CW[i]`.

[0304] reshape_model_bin_delta_abs_CW[i] specifies the absolute increment codeword value for the i-th binary bit.

[0305] `reshaper_model_bin_delta_sign_CW_flag[i]` specifies the sign of `reshape_model_bin_delta_abs_CW[i]`, as shown below:

[0306] – If reshape_model_bin_delta_sign_CW_flag[i] equals 0, then the corresponding variable RspDeltaCW[i] is positive.

[0307] Otherwise (reshape_model_bin_delta_sign_CW_flag[i] is not equal to 0), the corresponding variable RspDeltaCW[i] is negative. When reshape_model_bin_delta_sign_CW_flag[i] does not exist, it is inferred to be equal to 0.

[0308] Variable RspDeltaCW[i]=(1 2*reshape_model_bin_delta_sign_CW[i])*reshape_model_bin_delta_abs_CW[i];

[0309] The variable RspCW[i] is derived as follows:

[0310] The variable OrgCW is set to equal to (1 < <BitDepth Y ) / (MaxBinIdx+1).

[0311] – If reshaper_model_min_bin_idx<=i<=reshaper_model_max_bin_idx

[0312] RspCW[i]=OrgCW+RspDeltaCW[i].

[0313] Otherwise, RspCW[i] = 0.

[0314] If BitDepth Y If the value is 10, then the value of RspCW[i] should be in the range of 32 to 2*OrgCW-1.

[0315] The variable InputPivot[i] (where i is in the range from 0 to MaxBinIdx+1, inclusive) is derived as follows:

[0316] InputPivot[i] = i * OrgCW

[0317] The derivation of variables ReshapePivot[i] (i is in the range of 0 to MaxBinIdx+1, inclusive), ScaleCoef[i], and InvScaleCoeff[i] (i is in the range of 0 to MaxBinIdx, inclusive) is as follows:

[0318]

[0319] The derivation of the variable ChromaScaleCoef[i] (where i is in the range from 0 to MaxBinIdx, inclusive) is as follows:

[0320] ChromaResidualScaleLut

[64] ={16384,16384,16384,16384,16384,16384,16384,8192,8192,8192,819 2,5461,5461,5461,5461,4096,4096,4096,4096,3277,3277,3277,3277,2731,2731,2731,2731,2341,23 41,2341,2048,2048,2048,1820,1820,1820,1638,1638,1638,1638,1489,1489,1489,1489,1365,1365,1365,1365,1260,1260,1260,1170,1170,1170,1092,1092,1092,1024,1024,1024,1024}

[0321] shiftC = 11

[0322] –If (RspCW[i] == 0)

[0323] ChromaScaleCoef[i] = (1 < <shiftC)

[0324] – Otherwise (RspCW[i]!=0), ChromaScaleCoef[i]=ChromaResidualScaleLut[RspCW[i]>>1]

[0325] 2.4.2.4 Use of ILR

[0326] On the encoder side, each picture (or group of pictures) is first converted to the integer domain. All encoding and decoding processes are performed in the integer domain. For intra-frame prediction, neighboring blocks are in the integer domain; for inter-frame prediction, reference blocks (generated from the original domain from the decoded picture buffer) are first converted to the integer domain. The residuals are then generated and encoded / decoded into a bitstream.

[0327] After the entire image (or group of images) has been encoded / decoded, the samples in the integer domain are converted to the original domain, and then deblocking filters and other filters are applied.

[0328] Forward shaping of the predicted signal should be disabled in the following cases:

[0329] The current block is intra-frame encoded / decoded.

[0330] The current block is encoded and decoded as CPR (Current Picture Referencing, also known as Intra Block Copy, IBC).

[0331] The current block is encoded and decoded as a combined inter-frame intra-frame mode (CIIP), and forward shaping is disabled for intra-frame prediction blocks.

[0332] JVET-N0805

[0333] In JVET-N0805, to avoid signaling the ILR's side information in the slice header, it is proposed to signal it in the APS. It includes the following main ideas:

[0334] –Optionally, LMCS parameters can be transmitted in SPS. LMCS refers to Luma Mapping With Chroma Scaling (LMCS) technology, as defined in relevant video codec standards.

[0335] – Define the APS type for the ALF and LMCS parameters. Each APS has only one type.

[0336] – Transmit LMCS parameters in APS

[0337] – If the LMCS tool is enabled, set a flag in TGH to indicate whether the LMCS aps_id exists. If there is no signaling notification, use the SPS parameter.

[0338] * Semantic constraints need to be added so that there is always a valid thing being referenced when the tool is enabled.

[0339] 2.5.2.5.1 Implementation of the proposed design on JVET-M1001 (VVC Working Draft 4)

[0340] The suggested changes are shown in italics below.

[0341]

[0342] ...

[0344] A value of 1 for sps_lmcs_enabled_flag specifies that luma mapping and chroma scaling are used in the codec video sequence (CVS). A value of 0 for sps_lmcs_enabled_flag specifies that luma mapping and chroma scaling are not used in CVS.

[0345] A value of 1 for `sps_lmcs_default_model_present_flag` indicates that default LMCS data exists in this SPS. A value of 0 for `sps_lmcs_default_model_flag` indicates that default LMCS data does not exist in this SPS. When it does not exist, the value of `sps_lmcs_default_model_present_flag` is inferred to be 0. ...

[0347]

[0348] aps_params_type specifies the type of APS parameters carried in APS, as specified in the table below:

[0349] Table 7-x – APS Parameter Type Codes and Types of APS Parameters

[0350]

[0351]

[0352] Add the following definition to Clause 3:

[0353] ALF APS: APS where aps_params_type is equal to ALF_APS.

[0354] LMCS APS: APS with aps_params_type equal to LMCS_APS.

[0355] Make the following semantic changes: ...

[0357] `tile_group_alf_aps_id` specifies the `adaptation_parameter_set_id` of the ALF APS referenced by the tile group. The `TemporalId` of the ALF APS NAL cell whose `adaptation_parameter_set_id` is equal to `tile_group_alf_aps_id` should be less than or equal to the `TemporalId` of the codec tile group NAL cell.

[0358] When multiple ALF APSs with the same adaptation_parameter_set_id value are referenced by two or more slice groups of the same image, the multiple ALF APSs with the same adaptation_parameter_set_id value should have the same content. ...

[0360]

[0361] A tile_group_lmcs_enabled_flag value of 1 indicates that luma mapping and chroma scaling are enabled for the current tile group. A tile_group_lmcs_enabled_flag value of 0 indicates that luma mapping and chroma scaling are not enabled for the current tile group. When tile_group_lmcs_enable_flag does not exist, it is inferred to be equal to 0.

[0362] A `tile_group_lmcs_use_default_model_flag` value of 1 specifies that the default LMCS model is used for luma mapping and chroma scaling of tile groups. A `tile_group_lmcs_use_default_model_flag` value of 0 specifies that the LMCS model in the LMCS APS referenced by `tile_group_lmcs_aps_id` is used for luma mapping and chroma scaling of tile groups. When `tile_group_reshaper_use_default_model_flag` does not exist, it is inferred to be equal to 0.

[0363] `tile_group_lmcs_aps_id` specifies the `adaptation_parameter_set_id` of the LMCS APS referenced by the tile group. The `TemporalId` of the LMCS APS NAL cell whose `adaptation_parameter_set_id` is equal to `tile_group_lmcs_aps_id` should be less than or equal to the `TemporalId` of the codec tile group NAL cell.

[0364] When multiple LMCS APSs with the same adaptation_parameter_set_id value are referenced by two or more slice groups of the same picture, the multiple LMCS APSs with the same adaptation_parameter_set_id value should have the same content.

[0365] A tile_group_chroma_residual_scale_flag value of 1 indicates that chroma residual scaling is enabled for the current tile group. A tile_group_chroma_residual_scale_flag value of 0 indicates that chroma residual scaling is not enabled for the current tile group. When tile_group_chroma_residual_scale_flag does not exist, it is inferred to be equal to 0. ... ...

[0368] 2.4.2.6 JVET-N0138

[0369] This contribution proposes an extended use of the Adaptive Parameter Set (APS) to carry both shaper model parameters and ALF parameters. In a recent meeting, it was decided that ALF parameters would be carried by the APS instead of the slice header to improve encoding / decoding efficiency by avoiding unnecessary redundant signaling notifications for parameters across multiple slices. For the same reason, it is proposed to use the APS instead of the slice header to carry shaper model parameters. To identify the parameter type in the APS (at least whether it's ALF or shaper model), the APS syntax requires APS type information and an APS ID.

[0370] Adaptive parameter set syntax and semantics

[0371] The suggested changes are shown in italics below.

[0372]

[0373]

[0374] The `adaptation_parameter_set_type` identifier identifies the parameter type in the APS. The value of `adaptation_parameter_set_type` should be in the range of 0 to 1, inclusive. If `adaptation_parameter_set_type` equals 0, the signaling notifies the ALF parameter. Otherwise, the signaling notifies the shaper model parameter.

[0375] Generalized fragment group header syntax and semantics

[0376]

[0377] 2.5 Virtual Pipeline Data Unit

[0378] A Virtual Pipeline Data Unit (VPDU) is defined as a non-overlapping MxM-luminance (L) / NxN-chrominance (C) unit in an image. In a hardware decoder, consecutive VPDUs are processed simultaneously by multiple pipeline stages; different stages process different VPDUs simultaneously. In most pipeline stages, the VPDU size is roughly proportional to the buffer size, so it is said to be important to keep the VPDU size small. In the HEVC hardware decoder, the VPDU size is set to the maximum Transform Block (TB) size. Increasing the maximum TB size from 32×32-L / 16×16-C (as in HEVC) to 64×64-L / 32×32-C (as in current VVC) can result in encoding / decoding gains, and is expected to produce a 4x increase in VPDU size (64×64-L / 32×32-C) compared to HEVC. However, in addition to quadtree (QT) codec unit (CU) partitioning, VVC also employs ternary tree (TT) and binary tree (BT) partitioning to achieve additional codec gain, and TT and BT partitioning can be recursively applied to 128×128-L / 64×64-C codec tree blocks (CTUs), which is said to result in a 16x larger VPDU size (128×128-L / 64×64-C) compared to HEVC.

[0379] In the current design of VVC, the VPDU size is defined as 64×64-L / 32×32-C.

[0380] 2.6 Adaptive Parameter Set

[0381] In VVC, an Adaptive Parameter Set (APS) is used to carry ALF parameters. The slice header contains an `aps_id`, which conditionally exists when ALF is enabled. The APS contains the `aps_id` and the ALF parameters. (From JVET-M0132) new NUT (NAL unit type, as in AVC and HEVC) values ​​are assigned to the APS. For the general test conditions in VTM-4.0 (coming soon), it is recommended to use only `aps_id = 0` and send the APS with each image. Currently, the range of APS ID values ​​will be 0..31 and APS can be shared across images (and can differ between different slice groups within an image). When present, the ID value should be a fixed-length encoding / decoding. Different content within the same image cannot reuse the same ID value.

[0382] 2.7 Related Tools

[0383] 2.7.1 Diffusion Filter (DF)

[0384] In JVET-L0157, a spread filter was proposed, in which the intra / inter-frame prediction signal of the CU can be further modified by the spread filter.

[0385] Uniform diffusion filter A uniformly diffused filter is implemented by convolving the predicted signal with a fixed mask, which can be given as h. I or h IV , defined as follows.

[0386] In addition to the predicted signal itself, a row of reconstructed samples on the left and top sides of the block is used as input to the filtered signal, where these reconstructed samples can be avoided on inter-frame blocks.

[0387] Let pred be the predicted signal for a given block obtained through intra-frame or motion-compensated prediction. To handle filter boundary points, the predicted signal needs to be expanded to the predicted signal pred. ext This extended prediction can be formed in two ways:

[0388] Alternatively, as an intermediate step, a row of reconstructed samples from the left and top sides of the block is added to the prediction signal, and the resulting signal is then mirrored in all directions. Or, simply mirroring the prediction signal itself in all directions is also possible. The latter expansion is used for inter-frame blocks. In this case, only the prediction signal itself includes the expanded prediction signal `pred`. ext Input.

[0389] If you want to use filter h I The following replacement for the prediction signal pred is proposed:

[0390] h I *pred,

[0391] Using the boundary extension described above, here, the filter mask h I The following is given:

[0392]

[0393] If you want to use filter h IV The following replacement for the prediction signal pred is proposed:

[0394] h IV *pred.

[0395] Here, filter h IV The following is given:

[0396] hIV =h I *h I *h I *h I .

[0397] Directional diffusion filter Instead of using an adaptive signal diffusion filter, a directional filter and a horizontal filter h that still have a fixed mask are used. hor and vertical filter h ver More precisely, the mask h corresponding to the previous part. I The uniform diffusion filter is simply restricted to being applied only along the vertical direction or only along the horizontal direction. The vertical filter is implemented by applying a fixed filter mask to the predicted signal as follows:

[0398]

[0399] And the horizontal filter uses a transpose mask. And thus, it was achieved.

[0400] 2.7.2 Bilateral Filter (BF)

[0401] The bilateral filter, proposed in JVET-L0406, is always applied to luma blocks with non-zero transform coefficients and a stripe quantization parameter greater than 17. Therefore, no signaling notification is required for the use of the bilateral filter. If the bilateral filter is applied, it is performed on the decoded samples immediately after the inverse transform. Furthermore, the filter parameters (i.e., weights) are explicitly derived from the encoding / decoding information.

[0402] The filtering process is defined as follows:

[0403]

[0404] Here, P 0，0 It is the intensity of the current sample point, P′ 0，0 It is the correction intensity of the current sample point, P. k，0 and W k These are the intensity and weighting parameters of the k-th neighboring sample point, respectively. Figure 24 The example depicts a current sample point and its four neighboring sample points (i.e., K=4).

[0405] More specifically, the weight W associated with the k-th neighboring sample. k (x) is defined as follows:

[0406] W k (x) = Distance k ×Range k (x). (2)

[0407] In this article,

[0408] and

[0409] Here, σ d This depends on the encoding / decoding mode and the codec block size. When the TU is further divided, the described filtering process is applied to intra-frame and inter-frame codec blocks to achieve parallel processing.

[0410] To better capture the statistical characteristics of video signals and improve filter performance, the weighting function derived from equation (2) is based on σ. d The parameters (which depend on the encoding / decoding mode and the block segmentation parameters (minimum size), as listed in Table 4) are adjusted.

[0411] Table 4: σ for different block sizes and encoding / decoding modes d value

[0412] Min(block width, block height) In-frame mode Inter-frame mode 4 82 62 8 72 52 other 52 32

[0413] To further improve encoding and decoding performance, for inter-frame encoding and decoding blocks where the TU is not divided, the intensity difference between the current sample and one of its neighboring samples is replaced by the representative intensity difference between two windows covering the current sample and its neighboring sample. Therefore, the equation for the filtering process is modified as follows:

[0414]

[0415] Here, P k，m and P 0，m They represent P respectively k，0 and P 0，0 The value of the m-th sample point within the centered window. In this proposal, the window size is set to 3×3. Figure 25 The text describes the coverage of P. 2，0 and P 0，0 An example of two windows.

[0416] 2.7.3 Hadamard Transform Domain Filter (HF)

[0417] In JVET-K0068, a loop filter in the 1D Hadamard transform domain is applied at the CU level after reconstruction and has a multiplication-free implementation. The proposed filter is applied to all CU blocks that satisfy predefined conditions, and the filter parameters are derived from the encoding / decoding information.

[0418] The proposed filter is always applied to luminance reconstruction blocks with non-zero transform coefficients, excluding 4x4 blocks, and if the stripe quantization parameter is greater than 17. The filter parameters are explicitly derived from the encoding / decoding information. If the proposed filter is applied, it is executed on the decoded samples immediately after the inverse transform.

[0419] For each pixel from the reconstructed block, pixel processing includes the following steps:

[0420] Based on the scanning pattern, scan the four neighboring pixels surrounding the current pixel.

[0421] Read the 4-point Hadamard transform of the pixel

[0422] ο Spectral filtering based on the following formula:

[0423]

[0424] In this paper, (i) is the index of the spectral component in the Hadamard spectrum, R(i) is the spectral component of the reconstructed pixel corresponding to the index, and σ is the filter parameter derived from the codec quantization parameter QP using the following equation:

[0425] σ = 2 (1+0.126*(QP-27)) .

[0426] Examples of scanned patterns in Figure 26 As shown in the figure, A is the current pixel, and {B, C, D} are the surrounding pixels.

[0427] For pixels located on the CU boundary, the scan pattern is adjusted to ensure that all required pixels are within the current CU.

[0428] 3. Disadvantages of existing implementation methods

[0429] The following drawbacks may exist in existing ILR implementations:

[0430] 1) Sending ILR side information at the slice header is inappropriate due to the large number of bits required. Furthermore, prediction between different images / slices is not allowed. Therefore, for each slice, ILR side information needs to be sent, which can lead to encoding / decoding losses at low bit rates, especially at low resolutions.

[0431] 2) The interaction between ILR and DMVR (or other newly introduced encoding / decoding tools) is unclear. For example, ILR is applied to the inter-frame prediction signal to transform the original signal to the integer domain, and the decoding residual is in the integer domain. DMVR also relies on the prediction signal to refine the motion vector of a block. It is unclear whether DMVR is applied in the original domain or the integer domain.

[0432] 3) The interaction between the ILR and screen content encoding / decoding tools (e.g., Palette, B-DPCM, IBC, Transform Skip, Transquant-bypass, I-PCM mode) is unclear.

[0433] 4) Luminance-dependent chroma residual scaling is used for ILR. This introduces additional latency (due to the dependency between luminance and chroma), which is detrimental to hardware design.

[0434] 5) The goal of VPDU is to ensure that the processing of one 64×64 square region is completed before starting the processing of other 64×64 square regions. However, according to the design of ILR, there are no restrictions on the use of ILR, which may lead to violations of VPDU because chromaticity depends on the luminance prediction signal.

[0435] 6) When a CU has all zero coefficients, the prediction block and the reconstruction block still perform forward and reverse shaping processes, which wastes computational complexity.

[0436] 7) JVET-N0138 proposes signaling notification of ILR information in the APS. This solution may lead to several new problems. For example, two APSs are designed. However, the `adaptation_parameter_set_id` for ILR signaling notification can reference an APS that does not contain ILR information. Similarly, the `adaptation_parameter_set_id` for Adaptive Loop Filtering (ALF) signaling notification can reference an APS that does not contain ALF information.

[0437] 4 Example methods for loop shaping in video encoding and decoding

[0438] The embodiments of the currently disclosed technology overcome the shortcomings of existing implementations, thereby providing video codecs with higher encoding and decoding efficiency. The loop-shaping method based on the disclosed technology can enhance both existing and future video codec standards, as illustrated in the following examples describing various implementations. The examples of the disclosed technology provided below illustrate general concepts and are not intended to be construed as limiting. In the examples, unless explicitly indicated to the contrary, the various features described in these examples can be combined. It should be noted that some of the proposed techniques can be applied to existing candidate list construction processes.

[0439] In this document, Decoder Side Motion Vector Derivation (DMVD) includes methods such as DMVR and FRUC for performing motion estimation to derive or refine block / sub-block motion information, and BIO for performing sample-wise motion refinement. Various examples (Examples 1 through 42) are provided in the numbered list below.

[0440] 1. The motion information refinement process in DMVD technology, such as DMVR, can depend on information in the shaping domain.

[0441] a. In one example, the predicted blocks generated from the reference image in the original domain can first be transformed into the shape domain before being used for motion information refinement.

[0442] i. Alternatively, cost calculations (e.g., SAD, MR-SAD) / gradient calculations are performed in the integer domain.

[0443] ii. Alternatively, the shaping process can be disabled on the prediction blocks generated with the refined motion information after the motion information has been refined.

[0444] b. Alternatively, the motion information refinement process in DMVD technology, such as DMVR, can depend on information in the original domain.

[0445] i. The DMVD procedure can be invoked using the prediction block in the original domain.

[0446] ii. In one example, after the motion information is refined, the predicted block or final predicted block obtained with the refined motion information (e.g., a weighted average of two predicted blocks) can be further transformed into the integer domain to generate the final reconstructed block.

[0447] iii. Alternatively, the shaping process can be disabled on the prediction blocks generated with the refined motion information after the motion information has been refined.

[0448] 2. Propose aligning the domain of the sample points in the current slice / slice group / image with the domain of the sample points derived from the reference image for deriving the Local Illumination Compensation (LIC) parameters (either in the original domain or in the reshaping domain).

[0449] a. In one example, the integer field is used to deduce the LIC parameter.

[0450] i. Alternatively, the samples (e.g., reference samples in the reference image (with or without interpolation) and neighboring / non-adjacent samples of the reference samples (with or without interpolation)) can be first transformed to the integer domain before being used to derive the LIC parameters.

[0451] b. In one example, the original domain is used to deduce the LIC parameter.

[0452] i. Alternatively, the spatial neighbor / non-neighbor samples of the current block (e.g., in the current slice group / image / slice) can first be transformed to the original domain before being used to derive the LIC parameters.

[0453] c. It is proposed that when LIC parameters are derived in a domain, the same domain of the prediction block should be used when applying the LIC parameters to the prediction block.

[0454] i. In one example, when bullet point a. is invoked, the reference block can be converted to the integer domain, and the LIC model is applied to the integer reference block.

[0455] ii. In one example, when bullet point b. is invoked, the reference block is kept in the original domain, and the LIC model is applied to the reference block in the original domain.

[0456] d. In one example, the LIC model is applied to the prediction block in the integer domain (e.g., the prediction block is first transformed to the integer domain via positive integer transformation).

[0457] e. In one example, the LIC model is first applied to the prediction blocks in the original domain, and then the final prediction blocks, which depend on the prediction blocks to which the LIC was applied, can then be transformed to the integer domain (e.g., via positive shaping) and used to derive the reconstructed blocks.

[0458] f. The above method can be extended to other encoding and decoding tools that rely on both spatially neighboring / non-neighboring samples and reference samples in the reference image.

[0459] 3. For filters applied to the predicted signal (such as spread filters (DF)), the filter is applied to the prediction block in the original domain.

[0460] a. Alternatively, shaping is then applied to the filtered prediction signal to generate a reconstructed block.

[0461] b. Figure 27 The document describes an example of the process used for inter-frame encoding and decoding.

[0462] c. Alternatively, the filter is applied to the predicted signal in the shaping domain.

[0463] i. Alternatively, shaping is first applied to the prediction block; then, filtering methods can be further applied to the shaped prediction block to generate the reconstructed block.

[0464] ii. Figure 28 The document describes an example of the process used for inter-frame encoding and decoding.

[0465] d. Filter parameters may depend on whether ILR is enabled.

[0466] 4. For filters applied to the reconstruction block (e.g., bilateral filter (BF), Hadamard transform domain filter (HF)), the filter is applied to the reconstruction block in the original domain rather than the integer domain.

[0467] a. Alternatively, the reconstructed blocks in the integer domain are first transformed to the original domain, after which filters can be applied and used to generate the reconstructed blocks.

[0468] b. Figure 29 The document describes an example of the process used for inter-frame encoding and decoding.

[0469] c. Alternatively, filters can be applied to reconstruction blocks in the integer domain.

[0470] i. Alternatively, the filter can be applied first before inverse shaping. The filtered reconstructed block can then be transformed back to the original domain.

[0471] ii. Figure 30 The document describes an example of the process used for inter-frame encoding and decoding.

[0472] d. Filter parameters may depend on whether ILR is enabled.

[0473] 5. A filtering process that can be applied to reconstruction blocks (e.g., after intra / inter-frame or other types of prediction methods) is proposed to be used in the integer domain.

[0474] a. In one example, the deblocking filter (DBF) process is performed in the integer domain. In this case, inverse integer shaping is not applied before DBF.

[0475] i. In this case, the DBF parameters can differ depending on whether integer shaping is applied.

[0476] ii. In one example, the DBF procedure may depend on whether integer shaping is enabled.

[0477] 1. In one example, this method is applied when DBF is invoked in the original domain.

[0478] 2. Alternatively, this method is applied when DBF is invoked in an integer field.

[0479] b. In one example, the Sample Adaptive Offset (SAO) filtering process is performed in the integer domain. In this case, inverse shaping is not applied before the SAO.

[0480] c. In one example, the Adaptive Loop Filter (ALF) process is performed in the integer domain. In this case, inverse shaping is not applied before the ALF.

[0481] d. Alternatively, reverse shaping can be applied to the block after DBF.

[0482] e. Alternatively, reverse shaping can be applied to the block after SAO.

[0483] f. Alternatively, reverse reshaping can be applied to a block after ALF.

[0484] g. The above filtering method can be replaced by other types of filtering methods.

[0485] 6. Propose signaling ILR parameters in a new parameter set (such as ILR APS) instead of in the chip header.

[0486] a. In one example, the fragment group header may contain aps_id. Alternatively, aps_id may exist conditionally when ILR is enabled.

[0487] b. In one example, the ILR APS contains the aps_id and ILR parameters.

[0488] c. In one example, a new NUT (NAL unit type, as in AVC and HEVC) value is assigned to ILR APS.

[0489] d. In one example, the range of ILR APS ID values ​​will be 0…M (e.g., M = 2K-1).

[0490] e. In one example, ILR APS can be shared across images (and can differ across different slice groups within an image).

[0491] f. In one example, when an ID value is present, the ID value can be a fixed-length encoding / decoding. Alternatively, it can be encoded / decoded using Exponential-Golomb (EG) encoding / decoding, truncated unary, or other binarization methods.

[0492] g. In one example, the ID value cannot be reused for different content within the same image.

[0493] h. In one example, the APS of the ILR APS and ALF parameters can share the same NUT.

[0494] i. Alternatively, the ILR parameter can be carried using the current APS of the ALF parameter. In this case, the above method of mentioning the ILR APS can be replaced by the current APS.

[0495] j. Alternatively, ILR parameters can be carried in the SPS / VPS / PPS / sequence header / image header.

[0496] k. In one example, the ILR parameters may include shaper model information, the ILR method used, and the chroma residual scaling factor.

[0497] l. Alternatively, ILR parameters can be signaled at one level (such as in APS), and / or the use of ILR can be further signaled at a second level (such as in the chip header).

[0498] m. Alternatively, predictive encoding and decoding can be applied to encode and decode ILR parameters with different APS indices.

[0499] 7. Instead of applying luminance-dependent chroma residual scaling (LCRS) to chroma blocks, a forward / reverse shaping process is proposed to be applied to chroma blocks to remove the dependency between luminance and chroma.

[0500] a. In one example, an M-segment piecewise linear (PWL) model and / or forward / backward lookup table can be used for one chroma component. Alternatively, two PWL models and / or forward / backward lookup tables can be used to encode and decode two chroma components separately.

[0501] b. In one example, the PWL model and / or forward / backward lookup table for chromaticity can be derived from the PWL model and / or forward / backward lookup table for luminance.

[0502] i. In one example, no further signaling is required to inform the PWL model / lookup table of the chromaticity.

[0503] c. In one example, the chroma PWL model and / or forward / backward lookup table can be signaled in the SPS / VPS / APS / PPS / sequence header / picture header / film group header / film header / CTU line / CTU group / area.

[0504] 8. In one example, how signaling informs a group of images / pieces of its ILR parameters may depend on the previously encoded / decoded ILR parameters of the group of images / pieces.

[0505] a. For example, the ILR parameters of a group of pictures / photos can be predicted from the ILR parameters of one or more previously encoded / decoded groups of pictures / photos.

[0506] 9. Propose disabling luminance-dependent chroma residual scaling (LCRS) for specific block sizes / temporal layers / piece types / image types / encoding / decoding modes / specific types of motion information.

[0507] a. In one example, even when the forward / reverse shaping process is applied to the luma block, LCRS may not be applied to the corresponding chroma block.

[0508] b. Alternatively, LCRS can still be applied to the corresponding chroma blocks even when the forward / reverse shaping process is not applied to the luminance blocks.

[0509] c. In one example, LCRS is not used when applying the Cross-Component Linear Model (CCLM) mode. CCLM modes include LM, LM-A, and LM-L.

[0510] d. In one example, LCRS is not used when the Cross-Component Linear Model (CCLM) mode is not applied. CCLM modes include LM, LM-A, and LM-L.

[0511] e. In one example, when the luminance block being encoded exceeds one VPDU (e.g., 64×64).

[0512] i. In one example, LCRS is not allowed when the luma block size contains fewer than M*H samples (e.g., 16, 32, or 64 luma samples).

[0513] ii. Alternatively, LCRS is not allowed when the minimum dimensions of the width and / or height of the luminance block are less than or no greater than X. In one example, X is set to 8.

[0514] iii. Alternatively, LCRS is not allowed when the minimum dimensions of the width and / or height of the luminance block are not less than X. In one example, X is set to 8.

[0515] iv. Alternatively, LCRS is not allowed when the width of the block is greater than or equal to th1 and / or the height of the brightness block is greater than or equal to th2. In one example, th1 and / or th2 are set to 8.

[0516] 1. In one example, th1 and / or th2 are set to 128.

[0517] 2. In one example, th1 and / or th2 are set to 64.

[0518] v. Alternatively, when the width of the luminance block < th1 or <= th1 and / or the height of the luminance block < th2 or <= th2, LCRS is not allowed. In one example, th1 and / or th2 are set to 8.

[0519] 10. Whether to disable ILR (forward shaping process and / or backward shaping process) can depend on coefficients.

[0520] a. In one example, when a block is encoded / decoded with all-zero coefficients, the process of forward shaping applied to the prediction block is skipped.

[0521] b. In one example, when a block is encoded / decoded with all-zero coefficients, the process of backward shaping applied to the reconstructed block is skipped.

[0522] c. In one example, when a block is encoded / decoded with only one non-zero coefficient located at a specific position (e.g., the DC coefficient at the upper-left position of a block, the coefficients at the upper-left coding / decoding group within a block), the process of forward shaping applied to the prediction block and / or the process of backward shaping applied to the reconstructed block is skipped.

[0523] d. In one example, when a block is encoded / decoded with only M (e.g., M = 1) non-zero coefficients, the process of forward shaping applied to the prediction block and / or the process of backward shaping applied to the reconstructed block is skipped.

[0524] 11. It is proposed that if the encoded / decoded block exceeds one virtual pipeline data unit (VPDU), the ILR application area is divided into VPDU units. Each application area (e.g., with a maximum size of 64×64) is regarded as a separate CU for ILR operations.

[0525] a. In one example, when the width of the block > th1 or >= th1 and / or the height of the block > th2 or >= th2, it can be divided into sub-blocks with width < th1 or <= th1 and / or height < th2 or <= th2, and ILR can be performed on each sub-block.

[0526] i. In one example, the sub-blocks can have the same width or / and height.

[0527] ii. In one example, the sub-blocks except those located at the right boundary or / and bottom boundary can have the same width or / and height.

[0528] iii. In one example, the sub-blocks except those located at the left boundary or / and top boundary can have the same width or / and height.

[0529] b. In one example, when the size of a block (i.e., width * height) > th3 or >= th3, it can be divided into sub - blocks with size < th3 or <= th3, and ILR can be performed on each sub - block.

[0530] i. In one example, the sub - blocks can have the same size.

[0531] ii. In one example, the sub - blocks except those located at the right boundary or / and bottom boundary can have the same size.

[0532] iii. In one example, the sub - blocks except those located at the left boundary or / and top boundary can have the same size.

[0533] c. Alternatively, the use of ILR is limited to a specific block size.

[0534] i. In one example, when the encoded / decoded block exceeds one VPDU (e.g., 64×64), ILR is not allowed.

[0535] ii. In one example, when the block size contains less than M * H samples (e.g., 16 or 32 or 64 luminance samples), ILR is not allowed.

[0536] iii. Alternatively, when the minimum size of the width or / and height of a block is less than or not greater than X, ILR is not allowed. In one example, X is set to 8.

[0537] iv. Alternatively, when the minimum size of the width or / and height of a block is not less than X, ILR is not allowed. In one example, X is set to 8.

[0538] v. Alternatively, when the width of the block > th1 or >= th1 and / or the height of the block > th2 or >= th2, ILR is not allowed. In one example, th1 and / or th2 are set to 8.

[0539] 1. In one example, th1 and / or th2 are set to 128.

[0540] 2. In one example, th1 and / or th2 are set to 64.

[0541] vi. Alternatively, when the width of the block < th1 or <= th1 and / or the height of the block < th2 or <= th2, ILR is not allowed. In one example, th1 and / or th2 are set to 8.

[0542] 12. The above methods (e.g., for chroma encoding / decoding, whether to disable ILR and / or whether to disable LCRS and / or whether to signal PWL / lookup table) may depend on the color format, such as 4:4:4 / 4:2:0.

[0543] 13. Indicators for enabling ILR (e.g., tile_group_reshaper_enable_flag) can be encoded or decoded if there is an indication of an existing reshaper model (e.g., tile_group_reshaper_model_present_flag).

[0544] a. Alternatively, the tile_group_reshaper_model_present_flag can be encoded or decoded under the condition of tile_group_reshaper_enable_flag.

[0545] b. Alternatively, encoding / decoding can be performed on only one of the two syntax elements, which includes `tile_group_reshaper_model_present_flag` and `tile_group_reshaper_enable_flag`. The value of the other syntax element is set to equal to the syntax element that can be signaled.

[0546] 14. Different clipping methods can be applied to the prediction signal and reconstruction process.

[0547] a. In one example, an adaptive clipping method can be applied, and the maximum and minimum values ​​to be clipped can be defined in the integer domain.

[0548] b. In one example, adaptive pruning can be applied to the predicted signal in the integer domain.

[0549] c. Alternatively, fixed clipping (e.g., based on bit depth) can be applied to the reconstructed block.

[0550] 15. Filter parameters (such as those used in DF, BF, HF) may depend on whether ILR is enabled.

[0551] 16. It is proposed that for blocks encoded and decoded in Palette mode, ILR be disabled or applied differently.

[0552] a. In one example, when the block is encoded and decoded in palette mode, the shaping and reverse shaping are skipped.

[0553] b. Alternatively, when the block is encoded or decoded in palette mode, different shaping and reverse shaping functions can be applied.

[0554] 17. Alternatively, when applying ILR, the palette mode can be encoded and decoded differently.

[0555] a. In one example, when ILR is applied, the palette pattern can be encoded and decoded in the raw domain.

[0556] b. Alternatively, when applying ILR, the palette pattern can be encoded and decoded in the integer domain.

[0557] c. In one example, when ILR is applied, the palette prediction value can be signaled in the raw domain.

[0558] d. Alternatively, the palette prediction value can be signaled in the integer domain.

[0559] 18. It is proposed that for blocks encoded and decoded in IBC mode, ILR is either disabled or applied differently.

[0560] a. In one example, when the block is encoded and decoded in IBC mode, integer and reverse integer are skipped.

[0561] b. Alternatively, when the block is encoded or decoded in IBC mode, different integer and reverse integer shapes are applied.

[0562] 19. Alternatively, when applying ILR, the IBC mode can be encoded and decoded differently.

[0563] a. In one example, when ILR is applied, IBC can be performed in the original domain.

[0564] b. Alternatively, when applying ILR, IBC can be performed in the integer domain.

[0565] 20. It is proposed that for blocks encoded and decoded in B-DPCM mode, ILR is either disabled or applied differently.

[0566] a. In one example, when the block is encoded and decoded in B-DPCM mode, the shaping and reverse shaping are skipped.

[0567] b. Alternatively, when the block is encoded or decoded in B-DPCM mode, different integer and reverse integer shaping are applied.

[0568] 21. Alternatively, when applying ILR, the B-DPCM mode can be encoded and decoded differently.

[0569] a. In one example, when ILR is applied, B-DPCM can be performed in the original domain.

[0570] b. Alternatively, when applying ILR, B-DPCM can be performed in the integer domain.

[0571] 22. It is proposed that for blocks encoded and decoded in a transform skip mode, the ILR is either disabled or applied differently.

[0572] a. In one example, when a block is encoded and decoded in transform skip mode, integer and reverse integer are skipped.

[0573] b. Alternatively, when the block is encoded or decoded in transform skip mode, different integer and reverse integers can be applied.

[0574] 23. Alternatively, when applying ILR, the encoding and decoding transformation skip mode can be different.

[0575] a. In one example, when applying ILR, transformation skipping can be performed in the original domain.

[0576] b. Alternatively, when applying ILR, transformation skipping can be performed in the integer domain.

[0577] 24. It is proposed that for blocks encoded and decoded in I-PCM mode, ILR is either disabled or applied differently.

[0578] a. In one example, when the block is encoded and decoded in palette mode, the shaping and reverse shaping are skipped.

[0579] b. Alternatively, when the block is encoded or decoded in palette mode, different shaping and reverse shaping functions can be applied.

[0580] 25. Alternatively, when applying ILR, the I-PCM mode can be encoded and decoded differently.

[0581] a. In one example, when ILR is applied, I-PCM modes can be encoded and decoded in the raw domain.

[0582] b. Alternatively, when applying ILR, I-PCM modes can be encoded and decoded in the integer domain.

[0583] 26. It is proposed that for blocks encoded and decoded in transform quantization bypass mode, ILR is disabled or applied differently.

[0584] a. In one example, when the block is encoded and decoded in transform quantization bypass mode, the shaping and inverse shaping are skipped.

[0585] 27. Alternatively, when the block is encoded or decoded in transform quantization bypass mode, different shaping and inverse shaping functions are applied.

[0586] 28. For the above bullet points, when ILR is disabled, the forward and / or reverse reshaping processes can be skipped.

[0587] a. Alternatively, the predicted and / or reconstructed and / or residual signals are in the original domain.

[0588] b. Optionally, the predicted and / or reconstructed and / or residual signals are in the shaping domain.

[0589] 29. Multiple shaping / reverse shaping functions (such as multiple PWL models) can be used to encode and decode a picture / a group of slices / a VPDU / a region / a CTU line / multiple CUs.

[0590] a. How to select from multiple features may depend on block size / encoding / decoding mode / image type / low latency check flag / motion information / reference image / video content, etc.

[0591] b. In one example, multiple ILR side information sets (e.g., shaping / reverse shaping functions) can be notified per SPS / VPS / PPS / sequence header / image header / piece group header / piece header / region / VPDU / etc. signaling.

[0592] i. Alternatively, predictive encoding and decoding of ILR side information can be utilized.

[0593] c. In one example, more than one aps_idx can be signaled in PPS / image header / group header / video header / region / VPDU / etc.

[0594] 30. In one example, integer information is signaled in a new syntax set instead of VPS, SPS, PPS, or APS. For example, integer information is signaled in a set represented as inloop_reshaping_parameter_set()(IRPS, or any other name).

[0595] a. An example syntax design is shown below. Added syntax is highlighted in italics.

[0596]

[0597] The `inloop_reshaping_parameter_set_id` provides an identifier for IRPS, which can be referenced by other syntax elements.

[0598] Note – IRPS can be shared across images and can differ between different slice groups within an image. `irps_extension_flag` equal to 0 indicates that the `irps_extension_data_flag` syntax element does not exist in the IRPS RBSP syntax structure. `irps_extension_flag` equal to 1 indicates that the `irps_extension_data_flag` syntax element exists in the IRPS RBSP syntax structure.

[0599] The `irps_extension_data_flag` flag can have any value. Its presence and value do not affect the decoder's conformance to the configuration file specified in this version of the specification. Decoders conforming to this version of the specification should ignore all `irps_extension_data_flag` syntax elements.

[0600] b. An example syntax design is shown below. Added syntax is highlighted in italics.

[0601] Generalized fragment group header syntax and semantics

[0602]

[0603]

[0604] The tile_group_irps_id specifies the inloop_reshaping_parameter_set_id of the IRPS referenced by the tile group. The TemporalId of the IRPS NAL cell whose inloop_reshaping_parameter_set_id is equal to the tile_group_irps_id should be less than or equal to the TemporalId of the codec tile group NAL cell.

[0605] 31. In one example, IRL information is signaled in the APS along with ALF information.

[0606] a. An example syntax design is shown below. Added syntax is highlighted in italics.

[0607] Adaptive parameter set syntax and semantics

[0608]

[0609] b. In one example, a tile_group_aps_id is signaled in the tile group header to specify the adaptation_parameter_set_id of the APS referenced by the tile group. The ALF and ILR information for the current tile group are signaled in the specified APS.

[0610] i. An example syntax design is shown below. Added syntax is highlighted in italics.

[0611] if(tile_group_reshaper_model_present_flag||tile_group_alf_enabled_flag) tile_group_aps_id

[0612] 32. In one example, ILR information and ALF information are signaled in different APSs.

[0613] a. The first ID (which can be named tile_group_aps_id_alf) is signaled in the tile group header to specify the first adaptation_parameter_set_id of the first APS referenced by the tile group. The ALF information of the current tile group is signaled in the specified first APS.

[0614] b. The second ID (which can be named tile_group_aps_id_irps) is signaled in the tile group header to specify the second adaptation_parameter_set_id of the second APS referenced by the tile group. The ILR information of the current tile group is signaled in the specified second APS.

[0615] c. In one example, the first APS must have ALF information in the conformance bitstream;

[0616] d. In one example, the second APS must have ILR information in the consistent bitstream;

[0617] e. An example syntax design is shown below. Added syntax is highlighted in italics.

[0618]

[0619]

[0620] 33. In one example, some APSs with a specified `adaptation_parameter_set_id` must have ALF information. As another example, some APSs with a specified `adaptation_parameter_set_id` must have ILR information.

[0621] a. For example, an APS with an adaptation_parameter_set_id equal to 2N must have ALF information. N is any integer;

[0622] b. For example, an APS with an adaptation_parameter_set_id equal to 2N+1 must have ILR information. N is any integer;

[0623] c. An example syntax design is shown below. Added syntax is highlighted in italics.

[0624]

[0625]

[0626] i. For example, 2*tile_group_aps_id_alf specifies the first adaptation_parameter_set_id of the first APS referenced by the tile group. The ALF information of the current tile group is signaled in the specified first APS.

[0627] ii. For example, 2*tile_group_aps_id_irps+1 specifies the second adaptation_parameter_set_id of the second APS referenced by the tile group. The ILR information of the current tile group is signaled in the specified second APS.

[0628] 34. In one example, a slice cannot reference an APS (or IRPS) that was signaled prior to a Network Abstraction Layer (NAL) cell of a specified type that was signaled prior to the current slice.

[0629] a. In one example, a slice group cannot reference an APS (or IRPS) that was signaled prior to a slice group of the specified type that was signaled prior to the current slice group.

[0630] b. For example, a slice cannot reference an APS (or IRPS) that was signaled prior to the SPS, which was signaled prior to the current slice.

[0631] c. For example, a slice group cannot reference an APS (or IRPS) that was signaled prior to the PPS, which was signaled prior to the current slice group.

[0632] d. For example, a slice cannot reference an APS (or IRPS) that was signaled before the Access Unit Delimiter (AUD) that was signaled before the current slice.

[0633] e. For example, a slice cannot reference an APS (or IRPS) that was signaled before the End of Bitstream (EoB) NAL, which was signaled before the current slice.

[0634] f. For example, a slice cannot reference an APS (or IRPS) that was signaled prior to the End of Sequence (EoS) NAL, which was signaled prior to the current slice.

[0635] g. For example, a slice cannot reference an APS (or IRPS) that was signaled prior to an Instantaneous Decoding Refresh (IDR) NAL that was signaled prior to the current slice.

[0636] h. For example, a slice cannot reference an APS (or IRPS) that was signaled prior to a Clean Random Access (CRA) NAL that was signaled prior to the current slice.

[0637] i. For example, a slice cannot reference an APS (or IRPS) that was signaled prior to an Intra Random Access Point (IRAP) access unit that was signaled prior to the current slice.

[0638] j. For example, a slice group cannot reference an APS (or IRPS) that was signaled prior to an I-slice group (or picture, or stripe) that was signaled prior to the current slice group.

[0639] k. The methods disclosed in IDF-P1903237401H and IDF-P1903234501H can also be used when carrying ILR information in APS or IRPS.

[0640] 35. A consistent bitstream should satisfy the following: When a loop-shaping method is enabled for a video data unit (such as a sequence), default ILR parameters, such as a default model, should be defined.

[0641] a. When sps_lmcs_enabled_flag is set to 1, sps_lmcs_default_model_present_flag should be set to 1.

[0642] b. Default parameters can be signaled if the ILR enable flag is not used instead of the default model presence flag (such as sps_lmcs_default_model_present_flag).

[0643] c. For each tile group, the default model usage flag (such as tile_group_lmcs_use_default_model_flag) can be signaled without referencing the SPS default model usage flag.

[0644] d. Consistent bitstream should satisfy the following: When there is no ILR information in the corresponding APS type of ILR and a video data unit (such as a slice group) is forced to use ILR technology, the default model should be used.

[0645] e. Alternatively, the consistent bitstream should satisfy the following: when there is no ILR information in the corresponding APS type of the ILR and a video data unit (such as a tile group) is forced to use ILR technology (such as tile_group_lmcs_enable_flag equal to 1), the indication to use the default model should be true, for example, tile_group_lmcs_use_default_model_flag should be 1.

[0646] f. The limitation is that default ILR parameters (such as the default model) should be transmitted in the video data unit (such as the SPS).

[0647] i. Alternatively, when the SPS flag indicating the use of the ILR is true, the default ILR parameter should be passed.

[0648] g. The limitation is that at least one ILR APS is transmitted in the video data unit (such as SPS).

[0649] i. In one example, at least one ILR APS contains default ILR parameters (such as the default model).

[0650] 36. Default ILR parameters can be indicated by a flag. When this flag indicates that default ILR parameters are being used, no further signaling is required to notify ILR data.

[0651] 37. The default ILR parameter can be predefined when there is no signaling notification. For example, the default ILR parameter can correspond to an identity mapping.

[0652] 38. Time-domain information can be signaled along with ILR parameters (such as in ILR APS).

[0653] a. In one example, the time-domain layer index can be signaled in lmcs_data().

[0654] b. In one example, the time-domain layer index can be decremented by 1 by signaling in lmcs_data().

[0655] c. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ILR APSs associated with a smaller or equal temporal layer index.

[0656] d. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ILR APSs associated with smaller temporal layer indices.

[0657] e. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ILR APSs associated with a larger temporal layer index.

[0658] f. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ILR APSs associated with a larger or equal temporal layer index.

[0659] g. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ILR APSs associated with the same time-domain layer index.

[0660] h. In one example, whether the above restrictions apply may depend on a message that can be signaled to the decoder or inferred by the decoder.

[0661] 39. Time-domain information can be signaled along with ALF parameters (such as in ALF APS).

[0662] a. In one example, the time-domain index can be signaled in alf_data().

[0663] b. In one example, the time-domain layer index can be decremented by 1 by signaling in alf_data().

[0664] c. Alternatively, when encoding / decoding a slice / slice or a CTU within a slice / slice group, it is restricted to referencing those ALF APSs associated with a smaller or equal time-domain layer index.

[0665] d. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ALF APSs associated with smaller temporal layer indices.

[0666] e. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ALF APSs associated with a larger temporal layer index.

[0667] f. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ALF APSs associated with a larger or equal temporal layer index.

[0668] g. Alternatively, when encoding / decoding a slice group / slice, it is restricted to referencing those ALF APSs associated with an equal temporal layer index.

[0669] h. In one example, whether the above restrictions apply may depend on a message that can be signaled to the decoder or inferred by the decoder.

[0670] 40. In one example, the integer mapping between the original sample and the integer sample may not be positive; that is, a larger value is not allowed to be mapped to a smaller value.

[0671] a. For example, the integer mapping between original samples and integer samples can be a negative relationship, where for two values, the larger value in the original domain can be mapped to the smaller value in the integer domain.

[0672] 41. In a consistent bitstream, the syntax element aps_params_type is only allowed to have a few predefined values, such as 0 and 1.

[0673] a. In another example, it is only allowed to be 0 and 7.

[0674] 42. In one example, if ILR can be applied (e.g., if sps_lmcs_enabled_flag is true), then by default ILR information must be signaled.

[0675] Example implementations of the 5 disclosed technologies

[0676] In some embodiments, the tile_group_reshaper_enable_flag conditionally exists when the tile_group_reshaper_model_present_flag is enabled. Added syntax is highlighted in italics.

[0677] 7.3.3.1 Generalized piece group header syntax

[0678]

[0679] Alternatively, the tile_group_reshaper_model_present_flag may exist conditionally when the tile_group_reshaper_enable_flag is enabled.

[0680]

[0681] Alternatively, only one of the two syntax elements, `tile_group_reshaper_model_present_flag` or `tile_group_reshaper_enable_flag`, can be signaled. A syntax element that is not signaled is inferred to be equivalent to a syntax element that can be signaled. In this case, one syntax element controls the use of the ILR.

[0682] Alternatively, the consistent bitstream requires that `tile_group_reshaper_model_present_flag` should be equal to `tile_group_reshaper_enable_flag`. Alternatively, `tile_group_reshaper_model_present_flag` and / or `tile_group_reshaper_enable_flag` and / or `tile_group_reshaper_model()` and / or `tile_group_reshaper_chroma_residual_scale_flag` can be signaled in the APS instead of the slice header.

[0683] Example #2 at the top of JVET-N0805. Added syntax is highlighted in italics.

[0684] ...

[0686] A value of 1 for `sps_lmcs_enabled_flag` specifies that luma mapping and chroma scaling are used in the codec video sequence (CVS). A value of 0 for `sps_lmcs_enabled_flag` specifies that luma mapping and chroma scaling are not used in the CVS.

[0687] A value of 1 for `sps_lmcs_default_model_present_flag` indicates that default LMCS data exists in this SPS. A value of 0 for `sps_lmcs_default_model_flag` indicates that default LMCS data does not exist in this SPS. When it does not exist, the value of `sps_lmcs_default_model_present_flag` is inferred to be 0. ...

[0689]

[0690] aps_params_type specifies the type of APS parameters carried in APS, as specified in the following table:

[0691] Table 7-x - APS Parameter Type Codes and Types of APS Parameters

[0692]

[0693]

[0694] ALF APS: APS where aps_params_type is equal to ALF_APS.

[0695] LMCS APS: APS with aps_params_type equal to LMCS_APS.

[0696] Make the following semantic changes: ...

[0698] `tile_group_alf_aps_id` specifies the `adaptation_parameter_set_id` of the ALF APS referenced by the tile group. The `TemporalId` of the ALF APS NAL cell whose `adaptation_parameter_set_id` is equal to `tile_group_alf_aps_id` should be less than or equal to the `TemporalId` of the codec tile group NAL cell.

[0699] When multiple ALF APSs with the same adaptation_parameter_set_id value are referenced by two or more slice groups of the same image, the multiple ALF APSs with the same adaptation_parameter_set_id value should have the same content. ...

[0701] A tile_group_lmcs_enabled_flag value of 1 indicates that luma mapping and chroma scaling are enabled for the current tile group. A tile_group_lmcs_enabled_flag value of 0 indicates that luma mapping and chroma scaling are not enabled for the current tile group. When tile_group_lmcs_enable_flag does not exist, it is inferred to be equal to 0.

[0702] A `tile_group_lmcs_use_default_model_flag` value of 1 specifies that the default LMCS model is used for luma mapping and chroma scaling of tile groups. A `tile_group_lmcs_use_default_model_flag` value of 0 specifies that the LMCS model in the LMCS APS referenced by `tile_group_lmcs_aps_id` is used for luma mapping and chroma scaling of tile groups. When `tile_group_reshaper_use_default_model_flag` does not exist, it is inferred to be equal to 0.

[0703] `tile_group_lmcs_aps_id` specifies the `adaptation_parameter_set_id` of the LMCS APS referenced by the tile group. The `TemporalId` of the LMCS APS NAL cell whose `adaptation_parameter_set_id` is equal to `tile_group_lmcs_aps_id` should be less than or equal to the `TemporalId` of the codec tile group NAL cell.

[0704] When multiple LMCS APSs with the same adaptation_parameter_set_id value are referenced by two or more slice groups of the same picture, the multiple LMCS APSs with the same adaptation_parameter_set_id value should have the same content.

[0705] A tile_group_chroma_residual_scale_flag value of 1 indicates that chroma residual scaling is enabled for the current tile group. A tile_group_chroma_residual_scale_flag value of 0 indicates that chroma residual scaling is not enabled for the current tile group. When tile_group_chroma_residual_scale_flag does not exist, it is inferred to be equal to 0. ... ...

[0708] Luminance mapping and chroma scaling data syntax

[0709]

[0710] The examples described above can be incorporated into the methods described below (e.g., such as...). Figures 31A to 39E The method shown can be implemented in the context of a video decoder or a video encoder.

[0711] Figure 31AA flowchart of an exemplary method for video processing is shown. Method 3100 includes, at step 3110, performing a motion information refinement process based on samples in a first domain or a second domain for a conversion between a current video block and a codec representation of the video. Method 3100 includes, at step 3120, performing the conversion based on the result of the motion information refinement process. In some embodiments, during the conversion, samples are obtained from a first prediction block in the first domain using unrefined motion information for the current video block, at least a second prediction block is generated in the second domain using refined motion information for determining a reconstructed block, and the reconstructed samples of the current video block are generated based on at least the second prediction block.

[0712] Figure 31B A flowchart of an exemplary method for video processing is shown. Method 3120 includes, at step 3122, reconstructing a current video block based on at least one predicted block in a second domain. In some embodiments, during this transformation, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a brightness-dependent manner. In some embodiments, parameters derived by the codec tool using at least a first set of sample points in a video region of the video and a second set of sample points in a reference image of the current video block are applied during this transformation. In some embodiments, the domains of the first sample points and the domains of the second sample points are aligned.

[0713] Figure 32A A flowchart of an exemplary method for video processing is shown. Method 3210 includes, at step 3212, determining parameters of the encoding / decoding mode for a current video block of a current video region of the video, based on one or more parameters of the encoding / decoding mode of a previous video region. Method 3210 further includes, at step 3214, performing encoding / decoding on the current video block based on the determination to generate an encoding / decoding representation of the video. In some embodiments, the parameters of the encoding / decoding mode are included in a set of parameters in the encoding / decoding representation of the video. In some embodiments, performing encoding / decoding includes transforming a representation of the current video block in a first domain to a representation of the current video block in a second domain. In some embodiments, during encoding / decoding using the encoding / decoding mode, the current video block is constructed based on the first and second domains, and / or the chroma residual is scaled in a lumen-dependent manner.

[0714] Figure 32BA flowchart of an exemplary method for video processing is shown. Method 3220 includes, at step 3222, receiving a codec representation of a video including a set of parameters, wherein the set of parameters includes parameter information of a codec mode. Method 3220 further includes, at step 3224, performing decoding of the codec representation using the parameter information to generate a current video block of a current video region of the video from the codec representation. In some embodiments, the parameter information of the codec mode is based on one or more parameters of a codec mode of a previous video region. In some embodiments, in this codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0715] Figure 32C A flowchart of an exemplary method for video processing is shown. Method 3230 includes, at step 3232, performing a conversion between a current video block and a codec representation of the video. In some embodiments, this conversion includes applying a filtering operation to a prediction block in a first domain or a second domain different from the first domain.

[0716] Figure 32D A flowchart of an exemplary method for video processing is shown. Method 3240 includes, at step 3242, performing a conversion between a current video block and a codec representation of the video. In some embodiments, during this conversion, a final reconstructed block is determined for the current video block. In some embodiments, a temporary reconstructed block is generated using a prediction method and represented in a second domain.

[0717] Figure 33 A flowchart of an exemplary method for video processing is shown. Method 3300 includes, at step 3302, performing a conversion between a current video block of a video region of the video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the parameter set in the codec representation includes parameter information of the codec mode.

[0718] Figure 34A A flowchart of an exemplary method for video processing is shown. Method 3410 includes, at step 3412, performing a conversion between a current video block, which is a chroma block, and a codec representation of the video, wherein, during the conversion, the current video block is constructed based on a first domain and a second domain, and wherein the conversion further includes applying a forward shaping process and / or a reverse shaping process to one or more chroma components of the current video block.

[0719] Figure 34BA flowchart of an exemplary method for video processing is shown. Method 3420 includes, at step 3422, performing a conversion between a current video chroma block of the video and a codec representation of the video, wherein performing the conversion includes: determining, based on rules, whether luminance-dependent chroma residual scaling (LCRS) is enabled or disabled, and reconstructing the current video chroma block based on the determination.

[0720] Figure 35A A flowchart of an exemplary method for video processing is shown. Method 3510 includes, at step 3512, determining, based on one or more coefficient values ​​of the current video block, whether to disable the use of a codec mode for a conversion between a current video block and a codec representation of the video. Method 3510 further includes, at step 3514, performing the conversion based on the determination. In some embodiments, during the conversion using the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0721] Figure 35B A flowchart of an exemplary method for video processing is shown. Method 3520 includes, at step 3522, dividing the current video block into regions for a conversion between current video blocks exceeding the Video Virtual Pipeline Data Unit (VPDU). Method 3520 further includes, at step 3524, performing the conversion by separately applying codec modes to each region. In some embodiments, during this conversion by applying codec modes, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0722] Figure 35C A flowchart of an exemplary method for video processing is shown. Method 3530 includes, at step 3532, determining, based on the size or color format of the current video block, whether to disable the use of a codec mode for a conversion between a current video block and a codec representation of the video. Method 3530 further includes, at step 3534, performing the conversion based on the determination. In some embodiments, during this conversion using a codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0723] Figure 35DA flowchart of an exemplary method for video processing is shown. Method 3540 includes, at step 3542, performing a conversion between a current video block of the video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein at least one syntax element in the codec representation provides an indication of the use of the codec mode and an indication of the shaper model.

[0724] Figure 35E A flowchart of an exemplary method for video processing is shown. Method 3550 includes, at step 3552, determining that the conversion between the current video block and the codec representation of the video disables a codec mode. Method 3550 further includes, at step 3554, conditionally skipping forward shaping and / or inverse shaping based on this determination. In some embodiments, in this codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0725] Figure 35F A flowchart of an exemplary method for video processing is shown. Method 3560 includes, at step 3562, performing a conversion between a current video block of a video region of the video and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein multiple forward shaping and / or multiple inverse shaping are applied in a shaping mode of the video region.

[0726] Figure 36A A flowchart of an exemplary method for video processing is shown. Method 3610 includes, at step 3612, determining that a codec mode is enabled for the conversion between a current video block of the video and a codec representation of the video. Method 3610 further includes, at step 3614, performing the conversion using a palette mode, wherein in the palette mode, a palette representing at least the sample values ​​is used for the current video block. In some embodiments, in this codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a brightness-dependent manner.

[0727] Figure 36BA flowchart of an exemplary method for video processing is shown. Method 3620 includes, at step 3622, determining, for the conversion between a current video block and a codec representation of the video, that the current video block is encoded in a palette mode, wherein in this palette mode, a palette representing at least sample point values ​​is used to encode and decode the current video block. Method 3620 further includes, at step 2624, performing the conversion by disabling the codec mode due to this determination. In some embodiments, when a codec mode is applied to a video block, the video block is constructed based on a chroma residual scaled in a lumen-dependent manner.

[0728] Figure 36C A flowchart of an exemplary method for video processing is shown. Method 3630 includes, at step 3632, performing a conversion between a first video block of the video and a codec representation of the video, wherein the conversion uses a first codec mode and a palette codec mode, wherein in the palette codec mode, a palette representing at least pixel values ​​is used to encode and decode the current video block. Method 3630 further includes, at step 3634, performing a conversion between a second video block of the video encoded without using the palette codec mode and a codec representation of the video, wherein the conversion of the second video block uses the first codec mode. When the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner. In some embodiments, the first codec mode is applied to the first video block and the second video block in different ways.

[0729] Figure 37A A flowchart of an exemplary method for video processing is shown. Method 3710 includes, at step 3712, determining that a codec mode is enabled for the conversion between a current video block and a codec representation of the video. Method 3710 further includes, at step 3714, performing the conversion using an intra-block copy mode, wherein the intra-block copy mode generates a predicted block using at least block vectors pointing to an image including the current video block. In this codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0730] Figure 37BA flowchart of an exemplary method for video processing is shown. Method 3720 includes, at step 3722, determining, for the conversion between a current video block and the codec representation of the video, that the current video block is encoded and decoded in an intra-block copy (IBC) mode, wherein the IBC mode generates a prediction block for encoding and decoding the current video block using at least block vectors pointing to the video frame containing the current video block. Method 3720 further includes, at step 3724, performing the conversion by disabling the codec mode due to this determination. When the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luma-dependent manner.

[0731] Figure 37C A flowchart of an exemplary method for video processing is shown. Method 3730 includes, at step 3732, performing a conversion between a first video block of the video and a codec representation of the video, wherein the conversion uses an intra-block copy mode and a first codec mode, wherein the intra-block copy mode uses at least block vectors pointing to video frames containing the current video block to generate predicted blocks. Method 3730 further includes, at step 3734, performing a conversion between a second video block of the video encoded and decoded without using the intra-block copy mode and a codec representation of the video, wherein the conversion of the second video block uses the first codec mode. When the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and the first codec mode is applied differently to the first video block and the second video block.

[0732] Figure 38A A flowchart of an exemplary method for video processing is shown. Method 3810 includes, at step 3812, determining that a codec mode is enabled for the conversion between a current video block of the video and a codec representation of the video. Method 3810 further includes, at step 3814, performing the conversion using a block-based incremental pulse codec modulation (BDPCM) mode. In this codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0733] Figure 38BA flowchart of an exemplary method for video processing is shown. Method 3820 includes, at step 3822, determining, for the conversion between a current video block and the codec representation of the video, that the current video block is encoded using a block-based incremental pulse codec modulation (BDPCM) mode. Method 3820 further includes, at step 3824, performing the conversion by disabling the codec mode due to this determination. When the codec mode is applied to a video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0734] Figure 38C A flowchart of an exemplary method for video processing is shown. Method 3830 includes, at step 3832, performing a conversion between a first video block of the video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a block-based incremental pulse codec modulation (BDPCM) mode. Method 3830 further includes, at step 3834, performing a conversion between a second video block of the video and a codec representation of the video, wherein the second video block is encoded and decoded without using the BDPCM mode, and the conversion of the second video block uses the first codec mode. When the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and the first codec mode is applied to the first video block and the second video block in different ways.

[0735] Figure 38D A flowchart of an exemplary method for video processing is shown. Method 3840 includes, at step 3842, determining that a codec mode is enabled for the transformation between a current video block of the video and the codec representation of the video. The method further includes, at step 3844, performing the transformation using a transform skip mode, wherein in this transform skip mode, the transformation of the prediction residual is skipped when encoding and decoding the current video block. In this codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0736] Figure 38E A flowchart of an exemplary method for video processing is shown. Method 3850 includes, at step 3852, determining, for the transformation between a current video block and the codec representation of the video, that the current video block is encoded in a transform-skip mode, wherein in this transform-skip mode, the transform on the prediction residual is skipped when encoding and decoding the current video block. Method 3850 further includes, at step 3854, performing the transformation by disabling the codec mode due to this determination. When the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0737] Figure 38F A flowchart of an exemplary method for video processing is shown. Method 3860 includes, at step 3862, performing a conversion between a first video block of the video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a transform skip mode, wherein in the transform skip mode, the transform on the prediction residual is skipped when encoding and decoding the current video block. Method 3860 further includes, at step 3864, performing a conversion between a second video block of the video and a codec representation of the video, wherein the second video block is encoded and decoded without using the transform skip mode, and the conversion of the second video block uses the first codec mode. When the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and the first codec mode is applied to the first video block and the second video block in different ways.

[0738] Figure 38G A flowchart of an exemplary method for video processing is shown. Method 3870 includes, at step 3872, determining that a codec mode is enabled for the conversion between a current video block of the video and the codec representation of the video. Method 3870 further includes, at step 3874, performing the conversion using an intra-pulse codec modulation mode, wherein the current video block is encoded and decoded without the application of transform and transform-domain quantization. In this codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0739] Figure 38H A flowchart of an exemplary method for video processing is shown. Method 3880 includes, at step 3882, determining, for the conversion between a current video block and a codec representation of the video, that the current video block is encoded and decoded in an intra-pulse codec modulation mode, wherein the current video block is encoded and decoded without the application of transform and transform-domain quantization in this intra-pulse codec modulation mode. Method 3880 further includes, at step 3884, performing the conversion by disabling the codec mode due to this determination. When the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0740] Figure 38IA flowchart of an exemplary method for video processing is shown. Method 3890 includes, at step 3892, performing a conversion between a first video block of the video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and an intra-pulse codec modulation mode, wherein the current video block is encoded and decoded without the application of transform and transform-domain quantization in the intra-pulse codec modulation mode. Method 3890 further includes, at step 3894, performing a conversion between a second video block of the video and a codec representation of the video, wherein the second video block is encoded and decoded without the use of the intra-pulse codec modulation mode, and the conversion of the second video block uses the first codec mode. When the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and the first codec mode is applied to the first video block and the second video block in different ways.

[0741] Figure 38J A flowchart of an exemplary method for video processing is shown. Method 3910 includes, at step 3912, determining that a codec mode is enabled for the conversion between a current video block of the video and the codec representation of the video. Method 3910 further includes, at step 3914, performing the conversion using a modified transform quantization bypass mode, wherein, in this modified transform quantization bypass mode, the current video block is losslessly encoded and decoded without transform and quantization. In this codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0742] Figure 38K A flowchart of an exemplary method for video processing is shown. Method 3920 includes, at step 3922, determining, for the conversion between a current video block and the codec representation of the video, that the current video block is encoded and decoded in a transform quantization bypass mode, wherein in this transform quantization bypass mode, the current video block is losslessly encoded and decoded without transform and quantization. Method 3920 further includes, at step 3924, performing the conversion by disabling the codec mode due to this determination. When the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner.

[0743] Figure 38LA flowchart of an exemplary method for video processing is shown. Method 3930 includes, at step 3932, performing a conversion between a first video block of the video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a transform quantization bypass mode, wherein in the transform quantization bypass mode, the current video block is losslessly encoded and decoded without transform and quantization. Method 3930 further includes, at step 3934, performing a conversion between a second video block of the video and a codec representation of the video, wherein the second video block is encoded and decoded without using the transform quantization bypass mode, and the conversion of the second video block uses the first codec mode. When the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and the first codec mode is applied to the first video block and the second video block in different ways.

[0744] Figure 39A A flowchart of an exemplary method for video processing is shown. Method 3940 includes, at step 3942, performing a conversion between a current video block of the video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein information for the codec mode is signaled in a parameter set different from the Sequence Parameter Set (SPS), Video Parameter Set (VPS), Picture Parameter Set (PPS), or Adaptive Parameter Set (APS) for carrying adaptive loop filter (ALF) parameters.

[0745] Figure 39B A flowchart of an exemplary method for video processing is shown. Method 3950 includes, at step 3952, performing a conversion between a current video block of the video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein information for the codec mode is signaled in an adaptive parameter set (APS) together with adaptive loop filtering (ALF) information, wherein the information for the codec mode and the ALF information are included in a NAL unit.

[0746] Figure 39CA flowchart of an exemplary method for video processing is shown. Method 3960 includes, at step 3962, performing a conversion between a current video block of a video region of the video and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein information for the codec mode is signaled in a first type of APS, different from a second type of adaptive parameter set (APS) used for signaling notification of adaptive loop filtering (ALF) information.

[0747] Figure 39D A flowchart of an exemplary method for video processing is shown. Method 3970 includes, at step 3972, performing a conversion between a current video block of a video region of the video and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein the video region is not allowed to reference an adaptive parameter set or a parameter set signaled prior to a specified type of data structure for processing the video, and wherein the specified type of data structure is signaled prior to the video region.

[0748] Figure 39E A flowchart of an exemplary method for video processing is shown. Method 3980 includes, at step 3982, performing a conversion between a current video block of the video and a codec representation of the video, wherein the conversion uses a codec mode in which the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a lumen-dependent manner, and wherein syntax elements of a parameter set including parameters for processing the video have predefined values ​​in a consistent bitstream.

[0749] Figure 40A This is a block diagram of a video processing apparatus 4000. Apparatus 4000 can be used to implement one or more of the methods described herein. Apparatus 4000 can be embodied in a smartphone, tablet, computer, Internet of Things (IoT) receiver, etc. Apparatus 4000 may include one or more processors 4002, one or more memories 4004, and video processing hardware 4006. The processors (multiple) 4002 can be configured to implement one or more methods described in this document (including, but not limited to, methods such as…). Figures 31A to 39E (The method is shown). Memory (multiple memories) 4004 can be used to store data and code for implementing the methods and techniques described herein. Video processing hardware 4006 can be used to implement some of the techniques described in this document in hardware circuitry.

[0750] Figure 40B This is another example of a block diagram of a video processing system in which the disclosed techniques can be implemented. Figure 40B This is a block diagram illustrating an example video processing system 4100 in which various techniques disclosed herein may be implemented. Various implementations may include some or all of the components of system 4100. System 4100 may include an input 4102 for receiving video content. The video content may be received in a raw or uncompressed format, such as 8 or 10-bit multi-component pixel values, or it may be in a compressed or encoded format. Input 4102 may represent a network interface, a peripheral bus interface, or a storage interface. Examples of network interfaces include wired interfaces such as Ethernet, Passive Optical Network (PON), etc., and wireless interfaces such as Wi-Fi or cellular interfaces.

[0751] System 4100 may include a codec component 4104 capable of implementing the various codec or encoding methods described in this document. The codec component 4104 can reduce the average bit rate of the video from input 4102 to its output to produce a codec representation of the video. Codec techniques are therefore sometimes referred to as video compression or video transcoding techniques. The output of codec component 4104 may be stored or transmitted via a communication connection, such as that represented by component 4106. The bitstream (or codec) representation of the video received at input 4102, whether stored or communicated, can be used by component 4108 to generate pixel values ​​or transmit as displayable video to display interface 4110. The process of generating user-visible video from the bitstream representation is sometimes referred to as video decompression. Furthermore, although some video processing operations are referred to as “codec” operations or tools, it will be understood that codec tools or operations are used at the encoder, and the corresponding decoding tools or operations that inversely represent the codec results will be performed by the decoder.

[0752] Examples of peripheral bus interfaces or display interfaces may include Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), or DisplayPort. Examples of storage interfaces include SATA (Serial Advanced Technology Attachment), PCI, IDE, etc. The technologies described in this document can be found in a variety of electronic devices, such as mobile phones, laptops, smartphones, or other devices capable of performing digital data processing and / or video display.

[0753] In some embodiments, the video encoding / decoding method may use methods such as those described above. Figure 40Aor Figure 40B The device is implemented on the hardware platform.

[0754] Various technologies and embodiments can be described using the following terms-based format.

[0755] The first set of clauses describes specific features and aspects of the disclosed technologies listed in previous chapters, including, for example, Examples 1 and 2.

[0756] 1. A method for video processing, comprising: performing a motion information refinement process based on samples in a first domain or a second domain for a conversion between a current video block and a codec representation of the video; and performing the conversion based on the result of the motion information refinement process, wherein during the conversion, the samples are obtained from a first prediction block in the first domain using unrefined motion information for the current video block, at least a second prediction block is generated in the second domain using refined motion information for determining a reconstructed block, and reconstructed samples of the current video block are generated based on at least the second prediction block.

[0757] 2. The method according to Clause 1, wherein at least the second prediction block is generated from samples in a reference image in the first domain using refined motion information, and a shaping process for transforming the first domain to the second domain is further applied to at least the second prediction block.

[0758] 3. As described in Clause 2, after the shaping process, the second prediction block is converted into a representation in the second domain before the reconstructed samples used to generate the current video block.

[0759] 4. The method described in Clause 1, wherein the motion information refinement process is performed based on the decoder-side motion vector derivation (DMVD) method.

[0760] 5. The method according to Clause 4, wherein the DMVD method includes decoder-side motion vector refinement (DMVR) or frame rate upconversion (FRUC) or bidirectional optical flow (BIO).

[0761] 6. The method according to Clause 4, wherein the cost calculation or gradient calculation in the DMVD process is performed based on samples in the first domain.

[0762] 7. The method according to Clause 6, wherein the cost calculation includes the sum of absolute differences (SAD) or the mean-removed sum of absolute differences (MR-SAD).

[0763] 8. The method according to Clause 1, wherein the motion information refinement process is performed based on samples from at least a first prediction block in a first domain being converted to samples in a second domain, and wherein, after obtaining the refined motion information, a codec mode is disabled for at least a second prediction block, wherein in this codec mode, the current video block is constructed based on the first and second domains, and / or the chroma residual is scaled in a luminance-dependent manner.

[0764] 9. The method according to Clause 4, wherein the motion information refinement process is performed based on at least a first prediction block in the first domain, and wherein the motion information refinement process is invoked using the first prediction block in the first domain.

[0765] 10. The method according to Clause 1, wherein the final prediction block is generated as a weighted average of two second prediction blocks, and the reconstructed samples of the current video block are generated based on the final prediction block.

[0766] 11. The method according to Clause 1, wherein the motion information refinement process is performed based on a prediction block in a first domain, and wherein, after the motion information refinement process is performed, a codec mode is disabled for at least a second prediction block, wherein in the codec mode, the current video block is constructed based on the first and second domains, and / or the chroma residual is scaled in a luminance-dependent manner.

[0767] 12. A method for video processing, comprising: performing a conversion between a current video block of a video and a codec representation of the video, wherein during the conversion, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, wherein parameters derived by the codec tool using at least a first set of sample points in a video region of the video and a second set of sample points in a reference picture of the current video block are applied during the conversion, and wherein the domains of the first sample points and the second sample points are aligned.

[0768] 13. The method according to Clause 12, wherein the encoding / decoding tool includes a Local Illumination Compensation (LIC) model that uses a linear model of illumination changes in the current video block during the conversion, and the LIC model is applied based on parameters.

[0769] 14. The method described in Clause 12, wherein the video region includes the current clip, a group of clips, or an image.

[0770] 15. The method according to Clause 13, wherein the LIC model is applied to a prediction block in a second domain, and wherein the first sample set and the second sample set are in the second domain.

[0771] 16. The method according to Clause 13, wherein the reference block is transformed to the second domain, and the LIC model is applied to the prediction block in the second domain.

[0772] 17. The method according to Clause 15, wherein the first sample set and the second sample set are transformed to the second domain before being used to derive the parameters.

[0773] 18. The method according to Clause 17, wherein the second set of sample points includes reference sample points in the reference image and neighboring and / or non-adjacent sample points of the reference sample points.

[0774] 19. The method according to Clause 13, wherein the LIC model is applied to a prediction block in a first domain, and wherein the first sample set and the second sample set are in the first domain.

[0775] 20. The method according to Clause 13, wherein the reference block is held in the first domain and the LIC model is applied to the prediction block in the first domain.

[0776] 21. The method according to Clause 19, wherein the first set of points is transformed to the first domain before being used to derive parameters.

[0777] 22. The method according to Clause 21, wherein the first set of samples includes spatially neighboring and / or non-neighboring samples of the current video block.

[0778] 23. The method according to Clause 12, wherein the domain used to derive the parameters is used to apply the parameters to the prediction block.

[0779] 24. The method according to Clause 13, wherein the LIC model is applied to the prediction block in the second domain.

[0780] 25. The method according to clause 20 or 21, wherein, after the LIC model is applied to the prediction block in the first domain, the final prediction block, depending on the prediction block, is transformed to the second domain.

[0781] 26. The method according to any one of clauses 1-25, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values.

[0782] 27. The method according to Clause 26, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0783] 28. The method according to any one of clauses 1-27, wherein performing the conversion includes generating a codec representation from the current block.

[0784] 29. The method according to any one of clauses 1-27, wherein performing the conversion includes generating the current block from the codec representation.

[0785] 30. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 29.

[0786] 31. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 29.

[0787] The second set of clauses describes specific features and aspects of the disclosed technologies listed in previous sections, including, for example, Examples 3-5, 8, and 15.

[0788] 1. A method for video processing, comprising: determining parameters of a codec mode for a current video block of a current video region of a video based on one or more parameters of a codec mode of a previous video region; and performing codec on the current video block based on the determination to generate a codec representation of the video, wherein the parameters of the codec mode are included in a parameter set in the codec representation of the video, and wherein performing codec includes transforming a representation of the current video block in a first domain to a representation of the current video block in a second domain, and wherein during the codec performance using the codec mode, the current video block is constructed based on the first and second domains, and / or the chroma residual is scaled in a luminance-dependent manner.

[0789] 2. A method for video processing, comprising: receiving a codec representation of a video including a set of parameters, wherein the set of parameters includes parameter information of a codec mode; and performing decoding of the codec representation using the parameter information to generate a current video block of a current video region of the video from the codec representation, wherein the parameter information of the codec mode is based on one or more parameters of a codec mode of a previous video region, wherein, in the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0790] 3. The method described in Clause 1 or 2, wherein the parameter set is different from the fragment group header.

[0791] 4. The method according to Clause 1 or 2, wherein the parameter set is an adaptive parameter set (APS).

[0792] 5. The method according to Clause 1 or 2, wherein the current video region includes a slice of video image of the video or a video image of the video;

[0793] 6. The method according to Clause 1 or 2, wherein the previous video area includes one or more pieces of images.

[0794] 7. The method according to Clause 1 or 2, wherein the previous video area includes one or more video images of the video.

[0795] 8. A method for video processing, comprising: performing a conversion between a current video block of a video and a codec representation of the video, wherein the conversion includes applying a filtering operation to a prediction block in a first domain or in a second domain different from the first domain.

[0796] 9. The method according to Clause 8, wherein a filtering operation is performed on the prediction block in the first domain to generate a filtered prediction signal, a codec mode is applied to the filtered prediction signal to generate a shaped prediction signal in the second domain, and the current video block is constructed using the shaped prediction signal.

[0797] 10. The method according to Clause 8, wherein the encoding / decoding mode is applied to the prediction block to generate a shaped prediction signal in the second domain prior to the application of the filtering operation, and the filtering operation is performed using the shaped prediction signal to generate a filtered prediction signal, and the current video block is constructed using the filtered prediction signal.

[0798] 11. The method according to Clause 9 or 10, wherein, in the encoding / decoding mode, the current video block is constructed based on the first and second domains, and / or the chroma residual is scaled in a luminance-dependent manner.

[0799] 12. The method according to any one of clauses 8-11, wherein the filtering operation includes a diffusion filter.

[0800] 13. The method according to any one of clauses 8-11, wherein the parameters associated with the filtering operation depend on whether the filtering operation is applied to a block in the first domain or the second domain.

[0801] 14. The method according to Clause 8, wherein the transformation further comprises: applying motion-compensated prediction to the current video block to obtain a prediction signal before applying the filtering operation; applying a codec mode to the filtered prediction signal to generate a shaped prediction signal after applying the filtering operation to the prediction signal; and using the shaped prediction signal to construct the current video block.

[0802] 15. The method according to Clause 8, wherein the transformation further comprises: applying motion-compensated prediction to the current video block to obtain a prediction signal before applying the filtering operation; applying a codec mode to the prediction signal to generate a shaped prediction signal; and constructing the current video block using the filtered shaped prediction signal after applying the filtering operation, wherein the filtered shaped prediction signal is generated by applying the filtering operation to the shaped prediction signal.

[0803] 16. A method for video processing, comprising: performing a conversion between a current video block and a codec representation of the video, wherein during the conversion, a final reconstructed block is determined for the current video block, and wherein a temporary reconstructed block is generated using a prediction method and represented in a second domain.

[0804] 17. The method according to Clause 16, wherein the transformation further comprises: applying motion-compensated prediction to the current video block to obtain a prediction signal; applying forward shaping to the prediction signal to generate a shaped prediction signal for generating a temporary reconstructed block; and applying inverse shaping to the temporary reconstructed block to obtain an inverse reconstructed block, wherein filtering is applied to the inverse reconstructed block to generate a final reconstructed block.

[0805] 18. The method according to Clause 16, wherein the transformation further comprises: applying motion-compensated prediction to a current video block to obtain a prediction signal; applying forward shaping to the prediction signal to generate a shaped prediction signal for generating a temporary reconstruction block; applying inverse shaping to a filtered reconstruction block to obtain a final reconstruction block, wherein the filtered reconstruction block is generated by applying filtering to the temporary reconstruction block.

[0806] 19. The method according to any one of Clauses 16 to 18, wherein the transformation further comprises applying a luminance-dependent chromatic residual scaling (LMCS) process that maps luminance samples to specific values.

[0807] 20. The method according to Clause 16, wherein the filter is applied to a temporary reconstruction block in a first domain, the temporary reconstruction block in a second domain is first transformed to the first domain using an inverse shaping process before the application of the filter, and the final reconstruction block depends on the filtered temporary reconstruction block.

[0808] 21. The method according to Clause 16, wherein the filter is applied directly to a temporary reconstruction block in the second domain, and then an inverse shaping operation is applied to generate the final reconstruction block.

[0809] 22. The method according to Clause 16, wherein the filter comprises a bilateral filter (BF) or a Hadamard transform domain filter (HF).

[0810] 23. The method according to Clause 16, wherein the filter includes a deblocking filter (DBF) process, a sample adaptive offset (SAO) filter process, or an adaptive loop filter (ALF) filter process.

[0811] 24. The method according to any one of clauses 1-23, wherein the filter parameters used for the filtering operation or the filter depend on whether a codec mode is enabled for the current video block, wherein in the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0812] 25. The method according to any one of clauses 1-25, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values.

[0813] 26. The method according to Clause 25, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0814] 27. The method according to any one of clauses 8-26, wherein performing the conversion includes generating a codec representation from the current block.

[0815] 28. The method according to any one of clauses 8-26, wherein performing the conversion includes generating the current block from the codec representation.

[0816] 29. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 28.

[0817] 30. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 28.

[0818] The third set of clauses describes specific features and aspects of the disclosed technologies, including those listed in previous chapters such as Example 6.

[0819] 1. A video processing method, comprising: performing a conversion between a current video block of a video region of a video and a codec representation of the video, wherein the conversion uses a codec mode, wherein in the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the parameter set in the codec representation includes parameter information of the codec mode.

[0820] 2. The method described in Clause 1, wherein the parameter set is different from the fragment header.

[0821] 3. The method according to Clause 2, wherein the parameter set is an adaptive parameter set (APS).

[0822] 4. The method according to Clause 3, wherein the APS of the encoding / decoding mode information is named Luminance Mapping and Chroma Scaling (LMCS) APS.

[0823] 5. The method according to Clause 3, wherein the identifier of the APS to be used for the current video block is included in the codec representation of the video.

[0824] 6. The method according to Clause 5, wherein the presence of the identifier in the codec representation of the video depends on whether a codec mode is enabled for the video region.

[0825] 7. The method according to Clause 3, wherein the parameter set contains an identifier of the APS.

[0826] 8. The method according to Clause 1, wherein NAL unit type values ​​are assigned to the parameter set.

[0827] 9. The method according to Clause 1, wherein the identifier of the parameter set is in the range of 0 to M, where M is 2. K -1.

[0828] 10. The method according to Clause 1, wherein the parameter set is shared across images of the video.

[0829] 11. The method according to Clause 1, wherein the identifier of the parameter set has a value encoded and decoded by a fixed length.

[0830] 12. The method according to Clause 1, wherein the identifier of the parameter set is encoded or decoded using exponential Golomb (EG) code, truncated unary code, or binarized code.

[0831] 13. The method according to Clause 1, wherein for two sub-regions within the same image, the parameter set has identifiers with two distinct values.

[0832] 14. The method according to Clause 3, wherein the APS of parameter set and adaptive loop filter (ALF) information shares the same Network Abstraction Layer (NAL) Unit Type (NUT).

[0833] 15. The method according to Clause 1, wherein the parameter information is carried along with the current APS of the adaptive loop filter (ALF) information.

[0834] 16. The method according to Clause 1, wherein parameter information is carried in a Sequence Parameter Set (SPS), Video Parameter Set (VPS), Picture Parameter Set (PPS), sequence, header, or picture header.

[0835] 17. The method according to Clause 1, wherein the parameter information includes at least one of an indication of shaper model information, the use of a codec mode, or a chroma residual scaling factor.

[0836] 18. The method according to Clause 1, wherein parameter information is signaled at a level.

[0837] 19. The method according to Clause 1, wherein the parameter information includes the use of the encoding / decoding mode for signaling notification in the second level.

[0838] 20. The method according to Clauses 18 and 19, wherein parameter information is signaled in the APS and the use of codec modes is signaled at the video region level.

[0839] 21. The method according to Clause 1, wherein parameter information is parsed at one level.

[0840] 22. The method according to Clause 1, wherein the parameter information includes the use of the encoding / decoding mode parsed in the second level.

[0841] 23. The method according to Clause 21 or 22, wherein the parameter information is parsed in the APS and the use of the encoding / decoding mode is parsed at the video region level.

[0842] 24. The method according to Clause 1, wherein predictive encoding / decoding is applied to encode / decode parameter information having different APS indices.

[0843] 25. The method according to any one of clauses 1-24, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values.

[0844] 26. The method according to Clause 25, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0845] 27. The method according to any one of Clauses 1-26, wherein the video region is a picture or a set of pictures.

[0846] 28. The method according to any one of Clauses 1-26, wherein the video region level is a picture header or a group header.

[0847] 29. The method according to any one of clauses 1-28, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values ​​according to a shaping model.

[0848] 30. The method according to Clause 29, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0849] 31. The method according to any one of clauses 1-30, wherein performing the conversion includes generating a codec representation from the current block.

[0850] 32. The method according to any one of clauses 1-30, wherein performing the conversion includes generating the current block from the codec representation.

[0851] 33. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 32.

[0852] 34. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 32.

[0853] The fourth set of clauses describes specific features and aspects of the disclosed technologies listed in previous sections, including, for example, Examples 7 and 9.

[0854] 1. A method for video processing, comprising: performing a conversion between a current video block, which is a chroma block, and a codec representation of the video, wherein during the conversion, the current video block is constructed based on a first domain and a second domain, and wherein the conversion further comprises applying a forward shaping process and / or a reverse shaping process to one or more chroma components of the current video block.

[0855] 2. The method according to Clause 1, wherein the method further comprises: avoiding applying luminance-dependent chroma residual scaling (LCRS) to one or more chroma components of the current video block.

[0856] 3. The method according to Clause 1, wherein at least one of a piecewise linear (PWL) model, a forward lookup table, or a backward lookup table is used for the chromaticity component.

[0857] 4. The method according to Clause 3, wherein the PWL model, forward lookup table and backward lookup table for the chromaticity component are derived from the PWL model, forward lookup table and backward lookup table for the corresponding luminance component, respectively.

[0858] 5. The method according to Clause 3, wherein the PWL model is signaled in the Sequence Parameter Set (SPS), Video Parameter Set (VPS), Adaptive Parameter Set (APS), Picture Parameter Set (PPS), Sequence Header, Picture Header, Slice Header, Slice Header, Codec Tree Unit (CTU) Row, CTU Group, or Region.

[0859] 6. The method according to Clause 3, wherein the forward lookup table and the backward lookup table are signaled in the Sequence Parameter Set (SPS), Video Parameter Set (VPS), Adaptive Parameter Set (APS), Picture Parameter Set (PPS), Sequence Header, Picture Header, Slice Header, Slice Header, Codec Tree Unit (CTU) Row, CTU Group, or Area.

[0860] 7. A method for video processing, comprising: performing a conversion between a current video chroma block of a video and a codec representation of the video, wherein performing the conversion includes: determining, based on rules, whether luminance-dependent chroma residual scaling (LCRS) is enabled or disabled, and reconstructing the current video chroma block based on the determination.

[0861] 8. The method described in Clause 7, wherein the rule specifies that LCRS is disabled for a specific block size, temporal layer, slice group type, picture type, encoding / decoding mode, or specific type of motion information.

[0862] 9. The method described in Clause 7, wherein the rule specifies that LCRS is disabled for chroma blocks, and forward and / or reverse shaping processes are applied to the corresponding luma blocks.

[0863] 10. The method described in Clause 7, wherein the rule specifies that LCRS is applied to the chroma block, and the forward and / or reverse shaping process is not applied to the corresponding luma block.

[0864] 11. The method described in Clause 7, wherein the rule specifies that LCRS is disabled for the current video chroma block encoded and decoded using the Cross-Component Linear Model (CCLM).

[0865] 12. The method described in Clause 7, wherein the rule specifies that LCRS is disabled for the current video chroma block that is not encoded using Cross-Component Linear Model (CCLM).

[0866] 13. The method described in Clause 7, wherein the rule specifies that LCRS is disabled based on the size of the video block exceeding the Virtual Pipeline Data Unit (VPDU).

[0867] 14. The method described in Clause 13, wherein LCRS is not permitted when a video block contains fewer than M*H video samples.

[0868] 15. The method described in Clause 13, wherein LCRS is not permitted if the minimum dimensions of the width and / or height of the video block are less than or equal to a specific value.

[0869] 16. The method described in Clause 13, wherein LCRS is not permitted if the minimum dimensions of the width and / or height of the video block are not less than a specific value.

[0870] 17. The method described according to Clause 15 or 16, wherein the specific value is 8.

[0871] 18. The method described in Clause 13, wherein LCRS is not permitted if the width of the video block is equal to or greater than the first value and / or the height of the video block is equal to or greater than the second value.

[0872] 19. The method described in Clause 13, wherein LCRS is not permitted if the width of the video block is equal to or less than the first value and / or the height of the video block is equal to or less than the second value.

[0873] 20. The method according to Clause 18 or 19, wherein at least one of the first or second values ​​is 8, 64 or 128.

[0874] 21. The method according to any one of Clauses 13-20, wherein the video block is a luminance block or a chrominance block.

[0875] 22. The method according to any one of clauses 1-21, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values ​​according to a shaping model.

[0876] 23. The method according to Clause 22, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0877] 24. The method according to any one of clauses 1-23, wherein the chroma residual is scaled in a luminance-dependent manner by performing a luminance-dependent chroma residual scaling operation, wherein the luminance-dependent chroma residual scaling operation includes scaling the chroma residual prior to the reconstruction used to derive the video chroma block, and the scaling parameters are derived from luminance samples.

[0878] 25. The method according to any one of clauses 1-24, wherein performing the conversion includes generating a codec representation from the current block.

[0879] 26. The method according to any one of clauses 1-24, wherein performing the conversion includes generating the current block from the codec representation.

[0880] 27. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 26.

[0881] 28. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 26.

[0882] The fifth set of clauses describes specific features and aspects of the disclosed technologies listed in the preceding sections, including, for example, Examples 10-14, 28, 29 and 40.

[0883] 1. A method for video processing, comprising: for a conversion between a current video block of a video and a codec representation of the video, determining whether to disable the use of a codec mode based on one or more coefficient values ​​of the current video block; and performing the conversion based on the determination, wherein during the conversion using the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0884] 2. The method according to Clause 1, wherein the shaping process comprises: selectively applying at least one of the forward shaping processes to samples in a first domain, wherein the samples in the first domain are then transformed into samples in a second domain; and selectively applying the reverse shaping process to samples in the second domain, wherein the samples in the second domain are then transformed into a representation in the first domain.

[0885] 3. The method according to Clause 1 or 2, wherein the shaping process further includes: selectively applying a luminance-dependent chromaticity residual scaling process.

[0886] 4. The method according to any one of clauses 1-3, wherein the determination is based on whether to encode or decode the current video block with all zero coefficients.

[0887] 5. The method according to Clause 2, wherein the forward shaping process is skipped based on whether the current video block is encoded or decoded with all zero coefficients.

[0888] 6. The method according to Clause 2, wherein the current video block is encoded and decoded with all-zero coefficients, and wherein the reverse shaping process is skipped.

[0889] 7. The method according to Clause 2, wherein the current video block is encoded and decoded with all-zero coefficients, and wherein the luminance-dependent chroma residual scaling process is skipped.

[0890] 8. The method according to Clause 2, wherein the determination is based on whether the current video block is encoded or decoded using only a non-zero coefficient located at a specific position.

[0891] 9. The method according to Clause 2, wherein the current video block is encoded and decoded using only a non-zero coefficient located at a specific position, and at least one of the forward shaping process, the reverse shaping process, or the luminance-dependent chroma residual scaling process is skipped.

[0892] 10. The method according to Clause 2, wherein the determination is based on whether the current video block is encoded or decoded using M non-zero coefficients.

[0893] 11. The method according to Clause 2, wherein the current video block is encoded and decoded with M non-zero coefficients, and at least one of the forward shaping process, the reverse shaping process, or the luminance-dependent chroma residual scaling process is skipped.

[0894] 12. The method according to Clause 11, wherein M is 1.

[0895] 13. A video processing method comprising: dividing the current video block into regions for a conversion between current video blocks of a video exceeding a Virtual Pipeline Data Unit (VPDU); and performing the conversion by separately applying a codec mode to each region, wherein during the conversion by applying the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0896] 14. The method according to Clause 13, wherein each region corresponds to a separate codec unit (CU) of a codec mode.

[0897] 15. The method according to Clause 13, wherein the width of the current video block is equal to or greater than a first value, the current video block is divided into one or more sub-blocks with a width equal to or less than the first value, and a codec mode is enabled for each sub-block.

[0898] 16. The method according to Clause 13, wherein the height of the current video block is equal to or greater than the second value, the current video block is divided into one or more sub-blocks having a height equal to or less than the second value, and a codec mode is enabled for each sub-block.

[0899] 17. The method according to Clause 13, wherein the size of the current video block is equal to or greater than the third value, the current video block is divided into one or more sub-blocks having a size equal to or less than the third value, and a codec mode is enabled for each sub-block.

[0900] 18. The method according to any one of Clauses 15-17, wherein the sub-blocks have the same width or the same height.

[0901] 19. A method for video processing, comprising: for a conversion between a current video block of a video and a codec representation of the video, determining whether to disable the use of a codec mode based on the size or color format of the current video block; and performing the conversion based on the determination, wherein during the conversion using the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0902] 20. The method according to Clause 19, wherein the determination determines to disable the encoding / decoding mode for the current video block exceeding the Virtual Pipeline Data Unit (VPDU).

[0903] 21. The method according to Clause 19, wherein the determination determines to disable the encoding / decoding mode for the current video block having a size containing a number of samples less than M*H.

[0904] 22. The method according to Clause 19, wherein the determination determines that the encoding / decoding mode is disabled for the current video block if the minimum size of the width and / or height of the current video block is equal to or less than X as an integer.

[0905] 23. The method according to Clause 19, wherein the determination determines that the encoding / decoding mode is disabled for the current video block if the minimum size of the width and / or height of the current video block is not less than X, which is an integer.

[0906] 24. The method described according to Clause 22 or 23, wherein X is 8.

[0907] 25. The method according to Clause 19, wherein the determination determines that the encoding / decoding mode is disabled for the current video block if the current video block has a width equal to or greater than a first value and / or a height equal to or greater than a second value.

[0908] 26. The method according to Clause 19, wherein the determination determines that the encoding / decoding mode is disabled for the current video block if the current video block has a width equal to or less than a first value and / or a height equal to or less than a second value.

[0909] 27. The method according to Clause 25 or 26, wherein at least one of the first value or the second value is 8.

[0910] 28. The method according to any one of clauses 19 to 27, wherein disabling the encoding / decoding mode includes disabling at least one of: 1) positive shaping that converts samples in the first domain to the second domain;

[0911] 2) Back-shaping of samples in the second domain to the first domain; 3) Luminance-dependent chromaticity residual scaling.

[0912] 29. A method for video processing, comprising: performing a conversion between a current video block of a video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein at least one syntax element in the codec representation provides an indication of the use of the codec mode and an indication of a shaper model.

[0913] 30. The method according to Clause 29, wherein the instruction for the use of the encoding / decoding mode is encoded / decoded based on the instruction of the shaper model.

[0914] 31. The method according to Clause 29, wherein the indication of the shaper model is encoded and decoded based on the indication of the encoding / decoding mode.

[0915] 32. The method described in Clause 29, wherein only one syntax element of the syntax elements is encoded or decoded.

[0916] 33. The method according to any one of clauses 1-32, wherein different pruning methods are applied to the predicted signal and the reconstructed signal.

[0917] 34. The method according to Clause 33, wherein adaptive cropping with different cropping parameters within the video is allowed to be applied to the predicted signal.

[0918] 35. The method according to Clause 34, wherein the maximum and minimum values ​​of the adaptive clipping are defined in the second domain.

[0919] 36. The method according to Clause 33, wherein fixed clipping is applied to the reconstructed signal.

[0920] 37. A method for video processing, comprising: determining that a conversion between a current video block of a video and a codec representation of the video disables a codec mode; and conditionally skipping forward shaping and / or reverse shaping based on the determination, wherein, in the codec mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0921] 38. The method according to Clause 37, wherein at least one of the predicted signal, the reconstructed signal, or the residual signal is in the first domain.

[0922] 39. The method according to Clause 37, wherein at least one of the predicted signal, the reconstructed signal, or the residual signal is in the second domain.

[0923] 40. A method for video processing, comprising: performing a conversion between a current video block of a video region of the video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein a plurality of forward shaping and / or a plurality of inverse shaping are applied in a shaping mode of the video region.

[0924] 41. The method according to Clause 40, wherein the video region includes pictures, slice groups, virtual pipeline data units (VPDUs), codec tree units (CTUs), lines or multiple codec units.

[0925] 42. The method according to Clause 40 or 41, wherein the selection of multiple forward shaping and / or multiple reverse shaping depends on at least one of: i) block size or video region size, ii) encoding / decoding mode of the current video block or video region, iii) picture type of the current video block or video region, iv) low latency check flag of the current video block or video region, v) motion information of the current video block or video region, vi) reference picture of the current video block or video region, or vii) video content of the current video block or video region.

[0926] 43. The method according to any one of clauses 1 to 42, wherein during the transformation, samples in the first domain are mapped to samples in the second domain, wherein the values ​​of the samples in the second domain are less than the values ​​of the samples in the first domain.

[0927] 44. The method according to any one of clauses 1 to 43, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method used to map luminance samples to specific values.

[0928] 45. The method according to Clause 44, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0929] 46. ​​The method according to any one of clauses 1-45, wherein performing the conversion includes generating a codec representation from the current block.

[0930] 47. The method according to any one of clauses 1-45, wherein performing the conversion includes generating the current block from the codec representation.

[0931] 48. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 47.

[0932] 49. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 47.

[0933] The sixth set of provisions describes specific features and aspects of the disclosed technologies listed in previous sections, including, for example, Examples 16 and 17.

[0934] 1. A video processing method, comprising: determining that a conversion between a current video block of a video and a codec representation of the video is enabled by a codec mode; and performing the conversion using a palette mode, wherein in the palette mode, a palette representing at least sample values ​​is used for the current video block, and wherein, in the codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0935] 2. The method according to Clause 1, wherein the palette of representative sample values ​​includes at least one of: 1) palette prediction values, or 2) escaped samples.

[0936] 3. The method according to Clause 1, wherein the representative sample value represents the value in the first domain.

[0937] 4. The method according to Clause 1, wherein the representative sample value represents the value in the second domain.

[0938] 5. The method according to Clause 1 or 2, wherein the palette prediction value used in palette mode and included in the codec representation is in the first or second domain.

[0939] 6. The method according to Clause 1 or 2, wherein the escaped samples used in palette mode and included in the codec representation are in the first or second domain.

[0940] 7. The method according to Clause 1 or 2, wherein when the palette prediction values ​​and / or escape samples used in the palette mode and included in the codec representation are in the second domain, the first reconstructed block in the second domain is first generated and used to encode and decode subsequent blocks.

[0941] 8. The method according to Clause 7, wherein when the palette prediction values ​​and / or escape samples used in the codec representation in the modified palette mode are in the second domain, the final reconstruction block in the first domain is generated using the first reconstruction block and the inverse shaping process.

[0942] 9. The method described in Clause 8, wherein the reverse shaping process is invoked just before the deblocking filter process.

[0943] 10. The method according to any one of clauses 1-9, wherein the conversion is performed based on the color components of the current video block.

[0944] 11. The method according to Clause 10, wherein the color component is a luminance component.

[0945] 12. A video processing method comprising: for a conversion between a current video block of a video and a codec representation of the video, determining that the current video block is encoded in a palette mode, wherein in the palette mode, a palette representing at least sample point values ​​is used to encode and decode the current video block; and, due to the determination, performing the conversion by disabling a codec mode, wherein when a codec mode is applied to the video block, the video block is constructed based on chroma residuals scaled in a luminance-dependent manner.

[0946] 13. The method according to Clause 12, wherein the encoding / decoding mode is disabled when the current video block is encoded / decoded in Palette mode.

[0947] 14. A video processing method comprising: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion uses a first codec mode and a palette codec mode, wherein in the palette codec mode, a palette representing at least pixel values ​​is used to encode and decode the current video block; and performing a conversion between a second video block of a video encoded without using the palette codec mode and a codec representation of the video, wherein the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0948] 15. The method according to Clause 14, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the disabling of the use of forward and reverse shaping for converting samples between the first and second domains.

[0949] 16. The method according to Clause 14, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the use of different shaping and / or different inverse shaping functions for converting samples between the first and second domains.

[0950] 17. The method according to any one of clauses 1-11 and 14-16, wherein the first domain is the original domain and the second domain is the shaped domain using a luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values.

[0951] 18. The method according to Clause 17, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0952] 19. The method according to any one of Clauses 1-18, wherein performing the conversion includes generating a codec representation from the current block.

[0953] 20. The method according to any one of clauses 1-18, wherein performing the conversion includes generating the current block from the codec representation.

[0954] 21. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 21.

[0955] 22. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 21.

[0956] The seventh set of clauses describes specific features and aspects of the disclosed technologies listed in previous sections, including, for example, Examples 18 and 19.

[0957] 1. A video processing method comprising: determining that a conversion between a current video block of a video and a codec representation of the video is enabled by a codec mode; and performing the conversion using an intra-block copy mode, wherein the intra-block copy mode generates a predicted block using at least block vectors pointing to an image including the current video block, and wherein, in the codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0958] 2. The method according to Clause 1, wherein the prediction block is generated in the first domain.

[0959] 3. The method according to Clause 1, wherein the residual block is represented in the code-decoded representation in the first field.

[0960] 4. The method according to Clause 1, wherein the prediction block is generated in the second domain.

[0961] 5. The method according to Clause 1, wherein the residual block is represented in the codec representation in the second field.

[0962] 6. The method according to Clause 4 or 5, wherein the first building block of the current video block is obtained based on the sum of the residual block and the prediction block in the second domain, and the first building block is used for the conversion between subsequent video blocks and the codec representation of the video.

[0963] 7. The method according to Clause 4 or 5, wherein the final building block of the current video block is obtained based on the inverse shaping applied to the first building block to transform the first building block from the second domain to the first domain.

[0964] 8. The method according to any one of Clauses 1-7, wherein the conversion is performed based on the color components of the current video block.

[0965] 9. The method described in Clause 8, wherein the color component is a luminance component.

[0966] 10. A method for video processing, comprising: for a conversion between a current video block of a video and a codec representation of the video, determining that the current video block is encoded in an intra-block copy (IBC) mode, wherein the IBC mode generates a prediction block for encoding / decoding the current video block using at least block vectors pointing to video frames containing the current video block; and, due to the determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luma-dependent manner.

[0967] 11. The method according to Clause 10, wherein the encoding / decoding mode is disabled when the current video block is encoded / decoded in IBC mode.

[0968] 12. A method for video processing, comprising: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion uses an intra-block copy mode and a first codec mode, wherein the intra-block copy mode uses at least block vectors pointing to video frames containing the current video block to generate a predicted block; and performing a conversion between a second video block of a video encoded and decoded without using the intra-block copy mode and a codec representation of the video, wherein the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0969] 13. The method according to Clause 12, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the disabling of the use of forward and reverse shaping for converting samples between the first and second domains.

[0970] 14. The method according to Clause 12, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the use of different forward shaping and / or different reverse shaping for converting samples between the first and second domains.

[0971] 15. The method according to any one of clauses 1-14, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values.

[0972] 16. The method according to Clause 15, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[0973] 17. The method according to any one of Clauses 1-16, wherein performing the conversion includes generating a codec representation from the current block.

[0974] 18. The method according to any one of clauses 1-16, wherein performing the conversion includes generating the current block from the codec representation.

[0975] 19. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 18.

[0976] 20. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 18.

[0977] The eighth set of clauses describes specific features and aspects of the disclosed technologies listed in previous sections, including, for example, Examples 20-27.

[0978] 1. A video processing method, comprising: determining that a conversion between a current video block of a video and a codec representation of the video is enabled by a codec mode; and performing the conversion using a block-based incremental pulse codec modulation (BDPCM) mode, wherein, in the codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0979] 2. The method according to Clause 1, wherein the prediction block of the current video block is generated in the first domain.

[0980] 3. The method according to Clause 1, wherein the residual block of the current video block is represented in the codec representation in the first field.

[0981] 4. The method according to Clause 1, wherein the prediction block of the current video block is generated in the second domain.

[0982] 5. The method according to Clause 1, wherein the residual block of the current video block is represented in the codec representation in the second field.

[0983] 6. The method according to Clause 4 or 5, wherein the first building block of the current video block is obtained based on the sum of the residual block and the prediction block in the second domain, and the first building block is used for the conversion between subsequent video blocks and the codec representation of the video.

[0984] 7. The method according to Clause 4 or 5, wherein the final building block of the current video block is obtained based on the inverse shaping applied to the first building block to transform the first building block from the second domain to the first domain.

[0985] 8. A video processing method comprising: for a conversion between a current video block and a codec representation of the video, determining that the current video block is encoded using a block-based incremental pulse codec modulation (BDPCM) mode; and, due to the determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0986] 9. The method according to Clause 8, wherein the encoding / decoding mode is disabled when the current video block is encoded / decoded in BDPCM mode.

[0987] 10. A video processing method comprising: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a block-based incremental pulse codec modulation (BDPCM) mode; and performing a conversion between a second video block of a video and a codec representation of the video, wherein the second video block is encoded and decoded without using the BDPCM mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[0988] 11. The method according to Clause 10, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the disabling of the use of forward and reverse shaping for converting samples between the first and second domains.

[0989] 12. The method according to Clause 10, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the use of different forward shaping and / or different reverse shaping for converting samples between the first and second domains.

[0990] 13. A video processing method comprising: determining that a conversion between a current video block of a video and a codec representation of the video is enabled by a codec mode; and performing the conversion using a transform skip mode, wherein in the transform skip mode, a transformation of a prediction residual is skipped when the current video block is encoded or decoded, wherein in the codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0991] 14. The method according to Clause 13, wherein the prediction block of the current video block is generated in the first domain.

[0992] 15. The method according to Clause 13, wherein the residual block of the current video block is represented in the codec representation in the first field.

[0993] 16. The method according to Clause 13, wherein the prediction block of the current video block is generated in the second domain.

[0994] 17. The method according to Clause 13, wherein the residual block is represented in the codec representation in the second field.

[0995] 18. The method according to Clause 16 or 17, wherein the first building block of the current video block is obtained by means of the sum of the residual block and the prediction block in the second domain, and the first building block is used for the conversion between subsequent video blocks and the codec representation of the video.

[0996] 19. The method according to Clause 16 or 17, wherein the final building block of the current video block is obtained based on the inverse shaping applied to the first building block to transform the first building block from the second domain to the first domain.

[0997] 20. A video processing method comprising: for a conversion between a current video block of a video and a codec representation of the video, determining that the current video block is encoded in a transform skip mode, wherein in the transform skip mode, a transform on the prediction residual is skipped when encoding and decoding the current video block; and, due to the determination, performing the conversion by disabling a codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[0998] 21. The method according to Clause 20, wherein the encoding / decoding mode is disabled when the current video block is encoded / decoded in transform skip mode.

[0999] 22. A video processing method comprising: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a transform skip mode, wherein in the transform skip mode, a transform on a prediction residual is skipped when the current video block is encoded or decoded; and performing a conversion between a second video block of a video and a codec representation of the video, wherein the second video block is encoded or decoded without using the transform skip mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[1000] 23. The method according to Clause 22, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the disabling of the use of forward and reverse shaping for converting samples between the first and second domains.

[1001] 24. The method according to Clause 22, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the use of different forward shaping and / or different reverse shaping for converting samples between the first and second domains.

[1002] 25. A method for video processing, comprising: determining that a conversion between a current video block of a video and a codec representation of the video is enabled by a codec mode; and performing the conversion using an intra-frame pulse codec modulation mode, wherein the current video block is encoded and decoded without the application of transform and transform-domain quantization, wherein, in the codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[1003] 26. The method according to Clause 25, wherein the prediction block of the current video block is generated in the first domain.

[1004] 27. The method according to Clause 25, wherein the residual block of the current video block is represented in the codec representation in the first field.

[1005] 28. The method according to Clause 25, wherein the prediction block of the current video block is generated in the second domain.

[1006] 29. The method according to Clause 25, wherein the residual block is represented in the code-decoded representation in the second field.

[1007] 30. The method according to Clause 28 or 29, wherein the first building block of the current video block is obtained based on the sum of the residual block and the prediction block in the second domain, and the first building block is used for the conversion between subsequent video blocks and the codec representation of the video.

[1008] 31. The method according to Clause 28 or 29, wherein the final building block of the current video block is obtained based on the inverse shaping applied to the first building block to transform the first building block from the second domain to the first domain.

[1009] 32. A video processing method comprising: for a conversion between a current video block of a video and a codec representation of the video, determining that the current video block is encoded and decoded in an intra-frame pulse codec modulation mode, wherein the current video block is encoded and decoded without the application of transform and transform-domain quantization in the intra-frame pulse codec modulation mode; and, due to the determination, performing the conversion by disabling the codec mode, wherein when the codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[1010] 33. The method according to Clause 32, wherein the encoding / decoding mode is disabled when the current video block is encoded / decoded in an intra-frame pulse codec modulation mode.

[1011] 34. A video processing method comprising: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and an intra-pulse codec modulation mode, wherein the current video block is encoded and decoded without the application of transform and transform-domain quantization in the intra-pulse codec modulation mode; and performing a conversion between a second video block of a video and a codec representation of the video, wherein the second video block is encoded and decoded without the use of the intra-pulse codec modulation mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[1012] 35. The method according to Clause 34, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the disabling of the use of forward and reverse shaping for converting samples between the first and second domains.

[1013] 36. The method according to Clause 34, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the use of different forward shaping and / or different reverse shaping for converting samples between the first and second domains.

[1014] 37. A method for video processing, comprising: determining that a conversion between a current video block of a video and a codec representation of the video is enabled by a codec mode; and performing the conversion using a modified transform quantization bypass mode, wherein the current video block is losslessly encoded and decoded without transform and quantization in the modified transform quantization bypass mode, wherein in the codec mode, the current video block is constructed based on samples in a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[1015] 38. The method according to Clause 37, wherein the prediction block of the current video block is generated in the first domain.

[1016] 39. The method according to Clause 37, wherein the residual block of the current video block is represented in the codec representation in the first field.

[1017] 40. The method according to Clause 37, wherein the prediction block of the current video block is generated in the second domain.

[1018] 41. The method according to Clause 37, wherein the residual block is represented in the code-decoded representation in the second field.

[1019] 42. The method according to clause 40 or 41, wherein the first building block of the current video block is obtained based on the sum of the residual block and the prediction block in the second domain, and the first building block is used for the conversion between subsequent video blocks and the codec representation of the video.

[1020] 43. The method according to clause 40 or 41, wherein the final building block of the current video block is obtained based on the inverse shaping applied to the first building block to transform the first building block from the second domain to the first domain.

[1021] 44. A video processing method comprising: for a conversion between a current video block of a video and a codec representation of the video, determining that the current video block is encoded and decoded in a transform quantization bypass mode, wherein in the transform quantization bypass mode, the current video block is losslessly encoded and decoded without transform and quantization; and, due to the determination, performing the conversion by disabling a codec mode, wherein when a codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner.

[1022] 45. The method according to Clause 44, wherein the encoding / decoding mode is disabled when the current video block is encoded / decoded in an intra-frame pulse codec modulation mode.

[1023] 46. ​​A video processing method comprising: performing a conversion between a first video block of a video and a codec representation of the video, wherein the conversion of the first video block uses a first codec mode and a transform quantization bypass mode, wherein in the transform quantization bypass mode, the current video block is losslessly encoded and decoded without transform and quantization; and performing a conversion between a second video block of a video and a codec representation of the video, wherein the second video block is encoded and decoded without using the transform quantization bypass mode, and the conversion of the second video block uses the first codec mode, wherein when the first codec mode is applied to the video block, the video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the first codec mode is applied to the first video block and the second video block in different ways.

[1024] 47. The method according to Clause 46, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the disabling of the use of forward and reverse shaping for converting samples between the first and second domains.

[1025] 48. The method according to Clause 46, wherein the first codec mode applied to the first video block is different from the first codec mode applied to the second video block due to the use of different forward shaping and / or different reverse shaping for converting samples between the first and second domains.

[1026] 49. The method according to any one of clauses 1 to 48, wherein the conversion is performed based on the color components of the current video block.

[1027] 50. The method described in Clause 49, wherein the color component is a luminance component.

[1028] 51. The method according to any one of clauses 1-50, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values.

[1029] 52. The method according to Clause 51, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[1030] 53. The method according to any one of clauses 1 to 52, wherein performing the conversion includes generating a codec representation from the current block.

[1031] 54. The method according to any one of clauses 1 to 52, wherein performing the conversion includes generating the current block from the codec representation.

[1032] 55. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 54.

[1033] 56. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 54.

[1034] The ninth set of provisions describes specific features and aspects of the disclosed technologies listed in previous sections, including, for example, Examples 30-34 and 41.

[1035] 1. A video processing method, comprising: performing a conversion between a current video block of a video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein information for the codec mode is signaled in a parameter set different from a sequence parameter set (SPS), a video parameter set (VPS), a picture parameter set (PPS), or an adaptive parameter set (APS) for carrying adaptive loop filter (ALF) parameters.

[1036] 2. The method described in Clause 1, wherein the parameter set is shared across images.

[1037] 3. The method according to Clause 1, wherein the parameter set comprises one or more syntax elements, wherein the one or more syntax elements comprise at least one of an identifier of the parameter set or a flag indicating the presence of extended data of the parameter set.

[1038] 4. The method according to Clause 1, wherein the parameter set is specific to a group of images within the image.

[1039] 5. A video processing method, comprising: performing a conversion between a current video block of a video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein information for the codec mode is signaled in an adaptive parameter set (APS) together with adaptive loop filtering (ALF) information, wherein the information for the codec mode and the ALF information are included in a NAL unit.

[1040] 6. The method according to Clause 5, wherein the identifier of the APS is signaled in the slice header.

[1041] 7. A video processing method comprising: performing a conversion between a current video block of a video region of the video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein information for the codec mode is signaled in a first type of APS, different from a second type of adaptive parameter set (APS) used for signaling notification of adaptive loop filtering (ALF) information.

[1042] 8. The method according to Clause 7, wherein the identifier of the second type of APS is signaled at the video area level.

[1043] 9. The method according to Clause 7, wherein the identifier of the first type of APS is signaled at the video region level.

[1044] 10. The method according to Clause 7, wherein the first type of APS included in the codec representation contains a second type of APS, wherein the second type of APS includes ALF information in the coherent bitstream.

[1045] 11. The method according to Clause 7, wherein the second type of APS included in the codec representation contains the first type of APS, wherein the first type of APS includes information for the codec mode in the coherent bitstream.

[1046] 12. The method according to Clause 7, wherein the first type of APS and the second type of APS are associated with different identifiers.

[1047] 13. The method according to Clause 12, wherein the second type of APS has an identifier equal to 2N, where N is an integer.

[1048] 14. The method according to Clause 13, wherein the APS of the first type has an identifier equal to 2N+1, where N is an integer.

[1049] 15. A method for video processing, comprising: performing a conversion between a current video block of a video region and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein the video region is not permitted to reference an adaptive parameter set or a parameter set signaled prior to a data structure of a specified type for processing the video, and wherein the data structure of the specified type is signaled prior to the video region.

[1050] 16. The method according to Clause 15, wherein the data structure includes at least one of the following: Network Abstraction Layer (NAL) unit, slice group, Sequence Parameter Set (SPS), Picture Parameter Set (PPS), Access Unit Separator NAL (AUD), Bitstream End NAL (EoB), Sequence End NAL (NAL), Instantaneous Decode Refresh (IDR) NAL, Completely Random Access (CRA) NAL, Intra-Frame Random Access Point (IRAP) Access Unit, I-slice group, picture, or stripe.

[1051] 17. A method for video processing, comprising: performing a conversion between a current video block of a video and a codec representation of the video, wherein the conversion uses a codec mode, wherein the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner, and wherein syntax elements of a parameter set including parameters for processing the video have predefined values ​​in a consistent bitstream.

[1052] 18. The method described in Clause 17, wherein the predefined values ​​are 0 and 1.

[1053] 19. The method described in Clause 17, wherein the predefined values ​​are 0 and 7.

[1054] 20. The method according to any one of clauses 1 to 19, wherein the video region includes at least one of a group of slices, a picture, a strip, or a slice.

[1055] 21. The method according to any one of clauses 1 to 20, wherein the first domain is the original domain and the second domain is the luminance mapping and chromaticity scaling (LMCS) method that maps luminance samples to specific values.

[1056] 22. The method according to Clause 21, wherein the LMCS uses a piecewise linear model to map luminance samples to specific values.

[1057] 23. The method according to any one of clauses 1 to 22, wherein performing the conversion includes generating a codec representation from the current block.

[1058] 24. The method according to any one of clauses 1 to 22, wherein performing the conversion includes generating the current block from the codec representation.

[1059] 25. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 24.

[1060] 26. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of clauses 1 to 24.

[1061] As can be understood from the foregoing, specific embodiments of the currently disclosed technology have been described herein for illustrative purposes; however, various modifications may be made without departing from the scope of the invention. Therefore, the currently disclosed technology is not limited beyond the scope of the appended claims.

[1062] The embodiments of the subject matter and functional operation described in this patent document can be implemented in various systems, digital electronic circuits, or in computer software, firmware, or hardware (including the structures disclosed in this specification and their equivalents), or in combinations thereof. Embodiments of the subject matter described in this specification can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible and non-transitory computer-readable medium for execution by or control of the operation of a data processing apparatus. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a combination of substances affecting machine-readable propagation signals, or a combination thereof. The terms "data processing unit" or "data processing apparatus" encompass all means, devices, and machines for processing data, including, for example, a programmable processor, a computer, or multiple processors or computers. In addition to hardware, the apparatus may also include code that creates an execution environment for the computer program in question, for example, code constituting processor firmware, a protocol stack, a database management system, an operating system, or a combination thereof.

[1063] Computer programs (also known as programs, software, software applications, scripts, or code) can be written in any programming language (including compiled or interpreted languages) and can be deployed in any form, including as standalone programs or as modules, components, subroutines, or other units suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored as part of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., a file storing one or more modules, subroutines, or code portions). Computer programs can be deployed to execute on a single computer or on multiple computers located at a single site or distributed across multiple sites and interconnected through a communications network.

[1064] The processes and logic flows described in this specification can be executed by one or more programmable processors that execute one or more computer programs to perform functions by manipulating input data and generating outputs. The processes and logic flows can also be executed by dedicated logic circuits, and the apparatus can be implemented as dedicated logic circuits, such as FPGAs (Field Programmable Gate Arrays) or ASICs (Application Specific Integrated Circuits).

[1065] Processors suitable for executing computer programs include, for example, general-purpose and special-purpose microprocessors, and any one or more processors of any type of digital computer. Typically, a processor receives instructions and data from read-only memory or random access memory, or both. The basic components of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Typically, a computer will also include one or more mass storage devices (e.g., magnetic disks, magneto-optical disks, or optical disks) for storing data, or operatively coupled to receive data from, transfer data to, or receive data from and transfer data to such mass storage devices. However, a computer does not require such devices. Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media, and memory devices, including, for example, semiconductor memory devices such as EPROM, EEPROM, and flash memory devices. The processor and memory may be supplemented by or incorporated into special-purpose logic circuitry.

[1066] This specification and the accompanying drawings are intended to be considered exemplary only, where exemplary means example. As used herein, the use of "or" is intended to include "and / or" unless the context clearly indicates otherwise.

[1067] While this patent document contains numerous details, these details should not be construed as limiting any invention or potentially claimed scope, but rather as descriptions of features specific to particular embodiments of a particular invention. Certain features described in this patent document within the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented separately in multiple embodiments or in any suitable sub-combination. Furthermore, although features may be described above as functioning in certain combinations and even initially claimed in this way, in some cases one or more features from the claimed combination may be excluded from the combination, and the claimed combination may be for sub-combinations or variations thereof.

[1068] Similarly, although operations are depicted in a specific order in the accompanying drawings, this should not be construed as requiring the operations to be performed in the specific order shown or in a sequential manner, or as performing all shown operations to achieve the desired result. Furthermore, the separation of various system components in the embodiments described in this patent document should not be construed as requiring such separation in all embodiments.

[1069] Only some implementation methods and examples are described, and other implementation methods, enhancements and variations can be made based on the content described and shown in this patent document.

Claims

1. A method for video processing, comprising: Based on one or more parameters of the encoding / decoding mode of the previous video region, determine the parameters of the encoding / decoding mode of the current video block for the current video region of the video; as well as Based on the determination, encoding is performed on the current video block to generate the bitstream of the video, and The parameters of the encoding / decoding mode are included in the parameter set of the video bitstream. The encoding process includes transforming the representation of the current video block in the first domain into a representation of the current video block in the second domain. During the encoding process using the encoding / decoding mode, the current video block is constructed based on the first domain and the second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The encoding process further includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

2. A method for video processing, comprising: Receive a bitstream of video including a parameter set, wherein the parameter set includes parameter information of the encoding / decoding mode; as well as Decoding of the bitstream is performed using the parameter information to generate the current video block of the current video region of the video from the bitstream, and The parameter information of the encoding / decoding mode is based on one or more parameters of the encoding / decoding mode of the previous video region. In the encoding / decoding mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The decoding process includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

3. The method according to claim 1 or 2, wherein, The parameter set is different from the chip group header.

4. The method according to claim 1 or 2, wherein, The parameter set is the adaptive parameter set APS.

5. The method according to claim 1 or 2, wherein, The current video area includes a slice of video image from the video or a video image from the video.

6. The method according to claim 1 or 2, wherein, The previous video area includes one or more pieces of images.

7. The method according to claim 1 or 2, wherein, The previous video area includes one or more video images of the video.

8. The method according to claim 1 or 2, wherein, The filtering operation is performed on the prediction block in the first domain to generate a filtered prediction signal, the encoding / decoding mode is applied to the filtered prediction signal to generate a shaped prediction signal in the second domain, and the current video block is constructed using the shaped prediction signal.

9. The method according to claim 1 or 2, wherein, The encoding / decoding mode is applied to the prediction block before the filtering operation is applied to generate a shaped prediction signal in the second domain, and the filtering operation is performed using the shaped prediction signal to generate a filtered prediction signal, and the current video block is constructed using the filtered prediction signal.

10. The method according to claim 1 or 2, wherein, The filtering operation includes a diffusion filter.

11. The method according to claim 1 or 2, wherein, The parameters associated with the filtering operation depend on whether the filtering operation is applied to a block in the first domain or the second domain.

12. The method according to claim 1 or 2, wherein, Performing the encoding or performing the decoding further includes: Before applying the filtering operation, motion compensation prediction is applied to the current video block to obtain the prediction signal; After applying the filtering operation, the encoding / decoding mode is applied to the filtered prediction signal to generate a shaped prediction signal, which is generated by applying the filtering operation to the prediction signal; and The current video block is constructed using the reshaping prediction signal.

13. The method according to claim 1 or 2, wherein, Performing the encoding or performing the decoding further includes: Before applying the filtering operation, motion compensation prediction is applied to the current video block to obtain the prediction signal; The encoding / decoding mode is applied to the predicted signal to generate a shaped prediction signal; and After applying the filtering operation, the current video block is constructed using the filtered shaping prediction signal, wherein the filtered shaping prediction signal is generated by applying the filtering operation to the shaping prediction signal.

14. The method according to claim 1 or 2, wherein, During the encoding / decoding or decoding process, a final reconstructed block is determined for the current video block, and The temporary reconstruction block is generated using a prediction method and represented in the second domain.

15. The method according to claim 14, wherein, Performing the encoding or performing the decoding further includes: Motion compensation prediction is applied to the current video block to obtain a prediction signal; Forward shaping is applied to the prediction signal to generate a shaped prediction signal for generating the temporary reconstruction block; and Inverse shaping is applied to the temporary reconstruction block to obtain an inverse reconstruction block, and The filtering is applied to the inverse reconstruction block to generate the final reconstruction block.

16. The method of claim 14, wherein, Performing the encoding or performing the decoding further includes: Motion compensation prediction is applied to the current video block to obtain a prediction signal; Forward shaping is applied to the prediction signal to generate a shaped prediction signal for generating the temporary reconstruction block; Inverse shaping is applied to the filtered reconstructed block to obtain the final reconstructed block, and The filtered reconstruction block is generated by applying the filtering to the temporary reconstruction block.

17. The method according to claim 15 or 16, wherein, Performing the encoding or decoding also includes applying a luminance-dependent chromatic residual scaling (LMCS) process that maps luminance samples to specific values.

18. The method according to claim 14, wherein, The filter is applied to the temporary reconstruction block in the first domain, the temporary reconstruction block in the second domain is first transformed to the first domain using an inverse shaping process before the filter is applied, and the final reconstruction block depends on the filtered temporary reconstruction block.

19. The method of claim 14, wherein, The filter is applied directly to the temporary reconstruction block in the second domain, and then an inverse shaping operation is applied to generate the final reconstruction block.

20. The method of claim 14, wherein, The filters include bilateral filters (BF) or Hadamard transform domain filters (HF).

21. The method according to claim 14, wherein, The filters include the Deblocking Filter (DBF) process, the Sample Adaptive Offset (SAO) filter process, or the Adaptive Loop Filter (ALF) process.

22. The method according to any one of claims 1-2 and 15-16, wherein, The first domain is the original domain, and the second domain is the integer domain using the Luminance Mapping and Chromaticity Scaling (LMCS) method, which maps luminance samples to specific values.

23. The method according to claim 22, wherein, The LMCS uses a piecewise linear model to map the luminance samples to the specific values.

24. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 1-23.

25. A computer program product stored on a non-transitory computer-readable medium, the computer program product comprising program code for performing the method according to any one of claims 1-23.

26. An apparatus for processing video data, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to: Based on one or more parameters of the encoding / decoding mode of a previous video region, determine the parameters of the encoding / decoding mode of the current video block for the current video region of the video; and Based on the determination, encoding is performed on the current video block to generate the bitstream of the video, and in, The parameters of the encoding / decoding mode are included in the parameter set of the video bitstream. The encoding process includes transforming the representation of the current video block in the first domain into a representation of the current video block in the second domain. During the encoding process using the encoding / decoding mode, the current video block is constructed based on the first domain and the second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The encoding process further includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

27. An apparatus for processing video data, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to: Receive a bitstream of video including a parameter set, wherein the parameter set includes parameter information of the encoding / decoding mode; and Decoding of the bitstream is performed using the parameter information to generate the current video block of the current video region of the video from the bitstream, and in, The parameter information of the encoding / decoding mode is based on one or more parameters of the encoding / decoding mode of the previous video region. In the encoding / decoding mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The decoding process includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

28. The apparatus according to claim 26 or 27, wherein, During the encoding / decoding or decoding process, a final reconstructed block is determined for the current video block, and The temporary reconstruction block is generated using a prediction method and represented in the second domain.

29. A non-transitory computer-readable storage medium for storing instructions, said instructions causing a processor to: Based on one or more parameters of the encoding / decoding mode of a previous video region, determine the parameters of the encoding / decoding mode of the current video block for the current video region of the video; and Based on the determination, encoding is performed on the current video block to generate the bitstream of the video, and in, The parameters of the encoding / decoding mode are included in the parameter set of the video bitstream. The encoding process includes transforming the representation of the current video block in the first domain into a representation of the current video block in the second domain. During the encoding process using the encoding / decoding mode, the current video block is constructed based on the first domain and the second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The encoding process further includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

30. A non-transitory computer-readable storage medium for storing instructions, said instructions causing a processor to: Receive a bitstream of video including a parameter set, wherein the parameter set includes parameter information of the encoding / decoding mode; and Decoding of the bitstream is performed using the parameter information to generate the current video block of the current video region of the video from the bitstream, and in, The parameter information of the encoding / decoding mode is based on one or more parameters of the encoding / decoding mode of the previous video region. In the encoding / decoding mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The decoding process includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

31. The non-transitory computer-readable storage medium according to claim 29 or 30, wherein, During the encoding / decoding or decoding process, a final reconstructed block is determined for the current video block, and The temporary reconstruction block is generated using a prediction method and represented in the second domain.

32. A non-transitory computer-readable recording medium storing instructions and a bitstream of video, wherein the instructions cause a processor to: Based on one or more parameters of the encoding / decoding mode of a previous video region, determine the parameters of the encoding / decoding mode of the current video block for the current video region of the video; and Based on the determination, encoding is performed on the current video block to generate the bitstream, and in, The parameters of the encoding / decoding mode are included in the parameter set of the video bitstream. The encoding process includes transforming the representation of the current video block in the first domain into a representation of the current video block in the second domain. During the encoding process using the encoding / decoding mode, the current video block is constructed based on the first domain and the second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The encoding process further includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

33. A non-transitory computer-readable recording medium storing instructions and a bitstream of video, wherein the instructions cause a processor to: Encoding is performed on the current video block of the video to generate a bitstream including a parameter set, wherein the parameter set includes parameter information of the encoding / decoding mode, and in, The parameter information of the encoding / decoding mode is based on one or more parameters of the encoding / decoding mode of the previous video region. In the encoding / decoding mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The generation process includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

34. The non-transitory computer-readable recording medium according to claim 32 or 33, wherein, During the generation process, a final reconstructed block is determined for the current video block, and The temporary reconstruction block is generated using a prediction method and represented in the second domain.

35. A method for storing a bitstream of video, comprising: Based on one or more parameters of the encoding / decoding mode of the previous video region, determine the parameters of the encoding / decoding mode of the current video block for the current video region of the video; Based on the determination, the current video block is encoded to generate the bitstream; as well as The bitstream is stored in a non-transitory computer-readable recording medium, and The parameters of the encoding / decoding mode are included in the parameter set of the video bitstream. The encoding process includes transforming the representation of the current video block in the first domain into a representation of the current video block in the second domain. During the encoding process using the encoding / decoding mode, the current video block is constructed based on the first domain and the second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The encoding process further includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

36. A method for storing a bitstream of video, comprising: Encode the current video block of the video to generate a bitstream including a parameter set, wherein the parameter set includes parameter information of the encoding / decoding mode; as well as The bitstream is stored in a non-transitory computer-readable recording medium, and The parameter information of the encoding / decoding mode is based on one or more parameters of the encoding / decoding mode of the previous video region. In the encoding / decoding mode, the current video block is constructed based on a first domain and a second domain, and / or the chroma residual is scaled in a luminance-dependent manner. The generation process includes applying a filtering operation to a prediction block in the first domain or the second domain. The filter parameters used for filtering operations or filters depend on whether the encoding / decoding mode is enabled for the current video block.

37. The method according to claim 35 or 36, wherein, During the generation process, a final reconstructed block is determined for the current video block, and The temporary reconstruction block is generated using a prediction method and represented in the second domain.

Images