Encoder, decoder, method and computer program with improved transform-based scaling

By selecting the quantization accuracy according to the transformation mode, the problem of inconsistent quantization accuracy caused by different transformation modes and block sizes is solved, which reduces the distortion rate and improves the compression efficiency of video encoding.

CN118945349APending Publication Date: 2024-11-12FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411143663.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2019-06-14
Filing Date
2020-06-12
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Different scaling factors and quantization parameters caused by different transformation modes and block sizes lead to inconsistent quantization accuracy and increase distortion rate.

Method used

Select quantization accuracy based on the transform mode of the block used for quantization, ensure the quantization and dequantization process by selecting the identity or non-identity transformation, and using quantization parameters (QP), scaling factors and quantization steps to define the quantization accuracy, ensuring the quantization and dequantization process Consistent accuracy.

Benefits of technology

By adjusting the quantization accuracy, distortion occurs in different transformation modes is reduced, and the compression efficiency and quality of video encoding is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945349A_ABST
    Figure CN118945349A_ABST
Patent Text Reader

Abstract

An encoder, a decoder, a method and a computer program with improved transform-based scaling are disclosed. A method for block-based coding of a picture using transform coding according to the present disclosure comprises: selecting a transform from a plurality of transforms for a current block, the plurality of transforms including an identical transform and a non-identical transform; transforming the current block using the transformation to obtain a transformed block; and quantizing the transformed block using a quantization parameter dependent on whether the transform is an identical transform or a non-identical transform to obtain a quantized block, where when the transform is an identical transform, the method comprises: determining an initial quantization parameter, and determining whether the initial quantization parameter is less than a predetermined threshold, if the initial quantization parameter is less than the predetermined threshold, and if the initial quantization parameter is less than the predetermined threshold, quantizing the quantized block using a quantization parameter dependent on whether the transform is an identical transform or a non-identical transform. When the initial quantization parameter is smaller than the preset threshold value, the quantization parameter is set to be the preset threshold value; and entropy encoding the quantized block into a data stream. A corresponding decoding method and a corresponding apparatus are also disclosed.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of an application with an application date of June 12, 2020, an international application number of PCT / EP2020 / 066355, a Chinese application number of "202080043648.0", and an invention name of "Encoders, decoders, methods and computer programs with improved transform-based scaling". Technical Field

[0002] Embodiments according to the invention relate to encoders, decoders, methods and computer programs with improved transform-based scaling.

[0003] Introductory Notes:

[0004] Next, different inventive embodiments and aspects will be described. Furthermore, other embodiments will be defined by the appended claims.

[0005] It should be noted that any embodiment defined by the claims may be supplemented by any of the details (features and functions) described in the following different inventive embodiments and aspects.

[0006] In addition, it should be noted that the individual aspects described herein can be used alone or in combination. Therefore, details can be added to each of the individual aspects without adding details to another aspect in the aspect.

[0007] It should also be noted that the present disclosure explicitly or implicitly describes features that can be used in encoders (devices for providing an encoded representation of an input signal) and decoders (devices for providing a decoded representation of a signal based on the encoded representation). Therefore, any feature described herein can be used in the context of an encoder and in the context of a decoder.

[0008] In addition, the features and functions related to the method disclosed herein may also be used in an apparatus (an apparatus configured to perform such functions). In addition, any features and functions disclosed herein regarding an apparatus may also be used in a corresponding method. In other words, the method disclosed herein may be supplemented by any features and functions described regarding an apparatus.

[0009] Furthermore, as will be described in the "Alternative Implementations" section, any of the features and functions described herein may be implemented in hardware or software, or using a combination of hardware and software. Background Art

[0010] In state-of-the-art lossy video compression, the encoder quantizes the prediction residual or the transformed prediction residual using a specific quantization step size Δ. The smaller the step size, the finer the quantization and the smaller the error between the original signal and the reconstructed signal. Recent video coding standards (e.g., H.264 and H.265) use an exponential function of the so-called quantization parameter (QP) to derive this quantization step size Δ, for example:

[0011]

[0012] The exponential relationship between the quantization step size and the quantization parameter allows for finer adjustments to the resulting bitrate. The decoder needs to know the quantization step size to perform the correct scaling of the quantized signal. Although quantization is irreversible, this stage is sometimes called "inverse quantization". This is why the decoder parses the scaling factor or QP from the bitstream. QP signaling is usually performed hierarchically, that is, the base QP is signaled at a higher level in the bitstream, such as the picture level. At the sub-picture level, a picture can consist of multiple slices, tiles, or bricks, and only the increment of the base QP is signaled. In order to adjust the bitrate with finer granularity, the incremental QP can even be signaled per block or region of a block, for example, in HEVC, the incremental QP is signaled in one transform unit within an N×N region of a coding block. Encoders usually use incremental QP techniques to perform subjective optimization or rate control algorithms. Without loss of generality, it is assumed below that the basic unit in the present invention is a picture, so for each picture consisting of a single slice, the base QP is signaled by the encoder. In addition to this base QP, also called slice QP, for each transform block (or any union of transform blocks, also called quantization group), a delta QP may be signaled.

[0013] State-of-the-art video coding schemes, such as High Efficiency Video Coding (HEVC) or the upcoming Versatile Video Coding (VVC) standard, optimize energy compression for various residual signal types by allowing additional transforms beyond the widely used integer approximation of the discrete cosine transform type II (DCT-II). The HEVC standard also specifies integer approximation of the discrete sine transform type VII (DST-VII) for 4×4 transform blocks using specific intra-directional modes. Due to this fixed mapping, there is no need to signal whether to use DCT-II or DST-VII. In addition to this, the identity transform can be selected for the 4×4 transform block. Here, the encoder needs to signal whether to apply DCT-II / DST-VII or the identity transform. Since the identity transform is equivalent to a matrix multiplied by 1, it is also called transform skipping. In addition, current VVC developments allow the encoder to select more transforms of the DCT / DST family for the residual as well as additional inseparable transforms, which are applied after the DCT / DST transform at the encoder and before the inverse DCT / DST at the decoder. Both the DCT / DST transform and an extended set of additional non-separable transforms require additional signaling for each transform block.

[0014] Figure 1b A hybrid video coding method is shown, wherein the residual signal 24 is forward transformed and subsequently quantized at the encoder 10, and the quantized transform coefficients are scaled and then inverse transformed for the decoder 36. Blocks 28 / 32 and 52 / 54 related to the transform and quantization are highlighted.

[0015] Therefore, it is desirable to provide a concept of quantization and / or scaling that can be used when encoding pictures and / or videos, resulting in improved compression efficiency.

[0016] This is achieved by the subject matter of the independent claims of the present application.

[0017] Further embodiments according to the invention are defined by the subject matter of the dependent claims of the present application. Summary of the invention

[0018] According to a first aspect of the invention, the inventors of the present application have realised that a problem encountered when quantising transform coefficients and scaling the quantised transform coefficients stems from the fact that different transform modes and / or block sizes may result in different scaling factors and quantisation parameters. The quantisation precision in one transform mode may result in an increase in distortion in another transform mode. According to a first aspect of the present application, this difficulty is overcome by selecting the quantisation precision according to the transform mode used for the block to be quantised. Therefore, different quantisation precisions may be selected for different transform modes and / or block sizes.

[0019] Therefore, according to the first aspect of the present application, an encoder for block-based encoding of a picture signal using transform coding is configured to select a selected transform mode, such as an identity transform or a non-identity transform, for a predetermined block (e.g., a block in a region of a block in a video signal or a picture signal). Identity transform can be understood as transform skipping. In addition, the encoder is configured to quantize a block to be quantized associated with a predetermined block according to a selected transform mode using a quantization accuracy depending on the selected transform mode to obtain a quantized block. The block to be quantized is, for example, a predetermined block after a selected transform mode, and / or a block obtained by applying a transform based on a selected transform mode to a predetermined block when the selected transform mode is a non-identity transform, and a block obtained by equalizing a predetermined block when the selected transform mode is an identity transform. The quantization accuracy is, for example, defined by a quantization parameter (QP), a scaling factor, and / or a quantization step size. The value of the block to be quantized is, for example, divided by a quantization parameter (QP), a scaling factor, and / or a quantization step size to receive a quantized block. In addition, the encoder is configured to entropy encode the quantized block into a data stream.

[0020] Similarly, according to the first aspect of the present application, a decoder for performing block-based decoding on an encoded picture signal using transform decoding is configured to select a selected transform mode, such as an identity transform or a non-identity transform, for selecting a predetermined block (e.g., a block in a region of a block in a picture signal video or frequency signal). The identity transform can be understood as transform skipping. The non-identity transform can be an inverse transform / inverse transform of the transform applied by the encoder. In addition, the decoder is configured to entropy decode a block to be dequantized in a data stream that is associated with a predetermined block according to a selected transform mode. The block to be dequantized is, for example, a predetermined block before passing through a selected transform mode. In addition, the decoder is configured to dequantize the block to be dequantized using a quantization accuracy that depends on the selected transform mode to obtain a dequantized block. The quantization accuracy is, for example, defined by a quantization parameter (QP), a scaling factor, and / or a quantization step size. The value of the block is, for example, multiplied by a quantization parameter (QP), a scaling factor, and / or a quantization step size to receive a dequantized block. The quantization accuracy, for example, defines the dequantization accuracy of the block to be dequantized. The quantization accuracy can be understood as a scaling accuracy.

[0021] According to an embodiment, the quantization precision depends in part on whether the selected transform mode is an identity transform or a non-identity transform. Note that other adjustments may occur depending on the prediction mode and / or block size and / or block shape. The correlation with the transform mode is based on the idea that a non-identity transform can increase the precision of the residual signal and thus also the dynamic range. However, this is not the case for an identity transform. In the case where the transform mode is an identity transform, the quantization precision associated with the low distortion of a non-identity transform can result in higher distortion. Therefore, the distinction between an identity transform and a non-identity transform is advantageous.

[0022] If the selected transform mode is an identity transform, the encoder and / or decoder may be configured to determine an initial quantization precision for a predetermined block and check whether the initial quantization precision is finer than a predetermined threshold. In the case where the selected transform mode is a non-identity transform, although a quantization precision finer than the predetermined threshold may reduce distortion, this is not the case for the selected transform mode being an identity transform. If the initial quantization precision is finer than the predetermined threshold, the encoder and / or decoder may be configured to set the quantization precision to a default quantization precision, for example, corresponding to the predetermined threshold, in the case where the selected transform mode is an identity transform. Thus, additional distortion that does not exist for the default quantization precision may be avoided.

[0023] In addition, the encoder and / or decoder may be configured to use the initial quantization precision as the quantization precision if the initial quantization precision is not finer than a predetermined threshold. In this case, the initial quantization precision should not introduce additional distortion, so that it is no problem to use the initial quantization precision without changing or adjusting it.

[0024] According to an embodiment, in the case of an encoder, the initial quantization precision is determined by determining an index in a quantization parameter list, and in the case of a decoder, the initial quantization precision is determined by determining an index in a dequantization parameter list. The index, for example, points to a quantization parameter (for example, a dequantization parameter or a scaling parameter of the decoder) within a quantization parameter list (for example, a dequantization parameter list of the decoder) and is associated with a quantization step size via a function that is equal for all quantization parameters in the quantization parameter list. The encoder may be configured to perform quantization, for example, by dividing the value of the block to be quantized by the quantization step size, and the decoder may be configured to perform dequantization by multiplying the value of the block to be dequantized by the quantization step size. The index may be equal to the quantization parameter (QP), and the quantization parameter list and / or the dequantization parameter list may be defined by levelScale[] = {40, 45, 51, 64, 72}. The quantization step size (Δ(QP)) may be derived using an exponential function of the index (QP), for example Among them, levelScale[] = {40, 45, 51, 64, 72}.

[0025] According to an embodiment, the encoder and / or decoder is configured to check whether the initial quantization precision is finer than a predetermined threshold by checking whether the index (i.e., the index in the quantization parameter list) is less than a predetermined index value. The predetermined index value defines, for example, an index of 4, i.e., the index is equal to 4. If the selected transform mode is an identity transform, the encoder and / or decoder may be configured to clip the index (e.g., the quantization parameter QP) for a minimum value of 4. The encoder and / or decoder may be configured to prohibit quantization parameters (QP) less than 4. If the QP is less than 4, the encoder and / or decoder may be configured to set the QP to 4, and if the QP is 4 or greater, maintain the QP, such as TrafoSkip? Max(4, QP): QP. Therefore, indexes (e.g., QP) of 0, 1, 2, and 3 are avoided or not allowed for the transform skip mode, which result in scaling factors less than 1, which may introduce distortion in the transform skip mode. Note that the above examples are applicable to 8-bit video signals and need to be adjusted according to the bit depth of the input video signal. An increase in the bit depth by one results in a decrease in the threshold by six. This signaling may be direct or indirect, for example via specification of a difference in internal bit depth relative to the input bit depth, direct signaling of the input bit depth, and / or signaling of a threshold.An example of an indirect configuration is as follows.

[0026] sps_internal_bit_depth_minus_input_bit_depth specifies the minimum quantization parameter allowed for transform skip mode as follows:

[0027] QpPrimeTsMin=4+6 * sps_internal_bit_depth_minus_input_bit_

[0028] depth

[0029] The value of sps_internal_bit_depth_minus_input_bit_depth should be in the range of 0 to 8, inclusive.

[0030] - Otherwise (transform_skip_flag[xTbY][yTbY][cIdx] is equal to 1), the following

[0031] Applicable:

[0032] qP=Clip3(QpPrimeTsMin,63+QpBdOffset,qP+QpActOffset)

[0033] According to an embodiment, the encoder performs quantization on the block to be quantized, including: scaling, then integer quantization, for example, quantization to the nearest integer value. Similarly, the decoder performs dequantization on the block to be dequantized, including: scaling, then integer dequantization, for example, dequantization to the nearest integer value. In addition, the encoder and / or the decoder are configured so that the predetermined threshold and / or the default quantization precision is related to the scaling factor, for example, in the case of the decoder, the rescaling factor is 1. The encoder can be configured to quantize the block to be quantized using the scaling factor, and the decoder can be configured to dequantize the block to be dequantized using the scaling factor. The encoder can be configured to quantize the block to be quantized by dividing the value of the block to be quantized by the scaling factor, and the decoder can be configured to dequantize the block to be dequantized by multiplying the value of the block to be dequantized by the scaling factor. The encoder and / or the decoder are configured, for example, to check whether the initial quantization precision is finer than a predetermined threshold by checking whether the scaling factor (e.g., the quantization step size Δ (QP)) is less than a predetermined scaling factor. The predetermined scaling factor defines, for example, a scaling factor of 1. If the selected transform mode is the identity transform, the encoder and / or decoder may be configured to clip the scaling factor to a minimum value of 1. The encoder and / or decoder may be configured to prohibit scaling factors less than 1. If Δ(QP) is less than 1, the encoder is configured to set Δ(QP) to 1, and if Δ(QP) is 1 or greater, maintain Δ(QP), e.g., to obtain a scaling factor of at least 1 if the selected transform mode is the identity transform.

[0034] According to an embodiment, the encoder and / or decoder is configured to determine the initial quantization accuracy of several blocks including the predetermined block, the initial quantization accuracy of several pictures including the predetermined block, or the initial quantization accuracy of a slice of the picture including the predetermined block, for example, of the entire picture including the predetermined block. In the case of several pictures, at least one or only one of the pictures must include the predetermined block. In the case of the encoder, the picture is a picture of a picture signal or a video signal to be encoded, and the several blocks are, for example, blocks in a picture of a picture signal or a video signal. In the case of the decoder, the block is, for example, a prediction residual block in a residual picture of a decoded picture signal or a decoded video signal.

[0035] The encoder may be configured to signal in the data stream, for example, the initial quantization precision of several blocks such as the entire picture, the initial quantization precision of several pictures, or the initial quantization precision of a slice of a picture. The decoder may be configured to read from the data stream, for example, the initial quantization precision of several blocks such as the entire picture, the initial quantization precision of several pictures, or the initial quantization precision of a slice of a picture.

[0036] According to an embodiment, the encoder is configured to signal the quantization precision and / or the selected transform mode in the data stream.The decoder is, for example, configured to read the quantization precision and / or the selected transform mode from the data stream.

[0037] According to an embodiment, in the case of an encoder, the predetermined block represents a block of prediction residuals of a picture signal to be encoded based on a block. In the case of a decoder, the predetermined block, for example, represents a block of prediction residuals of a picture signal to be decoded based on a block. In the case of a decoder, the predetermined block, for example, represents a decoded residual block.

[0038] According to an embodiment, the encoder and / or decoder is configured to determine the initial quantization precision of a predetermined block and modify the initial quantization precision according to the selected transform mode. The initial quantization precision includes, for example, an index (ie, QP) and / or a scaling factor (ie, Δ(QP)). Therefore, the compression efficiency can be improved. This is based on the following idea: the initial quantization precision of a group of blocks or the initial quantization precision of several pictures can be signaled in the data stream, and for each block to be encoded or decoded, the initial quantization precision can be adjusted individually according to the transform mode of the corresponding block.

[0039] The modification of the initial quantization precision can be performed by offsetting the initial quantization precision using an offset value according to the selected transform mode. The offset can be selected so that the compression efficiency is improved, for example, by maximizing the perceived visual quality or minimizing the objective distortion (such as square error) for a given bit rate, or by reducing the bit rate for a given quality / distortion. According to an embodiment, the encoder and / or decoder is configured to determine the offset value for each transform mode. This can be performed separately for each picture signal or video signal. Alternatively, the offset value is determined for a smaller entity, such as several pictures, a picture, one or more slices of a picture, multiple blocks or a single block. Alternatively or additionally, for each transform mode, the offset value can be obtained from an offset value list.

[0040] As previously described, the encoder may be configured to determine the initial quantization precision by determining an index in a quantization parameter list. Similarly, the decoder may be configured to determine the initial quantization precision by determining an index in a dequantization parameter list. According to an embodiment, the encoder and / or decoder is configured to modify the initial quantization precision by adding an offset value to the index or by subtracting the offset value from the index. The index (i.e., quantization parameter (QP)) for example reduces or increases the offset value.

[0041] As previously described, in the case of an encoder, quantizing a block to be quantized may include scaling and then integer quantization, such as quantization to the nearest integer value. The encoder may be configured to perform scaling by dividing the value of the block to be quantized by a scaling factor. Similarly, in the case of a decoder, dequantizing a block to be dequantized may include scaling (e.g., rescaling) and then integer dequantization (e.g., dequantization to the nearest integer value), and the decoder may be configured to perform scaling by multiplying the value of the block to be dequantized by a scaling factor (e.g., a rescaling factor). In addition, the encoder and / or decoder may be configured to modify the initial quantization accuracy by adding an offset value to the scaling factor or by subtracting the offset value from the scaling factor. For example, the scaling factor is equal to the quantization step size Δ (QP). The quantization step size Δ (QP) can reduce or increase the offset value.

[0042] According to an embodiment, the encoder and / or decoder is configured to provide a modified initial quantization precision according to whether the selected transform mode is an identity transform or a non-identity transform. In other words, the encoder and / or decoder can be configured to modify the initial quantization precision according to whether the selected transform mode is an identity transform or a non-identity transform.

[0043] According to an embodiment, the encoder and / or decoder is configured to: if the selected transform mode is an identity transform, determine the initial quantization precision of the predetermined block and check whether the initial quantization precision is coarser than a predetermined threshold, and if the initial quantization precision is coarser than the predetermined threshold, the encoder and / or decoder is configured to modify the initial quantization precision using an offset value according to the selected transform mode, so that the modified initial quantization precision is finer than the predetermined threshold. If the index (QP) is greater than 10, 20, 30, 35, 40 or 45, the initial quantization precision is, for example, coarser than the predetermined threshold. In other words, the predetermined threshold can be represented by an index of 10, 20, 30, 35, 40 or 45. Therefore, at the second end of the bit rate range, i.e. for low bit rates, the index or scaling factor is reduced by the offset value. The second end of the bit rate range is, for example, associated with the end of the bit rate range opposite to the first end of the bit rate range, associated with a QP of 4 or lower.

[0044] According to an embodiment, the encoder and / or the decoder is configured to not modify the initial quantization precision using an offset value according to the selected transform mode if the initial quantization precision is not coarser than a predetermined threshold.

[0045] According to an embodiment, the encoder and / or decoder is configured to not use the offset value to modify the initial quantization precision if the selected transform mode is a non-identity transform. Thus, the offset is, for example, only used if the transform mode is an identity transform.

[0046] According to an embodiment, the encoder and / or decoder is configured to determine the offset by using rate-distortion optimization.Therefore, a high compression efficiency resulting in only small or no distortion can be achieved depending on the transform mode to be used for the predetermined block for which the offset is determined.

[0047] According to an embodiment, the encoder is configured to signal in a data stream an offset of a number of blocks including the predetermined block, an offset of a number of pictures including the predetermined block, or an offset of a slice of a picture including the predetermined block, such as an offset value or an index pointing to an offset value in a set of offset values. The picture is, for example, a picture of a picture signal or a video signal to be encoded, and the number of blocks are, for example, blocks in a picture of the picture signal or the video signal.

[0048] According to an embodiment, the decoder is configured to read, from a data stream, for example, an offset of several blocks including a predetermined block, an offset of several pictures including the predetermined block, or an offset of a slice of a picture including the predetermined block, such as an offset value or an index pointing to an offset value in a set of offset values. The decoder is configured to read, from a data stream, for example, an offset of several blocks including a predetermined block, an offset of several pictures including the predetermined block, or an offset of a slice of a picture including the predetermined block.

[0049] In the case of an encoder, quantizing the block to be quantized optionally includes: performing global scaling of the block (e.g., using one scaling factor for all values ​​of the block), and scaling using an intra-block varying scaling matrix, followed by integer quantization, e.g., quantization to the nearest integer value. The intra-block varying scaling matrix is, for example, a matrix having multiple scaling factors, such as multiple quantization parameters (QP) or multiple quantization step sizes Δ(QP). Each transform coefficient obtained by the encoder, for example, by applying a selected transform to a predetermined block, is scaled by one of the multiple scaling factors of the scaling matrix before scaling. Scaling using an intra-block varying scaling matrix can result in frequency-dependent weighting or spatially dependent weighting. In addition, the encoder can be configured to determine the intra-block varying scaling matrix according to a selected transform mode.

[0050] In the case of a decoder, dequantizing a block to be dequantized comprises: performing block global scaling (i.e., performing block global rescaling (e.g., using one scaling factor, i.e., one rescaling factor, for all values ​​of the block)), and scaling (e.g., rescaling) using an intra-block varying scaling matrix (i.e., an intra-block varying rescaling matrix), and then performing integer dequantization, e.g., dequantizing to the nearest integer value. The intra-block varying scaling matrix is, for example, a matrix with multiple scaling factors (i.e., rescaling factors), and the matrix with multiple scaling factors (i.e., rescaling factors) is, for example, a matrix with multiple quantization parameters (QP) or multiple quantization step sizes Δ(QP). Each value of the block is, for example, scaled individually by one of the multiple scaling factors of the scaling matrix. Scaling by the intra-block varying scaling matrix, for example, results in frequency-dependent weighting or spatially-dependent weighting. In addition, the decoder can be configured to determine the intra-block varying scaling matrix according to the selected transform mode.

[0051] According to an embodiment, the encoder and / or the decoder is configured to determine the intra-block change scaling matrix so that different blocks of equal size and shape to be quantized or dequantized are determined to have different intra-block change scaling matrices. Therefore, a first intra-block change scaling matrix of a first block and a second intra-block change scaling matrix of a second block may be different, wherein the first block and the second block may have the same size and shape.

[0052] In addition, the determination optionally causes the intra-block variation scaling matrix determined for different blocks to be quantized or different blocks to be dequantized of equal size and shape to depend on the selected transform mode, and the selected transform mode is not equal to the identity transform. This is based on the idea that frequency weighted scaling is not beneficial when the selected transform mode is the identity transform. For the identity transform, for example, block global scaling or spatial weighted scaling matrices can be used. However, for a transform mode equal to a non-identity transform, it is beneficial to scale each transform coefficient of the block to be quantized or dequantized individually. For different non-identity transform modes, the intra-block variation scaling matrix may be different.

[0053] According to an embodiment, the encoder is configured to: if the selected transform mode is a non-identity transform, apply a transform corresponding to the selected transform mode to a predetermined block to obtain a block to be quantized, and if the selected transform mode is an identity transform, the predetermined block is the block to be quantized.

[0054] According to an embodiment, the decoder is configured to: if the selected transform mode is a non-identity transform, apply an inverse transform corresponding to the selected transform mode to the dequantized block to obtain a predetermined block, and if the selected transform mode is an identity transform, the dequantized block is the predetermined block.

[0055] Embodiments relate to a method for block-based encoding of a picture signal using transform coding, comprising: selecting a selected transform mode, such as an identity transform or a non-identity transform, for a predetermined block (e.g., a block in a region of blocks in a video signal or a picture signal). Identity transform is understood, for example, as transform skipping. In addition, the method comprises: quantizing a block to be quantized associated with the predetermined block according to the selected transform mode using a quantization precision that depends on the selected transform mode to obtain a quantized block. The block to be quantized is, for example, a predetermined block that has been subjected to the selected transform mode, and / or a block obtained by applying a transform based on the selected transform mode to the predetermined block when the selected transform mode is a non-identity transform, and a block obtained by equalizing the predetermined block when the selected transform mode is an identity transform. The quantization precision is, for example, defined by a quantization parameter (QP), a scaling factor, and / or a quantization step size. The value of the block is, for example, divided by a quantization parameter (QP), a scaling factor, and / or a quantization step size to receive a quantized block. In addition, the method comprises entropy encoding the quantized block into a data stream.

[0056] Embodiments relate to a method for block-based decoding of an encoded picture signal using transform decoding, comprising: selecting a selected transform mode, such as an identity transform or a non-identity transform, for a predetermined block (e.g., a residual block in a region of adjacent residual blocks in a decoded residual picture signal or residual video signal). An identity transform is, for example, understood as a transform skip, while a non-identity transform is, for example, an inverse / inverse transform of a transform applied by an encoder. In addition, the method comprises entropy decoding a block to be dequantized in a data stream that is associated with the predetermined block according to a selected transform mode, and dequantizing the block to be dequantized using a quantization precision that depends on the selected transform mode to obtain a dequantized block. The quantization precision is, for example, defined by a quantization parameter (QP), a scaling factor, and / or a quantization step size. The value of the block can be multiplied by a quantization parameter (QP), a scaling factor, and / or a quantization step size to receive a dequantized block. The quantization precision, for example, defines the precision of dequantization of the block to be dequantized.

[0057] The above methods are based on the same considerations as the above encoder and / or decoder. In this way, these methods can be completed with all the features and functions described with respect to the encoder and / or decoder.

[0058] An embodiment relates to a computer program with a program code for performing the method described herein when running on a computer.

[0059] The embodiment relates to a data stream obtained by performing a block-based encoding method on a picture signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] The accompanying drawings are not necessarily drawn to scale, instead emphasis is generally placed on illustrating the principles of the invention. In the following description, various embodiments of the invention are described with reference to the following drawings, in which:

[0061] Figure 1a shows a schematic diagram of an encoder;

[0062] Figure 1b A schematic diagram of an alternative encoder is shown;

[0063] Figure 2 shows a schematic diagram of a decoder;

[0064] Figure 3 A schematic diagram of block-based coding is shown;

[0065] Figure 4 shows a schematic diagram of an encoder according to an embodiment;

[0066] Figure 5 shows a schematic diagram of a decoder according to an embodiment;

[0067] Figure 6 A schematic diagram showing decoding-side scaling and inverse transformation in recent video coding standards;

[0068] Figure 7 A schematic diagram showing decoder-side scaling and inverse transformation according to an embodiment is shown;

[0069] Figure 8 A block diagram showing a method based on block coding according to an embodiment; and

[0070] Fig. 9 A block diagram of a block-based decoding method according to an embodiment is shown. DETAILED DESCRIPTION

[0071] Even if the same or equivalent reference numerals appear in different drawings, in the following description, the same or equivalent elements or elements having the same or equivalent functions are denoted by the same or equivalent reference numerals.

[0072] In the following description, a number of details are set forth to provide a more thorough explanation of embodiments of the present invention. However, it will be clear to those skilled in the art that embodiments of the present invention may be practiced without these specific details. In other examples, well-known structures and devices are shown in block diagram form rather than specifically to avoid confusion with embodiments of the present invention. In addition, unless otherwise specifically indicated, the features of the different embodiments described below may be combined with each other.

[0073] The following description of the drawings starts with the presentation of a description of an encoder and a decoder based on block prediction codec for encoding pictures of a video in order to form an example of a coding framework in which embodiments of the present invention may be built. Figures 1a to 3 The corresponding encoder and decoder are described. Although Figures 4 to 7 Embodiments are described, and the embodiments of the inventive concepts described herein can be constructed into Figure 1a , Figure 1b and Figure 2 The encoder and decoder can also be used to form Figure 1a , Figure 1b and Figure 2 The encoder and decoder operate on the underlying encoding framework.

[0074] Figure 1a An apparatus (eg, a video encoder and / or a picture encoder) is shown that exemplarily uses transform-based residual coding to predictively encode a picture 12 into a data stream 14. The apparatus or encoder is indicated using reference numeral 10. Figure 1b Also shown is an arrangement for predictively encoding a picture 12 into a data stream 14, wherein a possible prediction module 44 is shown in more detail. Figure 2 A corresponding decoder 20 is shown, i.e. an apparatus 20 configured to predictively decode a picture 12′ in a data stream 14 also using transform-based residual decoding, wherein a prime sign has been used to indicate that the picture 12′ reconstructed by the decoder 20 deviates from the picture 12 initially encoded by the apparatus 10 in terms of coding losses introduced by quantization of the prediction residual signal. Figure 1a , Figure 1b and Figure 2 Transform-based prediction residual coding is used illustratively, but the embodiments of the present application are not limited to such prediction residual coding. Figure 1a , Figure 1b and Figure 2 The same is true for the other details described.

[0075] The encoder 10 is configured to perform a spatial-to-spectral transformation on the prediction residual signal and encode the prediction residual signal thus obtained into the data stream 14. Likewise, the decoder 20 is configured to decode the prediction residual signal in the data stream 14 and perform a spectral-to-spatial transformation on the prediction residual signal thus obtained.

[0076] Internally, the encoder 10 may include a prediction residual signal former 22 that generates a prediction residual 24 to measure the deviation of the prediction signal 26 from the original signal (i.e., from the picture 12), wherein the prediction signal 26 may be interpreted as a linear combination of a set of one or more predictor blocks according to an embodiment of the present invention. The prediction residual signal former 22 may, for example, be a subtractor that subtracts the prediction signal from the original signal (i.e., from the picture 12). The encoder 10 then also includes a transformer 28 that performs a spatial to spectral transform on the prediction residual signal 24 to obtain a spectral domain prediction residual signal 24', which is then quantized by a quantizer 32, which is also included in the encoder 10. The prediction residual signal 24" so quantized is encoded into the bitstream 14. To this end, the encoder 10 may optionally include an entropy encoder 34 that entropy encodes the transformed and quantized prediction residual signal into the data stream 14.

[0077] The prediction signal 26 is generated by a prediction stage 36 of the encoder 10 based on a prediction residual signal 24″ which is encoded into the data stream 14 and can be decoded from the data stream 14. For this purpose, Figure 1a As shown, the prediction stage 36 may internally include a dequantizer 38, which dequantizes the prediction residual signal 24" to obtain a spectral domain prediction residual signal 24"' corresponding to the signal 24' except for the quantization loss, and then includes an inverse transformer 40, which inversely transforms the latter prediction residual signal 24"' (i.e., spectrum to space transformation) to obtain a prediction residual signal 24"" corresponding to the original prediction residual signal 24 except for the quantization loss. The combiner 42 of the prediction stage 36 then recombines the prediction signal 26 and the prediction residual signal 24"" to obtain a reconstructed signal 46, i.e., a reconstruction of the original signal 12, for example by addition. The reconstructed signal 46 may correspond to the signal 12'. As shown in FIG. Figure 1b As shown in more detail, prediction module 44 of prediction stage 36 then generates prediction signal 26 based on signal 46 by using, for example, spatial prediction (ie, intra-picture prediction) and / or temporal prediction (ie, inter-picture prediction).

[0078] Likewise, if Figure 2 As shown, the decoder 20 may be internally composed of components corresponding to the prediction stage 36 and interconnected in a manner corresponding to the prediction stage 36. Specifically, the entropy decoder 50 of the decoder 20 may entropy decode the quantized spectral domain prediction residual signal 24″ in the data stream, and then the dequantizer 52, the inverse transformer 54, the combiner 56 and the prediction module 58 interconnected and cooperating in the manner described above with respect to the prediction stage 36 may restore the reconstructed signal based on the prediction residual signal 24″, so as to be Figure 2 As shown, the output of combiner 56 produces the reconstructed signal (ie, Picture 12').

[0079] Although not specifically described above, it is easy to understand that the encoder 10 can set some encoding parameters including, for example, prediction modes, motion parameters, etc. according to some optimization schemes (for example, in a manner that optimizes some rate and distortion related criteria (i.e., encoding cost)). For example, the encoder 10 and the decoder 20 and the corresponding modules 44, 58 can support different prediction modes such as intra-frame coding mode and inter-frame coding mode, respectively. The granularity at which the encoder and the decoder switch between these prediction mode types can correspond to the subdivision of the pictures 12 and 12' into coding segments or coding blocks, respectively. For example, in units of these coding segments, the pictures can be subdivided into blocks that are intra-frame encoded and blocks that are inter-frame encoded.

[0080] As outlined in more detail below, an intra-coded block is predicted based on a spatial, already encoded / decoded neighborhood (e.g., a current template) of a corresponding block (e.g., a current block). Several intra-coding modes may exist and be selected for a corresponding intra-coded segment, including directional or angular intra-coding modes, according to which the corresponding segment is filled by extrapolating sample values ​​of the neighborhood into the corresponding intra-coded segment along a direction specific to the corresponding directional intra-coding mode. For example, the intra-coding modes may also include one or more other modes, such as: a DC coding mode, according to which the prediction of the corresponding intra-coded block assigns a DC value to all samples within the corresponding intra-coded segment; and / or a plane intra-coding mode, according to which the prediction of the corresponding block is approximated or determined as a spatial distribution of sample values ​​described by a two-dimensional linear function at sample positions of the corresponding intra-coded block, with a driving tilt and offset of a plane defined by the two-dimensional linear function based on neighboring samples.

[0081] In contrast, inter-coded blocks may be temporally predicted, for example. For inter-coded blocks, a motion vector may be signaled within the data stream 14, which indicates a spatial displacement of a portion of a previously coded picture (e.g., a reference picture) of the video to which the picture 12 belongs, at which the previously coded / decoded picture was sampled to obtain a prediction signal for the corresponding inter-coded block. This means that, in addition to the residual signal encoding included in the data stream 14 (e.g., entropy coded transform coefficient levels representing a quantized spectral domain prediction residual signal 24″), coding mode parameters for assigning coding modes to various blocks, prediction parameters for some blocks (e.g., motion parameters for inter-coded segments), and optionally other parameters, such as parameters for controlling and signaling the subdivision of the picture 12 and picture 12′ into segments, respectively. The decoder 20 uses these parameters to subdivide the pictures in the same way as the encoder, assign the same prediction modes to the segments, and perform the same predictions to produce the same prediction signals.

[0082] Figure 3The relationship between the reconstruction signal (i.e. the reconstructed picture) 12' on the one hand and the combination of the prediction residual signal 24"" and the prediction signal 26 signaled in the data stream 14 on the other hand is shown. As already described above, the combination may be an addition. The prediction signal 26 is Figure 3 1 is shown as subdividing the picture region into intra-frame coding blocks indicated by hatching and inter-frame coding blocks indicated by no hatching. The subdivision may be any subdivision, such as regularly subdividing the picture region into rows and columns of square blocks or non-square blocks, or subdividing the picture 12 from a tree root block into a plurality of leaf blocks of variable size, such as quadtree subdivision, etc., wherein Figure 3 A hybrid thereof is shown in which the picture region is first subdivided into rows and columns of tree root blocks and then further subdivided into one or more leaf blocks according to a recursive multi-tree subdivision.

[0083] Likewise, the intra-coding mode for the intra-coding block 80 may be encoded in the data stream 14, which assigns one of several supported intra-coding modes to the corresponding intra-coding block 80. For the inter-coding block 82, one or more motion parameters may be encoded in the data stream 14. In general, the inter-coding block 82 is not limited to being encoded in time. Alternatively, the inter-coding block 82 may be any block predicted from a previously encoded portion beyond the current picture 12 itself, such as a previously encoded picture of the video to which the picture 12 belongs, or a picture of another view or a lower layer in the case where the encoder and decoder are scalable encoders and decoders, respectively.

[0084] Figure 3 The prediction residual signal 24″″ in is also shown to subdivide the picture area into blocks 84. These blocks may be referred to as transform blocks in order to distinguish them from the coding blocks 80 and 82. In practice, Figure 3 It is shown that the encoder 10 and the decoder 20 can respectively subdivide the picture 12 and the picture 12' into blocks using two different subdivisions, namely one subdivision into coding blocks 80 and 82, and the other subdivision into transform blocks 84. The two subdivisions can be the same, that is, each coding block 80 and 82 can also form a transform block 84, but Figure 3The following situation is shown: in which, for example, the subdivision into transform blocks 84 forms an extension of the subdivision into coding blocks 80 and 82, so that any boundary between two blocks 80 and 82 overlaps the boundary between two blocks 84, or alternatively, each block 80, 82 either coincides with one of the transform blocks 84 or with a group of transform blocks 84. However, the subdivision can also be determined or selected independently of each other, so that the transform block 84 can alternatively cross the block boundary between the blocks 80, 82. As far as the subdivision into transform blocks 84 is concerned, statements similar to those about the subdivision into blocks 80, 82 are therefore true, that is, the block 84 can be the result of a regular subdivision of the picture area into blocks (arranged or not arranged in rows and columns), the result of a recursive multi-tree subdivision of the picture area, or a combination thereof, or any other type of blocking method. By the way, it should be noted that the blocks 80, 82 and 84 are not limited to square, rectangular or any other shape.

[0085] Figure 3 It is also shown that the combination of the prediction signal 26 and the prediction residual signal 24"" directly produces the reconstructed signal 12'. However, it should be noted that according to alternative embodiments more than one prediction signal 26 may be combined with the prediction residual signal 24"" to produce the picture 12'.

[0086] exist Figure 3 In the embodiment described below, the transform block 84 should have the following meaning. The transformer 28 and the inverse transformer 54 perform their transforms in units of these transform blocks 84. For example, many codecs use some kind of DST (discrete sine transform) or DCT (discrete cosine transform) for all transform blocks 84. Some codecs allow skipping transforms so that for some transform blocks 84, the prediction residual signal is directly encoded in the spatial domain. However, according to the embodiments described below, the encoder 10 and the decoder 20 are configured in a way that they support several transforms. For example, the transforms supported by the encoder 10 and the decoder 20 may include:

[0087] DCT-II (or DCT-III), where DCT stands for Discrete Cosine Transform

[0088] DST-IV, where DST stands for discrete sine transform

[0089] DCT-IV

[0090] Daylight Saving Time-VII

[0091] Identity Transformation (IT)

[0092] Naturally, while the transformer 28 will support all forward transformed versions of these transforms, the decoder 20 or inverse transformer 54 will support their corresponding backward or inverse versions:

[0093] Inverse DCT-II (or Inverse DCT-III)

[0094] ·Inverse DST-IV

[0095] Inverse DCT-IV

[0096] ·Inverse DST-VII

[0097] Identity Transformation (IT)

[0098] The subsequent description provides more details about the transforms that can be supported by the encoder 10 and decoder 20. In any case, it should be noted that the set of supported transforms may include only one transform, such as a spectral to spatial or spatial to spectral transform, but it is also possible that the encoder or decoder does not use a transform at all or does not use a transform for a single block 80, 82, 84.

[0099] As already outlined above, Figure 1a to Figure 2 has been presented as an example in which the inventive concepts described herein may be implemented to form specific examples of encoders and decoders according to the present application. In this regard, Figure 1a , Figure 1b and Figure 2 The encoder and decoder of may represent possible implementations of the encoder and decoder described above, respectively. However, Figure 1a , Figure 1b and Figure 2 However, the encoder according to the embodiment of the present application may use the above or later more detailed overview and different Figure 1a or Figure 1b The concept of the encoder performs block-based coding on the picture 12, which is different from Figure 3 The subdivision into blocks 80 may be performed in the manner illustrated in the example in FIG. 1 , and / or no transform is used at all (e.g., transform skipping / identical transform) or no transform is used for a single block. Similarly, a decoder according to an embodiment of the present application may perform block-based decoding on a picture 12′ in a data stream 14 using the coding concept further outlined below, but may be similar to, for example, Figure 2 The decoder 20 is different in that it is different from Figure 3 The described approach subdivides the picture 12' into blocks and / or derives prediction residuals in the spatial domain instead of in the transform domain from the data stream 14, for example and / or does not use any transform at all or does not use a transform for individual blocks.

[0100] According to an embodiment, the inventive concept described previously may be implemented in a quantizer 32 of an encoder or a dequantizer 38, 52 of a decoder. Thus, according to an embodiment, the quantizer 32 and / or the dequantizer 38, 52 may be configured to apply different scaling to the block to be quantized depending on the selected transform applied by the transformer 28 or to be applied by the inverse transformer 54. Thus, the quantizer 32 and / or the dequantizer 38, 52 is configured to use not only one predefined scaling for all transform modes (i.e., transform types), but also a different scaling for each selected transform mode.

[0101] State-of-the-art hybrid video coding techniques use the same scaling factor for inverse quantization regardless of the transform and block size used. The present invention describes methods that allow different scaling factors to be used depending on the selected transform and block size. From the encoder's point of view, the quantization step size is different depending on the selected transform and transform block size. By combining different quantization step sizes depending on the transform type and transform block size, the encoder can achieve higher compression efficiency.

[0102] Figure 4 An encoder 10 is shown for block-based encoding of a picture signal using transform coding. A predetermined block 18 of a prediction residual 24 of an input picture 12 is processed by the encoder 10.

[0103] The encoder 10 is configured to select a selected transform mode 130 for a predetermined block 18. The selected transform mode 130 is selected, for example, based on the content of the predetermined block 18, or based on the content of the prediction residual 24 of the input picture 12, or based on the content of the input picture 12. The encoder can select the selected transform mode 130 from the transform mode 128, which can be divided into a non-identity transform 1281 and an identity transform 1282.

[0104] According to an embodiment, the non-identity transform 1281 includes a DCT-II, DCT-III, DCT-IV, DST-IV and / or DST-VII transform.

[0105] Furthermore, the encoder 10 is configured to quantize a block 18 ′ to be quantized associated with a predetermined block 18 according to the selected transform mode 130 using a quantization precision 140 depending on the selected transform mode 130 to obtain a quantized block 18 ″.

[0106] According to an embodiment, the block 18′ to be quantized by the quantizer 32 may be obtained by the encoder through one or more processing steps applied to the predetermined block 18, wherein the encoder 10 may be configured to use the selected transform mode 130 in one of these steps. The block 18′ to be quantized is, for example, a processed version of the predetermined block 18. For example, the block 18′ to be quantized is obtained by applying the selected transform mode 130 to the predetermined block 18, wherein an identity transform may correspond to a transform skip.

[0107] The block 18' to be quantized is quantized with a certain quantization precision 140. The quantization precision 140 may be determined based on a selected transform mode 130 selected for a predetermined block 18 associated with the block 18' to be quantized. By optimizing the quantization precision 140, distortion caused by quantization may be reduced. For different transform modes 128, the same quantization precision may result in different amounts of distortion. Therefore, it is advantageous to associate separate quantization precisions 140 with different transform modes 128.

[0108] The encoder 10 is for example configured to determine a quantization parameter for the block 18' to be quantized, the quantization parameter defining a quantization precision 140. The quantization precision 140 is for example defined by a quantization parameter (QP), a scaling factor and / or a quantization step size.

[0109] The quantized block 18 ″ resulting from the quantization of the block 18 ′ using the individual quantization precision 140 is entropy encoded into the data stream 14 by the entropy encoder 34 of the encoder 10 .

[0110] Optionally, the encoder 10 may include Figure 7 Similar or combined Figure 7 Additional features described.

[0111] Figure 5 A decoder 20 is shown for block-based decoding of an encoded picture signal using transform decoding. The decoder 20 may be configured to reconstruct an output picture from the data stream 14, wherein the predetermined block 118 may represent a block of prediction residuals for the output picture.

[0112] The decoder 20 is configured to select a selected transform mode 130 for a predetermined block 118. The selected transform mode 130 is selected, for example, based on signaling in the data stream 14. The decoder may select the selected transform mode 130 from transform modes 128, which may be divided into non-identity transforms 1281 and identity transforms 1282.

[0113] The non-identity transform 1281 may represent an inverse / reverse transform of a transform applied by an encoder. According to an embodiment, the non-identity transform 1281 comprises an inverse DCT-II, inverse DCT-III, inverse DCT-IV, inverse DST-IV and / or inverse DST-VII transform.

[0114] Furthermore, the decoder 20 is configured to entropy decode, by the entropy decoder 50, a block 118′ to be dequantized in the data stream 14 that is associated with the predetermined block 118 according to the selected transform mode 130. According to an embodiment, the block 118′ to be dequantized may be processed by one or more steps performed by the decoder 20 to produce the predetermined block 118, wherein the decoder 20 may be configured to use the selected transform mode 130 in one of these steps. The predetermined block 118 is, for example, a processed version of the block 118′ to be dequantized. The block 118′ to be quantized is, for example, the predetermined block 118 before being subjected to the selected transform mode 130. Figure 5 As shown, the decoder 20 is optionally configured to use the inverse transformer 54 to obtain the predetermined block 118 using the selected transform mode 130 .

[0115] Furthermore, the decoder 20 is configured to dequantize the block 118' to be dequantized by the dequantizer 52 using a quantization precision 140 depending on the selected transform mode 130 to obtain a dequantized block 118".

[0116] The block 118' to be dequantized is dequantized with a certain quantization precision 140. The quantization precision 140 may be determined based on a selected transform mode 130 selected for a predetermined block 118 associated with the block 118' to be dequantized. By optimizing the quantization precision 140, distortion caused by quantization may be reduced. For different transform modes 128, the same quantization precision may result in different amounts of distortion. Therefore, it is advantageous to associate separate quantization precisions 140 with different transform modes 128.

[0117] The decoder 20 is, for example, configured to determine a quantization parameter (ie, a dequantization parameter) for the block 118' to be dequantized, which defines a quantization precision 140. The quantization precision 140 is, for example, defined by a quantization parameter (QP), a scaling factor and / or a quantization step size.

[0118] The optional transformer 54 may be configured to transform the dequantized block 118 ″ using the selected transform mode 130 to obtain the predetermined block 118 .

[0119] The present invention can change the quantization step size, i.e., the quantization precision, according to the selected transform and transform block size. The following description is written from the decoder's perspective, and the decoder-side scaling 52 (multiplication) with the quantization step size can be viewed as the inverse (irreversible) relationship of the encoder-side division by the step size.

[0120] On the decoder side, the scaling 52 (i.e., dequantization) of the (quantized) transform coefficient levels in current video coding standards such as H.265 / HEVC is designed for transform coefficients generated by DCT / DST integer transforms with higher precision, as shown in Figure 6. There, the variable bitDepth specifies the bit depth of the image samples, for example 8 bits or 10 bits. The variables log2TbW and log2TbH specify the binary logarithm of the transform block width and height, respectively. Figure 6 Decoder-side scaling 52 and inverse transform 54 in a recent video coding standard such as H.265 / HEVC is shown.

[0121] It should be noted that at the decoder, the two DCT / DST based one-dimensional integer transforms 1281 introduce an additional factor This needs to be compensated by performing an inverse scaling. For non-square blocks with singular log2TbH+log2TbW, the scaling consists of This can be taken into account by adding a scaling factor of 181 / 256 or using a different set of levelScale values ​​(e.g. levelScale[] = {29, 32, 36, 40, 45, 51}) which in this case includes this factor. This does not apply for the identity transform or transform skip 1282 case.

[0122] It can be seen that for QPs less than 4, the levelScale of these QPs is less than 64=2 6 , so the step size or scaling factor becomes less than 1. This is not a problem for transform coefficients since the integer forward transform 1281 increases the precision of the residual signal and thus increases the dynamic range. However, for the residual signal in the case of identity transform or transform skip 1282, the dynamic range is not increased. In this case, for QP<4, a scaling factor less than 1 may introduce distortion, while for QP of 4, a scaling factor of 1 does not have distortion. This contradicts the quantizer design intent that reducing QP should reduce distortion.

[0123] For example, changing the quantization step size depending on the selected transform, whether or not the transform is skipped, can be used to derive different quantization step sizes for transform skipping 1282. In particular, for the lowest QPs of 0, 1, 2, and 3, this will solve the problem of the quantization step size / scaling factor being less than 1 for the lowest QP. Figure 7In one embodiment shown, a solution may be to clip the quantization parameter 53 to the minimum allowed value of 4 (QP'), which results in that the quantization step size cannot be less than 1. In addition to this, the size-dependent normalization 541 using bdShift1 and the final rounding 542 to the bit depth using bdShift2 required for the transform may be moved to the transform path 54. This will downshift the transform skip scaling by 10 bits by rounding. In another embodiment, a bitstream restriction may be defined to not allow the encoder to use QP values ​​that result in a scaling factor less than 1 for transform skipping, but to clip the QP value to 4. Figure 7 An improved decoder side scaling 52 and inverse transform 54 according to the present invention is shown.

[0124] At the other end of the bitrate range, i.e. for lower bitrates, the quantization step size of the identity transform 1282 may be reduced by an offset, resulting in higher fidelity for blocks where no transform or identity transform 1282 is applied. This will enable the encoder to select appropriate QP values ​​for transform skip blocks to achieve higher compression efficiency. This aspect is not limited to identity transform / transform skip 1282, it can also be used to modify the QP of other transform types 1281 by an offset. The encoder will determine this offset, for example, in a way that improves coding efficiency, such as by maximizing perceived visual quality or minimizing objective distortion (such as squared error) for a given bitrate, or by reducing the bitrate for a given quality / distortion. This (in terms of the applied criteria) optimal derivation from the slice QP depends on, for example, the content, bitrate or complexity operating point, and other factors such as the selected transform and transform block size. The present invention describes a method of signaling a QP offset in the case of multiple transforms. Without loss of generality, given two alternative transforms, the encoder can send a fixed QP offset for each of the two alternative transforms in a high-level syntax structure (e.g., a sequence parameter set, a picture parameter set, a tile group header, a slice header, or a similar structure). Alternatively, when the encoder has selected an alternative transform, for example, the encoder sends a QP offset for each transform block. A combination of these two approaches is to signal a base QP offset in a high-level syntax structure and to signal an additional offset for each transform block using an alternative transform. The offset can be a value that is added or subtracted from the base QP, or an index into a set of offset values. The set can be predefined or signaled in a high-level syntax structure.

[0125] • In a preferred embodiment of the invention, the QP offset relative to the base QP for the identity transform is signaled in a high-level syntax structure, for example at sequence, picture, tile group, tile or slice level.

[0126] • In another preferred embodiment of the present invention, for each coding unit or a predefined set of coding units, a QP offset relative to the base QP for the identity transform is signaled.

[0127] In another preferred embodiment of the present invention, for each transform unit to which the identity transform is applied, a QP offset relative to the base QP for the identity transform is signaled.

[0128] Another aspect of the invention is the use of different scaling matrices for different transform types, such as identity transform / transform skip. The scaling matrix allows each transform coefficient to be scaled differently. Since the transform coefficients are typically associated with different spatial frequencies of the residual signal, this can be interpreted as frequency-dependent weighting. Since the distribution of coefficients produced by different transform types may be different, it is recommended to use different scaling matrices for different transform types. A special case of this is the identity transform, where the coefficients are equal to the residual samples independent of the spatial frequency. In that case, there is no benefit from frequency-weighted scaling and either a separate spatially weighted scaling matrix or no matrix-based scaling can be applied.

[0129] also, Figure 8 and Fig. 9 A method based on the principles described with respect to the above encoder and / or decoder is shown.

[0130] Figure 8 A method 800 for block-based encoding of a picture signal using transform coding is shown, including: selecting 810 a selected transform mode for a predetermined block, such as an identity transform or a non-identity transform, wherein the identity transform can be understood as a transform skip. In addition, the method 800 includes quantizing 820 a block to be quantized (e.g., a predetermined block that has undergone a selected transform mode) associated with the predetermined block according to the selected transform mode, for example, using a quantization accuracy defined by a quantization parameter (QP), a scaling factor, and / or a quantization step size depending on the selected transform mode, to obtain a quantized block. The block to be quantized can be a block obtained by applying a transform based on the selected transform mode to the predetermined block when the selected transform mode is a non-identity transform, and a block obtained by equalizing the predetermined block when the selected transform mode is an identity transform. The quantization 820 can be performed by dividing the value of the block by a quantization parameter (QP), a scaling factor, and / or a quantization step size to receive a quantized block. In addition, the method 800 includes entropy encoding 830 the quantized block into a data stream.

[0131] Fig. 9A method 900 for block-based decoding of an encoded picture signal using transform decoding is shown, comprising: selecting a selected transform mode, such as an identity transform or a non-identity transform, for a predetermined block (e.g., a residual block in a region of adjacent residual blocks in a decoded residual picture signal or residual video signal). An identity transform may be understood as a transform skip, while a non-identity transform may be an inverse / inverse transform of a transform applied by an encoder or used by an encoding method. In addition, the method 900 comprises entropy decoding 920 a block to be dequantized in a data stream that is associated with the predetermined block according to the selected transform mode (e.g., the predetermined block before undergoing the selected transform mode). In addition, the method 900 comprises dequantizing 930 the block to be dequantized using a quantization precision that depends on the selected transform mode to obtain a dequantized block. The quantization precision may define the precision of the dequantization 930 of the block to be dequantized. The quantization precision is defined, for example, by a quantization parameter (QP), a scaling factor, and / or a quantization step size. Dequantization 930 is performed, for example, by multiplying the values ​​of the block by a quantization parameter (QP), a scaling factor, and / or a quantization step size to receive a dequantized block.

[0132] Alternative implementation plans:

[0133] Although some aspects have been described in the context of an apparatus, it will be clear that these aspects also represent a description of a corresponding method, wherein a block or device corresponds to a method step or a feature of a method step. Similarly, aspects described in the context of a method step also represent a description of a feature of a corresponding block or item or a corresponding apparatus. Some or all of the method steps may be performed by (or using) a hardware device (such as a microprocessor, a programmable computer, or an electronic circuit). In some embodiments, one or more of the most important method steps may be performed by such a device.

[0134] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or in software. Implementation may be performed using a digital storage medium (e.g., a floppy disk, DVD, Blu-ray, CD, ROM, PROM, EPROM, EEPROM, or flash memory) having stored thereon electronically readable control signals that cooperate (or are capable of cooperating) with a programmable computer system to perform the corresponding method. Thus, the digital storage medium may be computer readable.

[0135] Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.

[0136] Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer.The program code may, for example, be stored on a machine readable carrier.

[0137] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

[0138] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0139] A further embodiment of the inventive method is therefore a data carrier (or a digital storage medium or a computer-readable medium) on which is recorded the computer program for performing one of the methods described herein. The data carrier, the digital storage medium or the recorded medium is typically tangible and / or non-transitory.

[0140] Therefore, another embodiment of the inventive method is a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may, for example, be configured to be transmitted via a data communication connection (eg, via the Internet).

[0141] A further embodiment comprises a processing means, for example a computer or a programmable logic device, configured to or adapted to perform one of the methods described herein.

[0142] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

[0143] Another embodiment according to the invention comprises an apparatus or system configured to transmit a computer program to a receiver (e.g. electronically or optically), the computer program being used to perform one of the methods described herein. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may, for example, comprise a file server for transmitting the computer program to the receiver.

[0144] In some embodiments, a programmable logic device (e.g., a field programmable gate array) can be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array can collaborate with a microprocessor to perform one of the methods described herein. Typically, the method is preferably performed by any hardware device.

[0145] The devices described herein may be implemented using hardware devices, or using computers, or using a combination of hardware devices and computers.

[0146] The apparatus described herein or any component of an apparatus described herein may be implemented at least partially in hardware and / or software.

[0147] The methods described herein may be performed using a hardware device, or using a computer, or using a combination of a hardware device and a computer.

[0148] Any component of a method described herein or an apparatus described herein may be performed at least in part by hardware and / or by software.

[0149] The above embodiments are merely illustrative of the principles of the present invention. It should be understood that modifications and variations of the arrangements and details described herein will be apparent to other persons skilled in the art. Therefore, it is intended that the scope of the present invention be limited only by the scope of the appended patent claims and not by the specific details given by way of the description and explanation of the embodiments herein.

Claims

1. A method for block-based encoding of a picture using transform coding, the method comprising: Selecting a transform from a plurality of transforms for a current block, the plurality of transforms comprising an identity transform and a non-identity transform; transforming the current block using the transform to obtain a transformed block; quantizing the transformed block using a quantization parameter depending on whether the transform is an identity transform or a non-identity transform to obtain a quantized block, wherein when the transform is an identity transform, the method comprises: determining an initial quantization parameter, and determining whether the initial quantization parameter is less than a predetermined threshold, and when the initial quantization parameter is less than the predetermined threshold, setting the quantization parameter to the predetermined threshold; and The quantized block is entropy encoded into a data stream.

2. The method according to claim 1, further comprising: When the initial quantization parameter is not less than the predetermined threshold, the initial quantization parameter is used as the quantization parameter.

3. The method according to claim 1, further comprising: The transformation is signaled in the data stream.

4. The method according to claim 1, wherein: The predetermined threshold corresponds to a scaling factor of 1.

5. An apparatus for performing block-based encoding of a picture using transform coding, the apparatus being configured to: Selecting a transform from a plurality of transforms for a current block, the plurality of transforms comprising an identity transform and a non-identity transform; transforming the current block using the transform to obtain a transformed block; The transformed block is quantized using a quantization parameter depending on whether the transform is an identity transform or a non-identity transform to obtain a quantized block, wherein When the transform is an identity transform, the apparatus is configured to: determine an initial quantization parameter, and determine whether the initial quantization parameter is less than a predetermined threshold, and when the initial quantization parameter is less than the predetermined threshold, set the quantization parameter to the predetermined threshold; as well as The quantized block is entropy encoded into a data stream. 6 . The apparatus according to claim 5 , further configured to: when the initial quantization parameter is not less than the predetermined threshold, use the initial quantization parameter as the quantization parameter.

7. The apparatus of claim 5, further configured to signal the transformation in the data stream.

8. The device according to claim 5, wherein: The predetermined threshold corresponds to a scaling factor of 1.

9. A method for block-based decoding of a coded picture signal using transform decoding, the method comprising: Entropy decodes the current block from the data stream; Determine a transform corresponding to the current block from among a plurality of transforms, the plurality of transforms comprising an identity transform and a non-identity transform; as well as Dequantizing the current block using a quantization parameter depending on whether the transform is an identity transform or a non-identity transform to obtain a dequantized block, wherein when the transform is an identity transform, the method includes: determining an initial quantization parameter for the current block, and determining whether the initial quantization parameter is less than a predetermined threshold, and when the initial quantization parameter is less than the predetermined threshold, setting the quantization parameter to the predetermined threshold.

10. The method according to claim 9, further comprising: When the initial quantization parameter is not less than the predetermined threshold, the initial quantization parameter is used as the quantization parameter.

11. The method according to claim 9, wherein: The transformation is determined by decoding an indication from the data stream.

12. The method according to claim 9, wherein: The predetermined threshold corresponds to a scaling factor of 1.

13. An apparatus for performing block-based decoding of a picture using transform decoding, the apparatus being configured to: Entropy decodes the current block from the data stream; determining a transform corresponding to the current block from among a plurality of transforms, the plurality of transforms comprising an identity transform and a non-identity transform; and Dequantizing the current block using a quantization parameter depending on whether the transform is an identity transform or a non-identity transform to obtain a dequantized block, wherein, When the transform is an identity transform, the device is configured to: determine an initial quantization parameter for the current block, determine whether the initial quantization parameter is less than a predetermined threshold, and when the initial quantization parameter is less than the predetermined threshold, set the quantization parameter to the predetermined threshold. 14 . The apparatus according to claim 13 , further configured to: when the initial quantization parameter is not less than the predetermined threshold, use the initial quantization parameter as the quantization parameter.

15. The device according to claim 13, wherein: The transformation is determined by decoding an indication from the data stream.

16. The device according to claim 13, wherein: The predetermined threshold corresponds to a scaling factor of 1.