Encoding / decoding video picture data

By applying a combined conversion mode of flip and rotation operations at the picture area level of the video picture, the problem of insufficient encoding and decoding flexibility caused by the variability of video content in the prior art is solved, and efficient video compression and decoding are achieved.

CN119013974AActive Publication Date: 2024-11-22BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202280093326.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-03-28
Filing Date
2022-10-06
Publication Date
2024-11-22
Estimated Expiration
2042-10-06

AI Technical Summary

Technical Problem

When existing video encoding and decoding technologies deal with video content variability, it is difficult to achieve high compression efficiency and low complexity, especially when adapting to different video content features, resulting in insufficient encoding and decoding flexibility, affecting compression efficiency and Delay.

Method used

By applying a combined conversion mode of flip and rotation operations at the image area level of the video picture, reorganizing the bitstream of encoded video picture data, selecting suitable conversion modes for greater flexibility and adaptability, leveraging flip and rotation Operations provide new conversion modes to enhance compression coding efficiency.

Benefits of technology

It improves the flexibility and efficiency of video encoding and decoding, adapts to different video content features, improves the compression encoding gain, reduces the encoding and decoding complexity, and achieves higher compression efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119013974A_ABST
    Figure CN119013974A_ABST
Patent Text Reader

Abstract

The present application relates to encoding / decoding a video picture (PCT1) into / from a bitstream of encoded video picture data (BT1), the video picture comprising at least a picture region. A method for encoding a video picture (PCT1) comprises converting (402) at least one picture region of the video picture (PCT1) into a converted picture region based on a conversion mode (MDS); and encoding (404) the at least one converted picture region into a bitstream (BT1) of encoded video picture data. The conversion mode (MDS) defines a combination of at least one flipping operation and at least one rotation operation on at least one picture region. A method for decoding comprises the steps of decoding (408) and de-converting (410) to obtain a video picture (PCT1).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application generally relates to video picture encoding and decoding. In particular, but not exclusively, the technical field of the present application relates to encoding a video picture into a bitstream of encoded video picture data, decoding such a bitstream into a decoded video picture, and corresponding encoding and decoding devices. Background Art

[0002] This section is intended to introduce the reader to various aspects of the art that may be relevant to various aspects of at least one exemplary embodiment of the present application described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to better understand various aspects of the present application. Therefore, it should be understood that these statements will be interpreted from this perspective and not as an admission of prior art.

[0003] The video compression standard Advanced Video Coding (AVC), also known as H.264 or MPEG-4 Part 10, Advanced Video Coding (MPEG-4 AVC), introduces Flexible Macroblock Ordering (FMO) and Arbitrary Slice Ordering (ASO). These techniques involve changing or prioritizing the order in which blocks or slices of a video picture are encoded into a bitstream of encoded video picture data. Since conventional video codecs use raster scanning to scan each block or slice in the video picture data, coding gains can be achieved. The above techniques allow the creation of causal regions (i.e., regions of content that have been encoded or decoded and are known to the current block to be encoded at the decoder) where reference samples used for prediction and other predictions have higher accuracy. FMO and ASO techniques increase the flexibility of video encoding and decoding design and allow greater adjustment of signal characteristics. However, the problem with the above techniques is the increased decoding complexity, which makes the implementation of video encoders and decoders more difficult and expensive.

[0004] Various solutions have been developed recently to address the decoding complexity caused by block reordering techniques. Essentially, these known solutions propose to change the picture to be encoded instead of the actual block order, so that, in effect, the blocks are scanned during encoding as if they were arranged in another order than the original block order of the video picture.

[0005] Patent document WO2008024345A1 relates to adaptive region-based flipping video coding, and more specifically discloses a method and apparatus for video encoding and decoding using region-based flipping. The encoding apparatus comprises a video encoder for encoding image regions of a picture into a resulting bitstream, wherein at least one image region is flipped before encoding. When decoding an image region from the bitstream, flipping is also performed on the image region.

[0006] Patent document US9549195B2 relates to an image decoding device and method thereof using inter-frame coding prediction coding, and more specifically discloses an encoding device including an image conversion module, which uses a left-right symmetric mode conversion or a top-bottom symmetric mode conversion to convert the direction of the image. A decoding method is also provided for decoding a signal of an intra-frame coded image, wherein, with reference to information sent together with the signal of the image, it is determined whether a partial area of ​​the image has been converted in a top-bottom symmetric conversion mode to vertically flip the partial area of ​​the image, or in a left-right symmetric conversion mode to horizontally flip the partial area. Then, after the intra-frame coding prediction, the coded image is decoded by performing a conversion associated with the determined conversion mode.

[0007] Patent document WO2012121744A1 relates to adaptive picture rotation, and more specifically discloses a method for decoding a picture embedded in an encoded video sequence using a reference picture, the method comprising receiving at least a portion of the encoded video sequence; decoding at least a portion of the encoded video sequence to determine a rotation of the embedded picture; rotating at least a portion of the reference picture according to the determined rotation; and using at least a portion of the rotated reference picture to construct a reconstructed picture corresponding to the embedded picture.

[0008] The above-mentioned state-of-the-art solutions are based on flipping or rotating pictures or picture regions, resulting in relatively low decoding complexity and can therefore solve the problem of decoding complexity caused by changing the block order scanning. However, these state-of-the-art solutions are not always satisfactory because people expect to achieve higher compression gains. These known techniques may also be computationally intensive on the encoding side because the conversion mode selection can be performed based on a rate-distortion algorithm, and all conversion modes are encoded before deciding on the conversion mode to be selected. This may lead to a significant increase in encoding time and therefore hinder the adoption of this technology in coding standards despite the simplicity of decoding. In the case of iterative splitting algorithms (WO2008024345A1), this computationally intensive problem may be even worse because multiple combinations to be tested are combined.

[0009] In particular, known encoding / decoding techniques do not always provide sufficient flexibility in the way video pictures are encoded / decoded, thus resulting in limited compression efficiency and delays. Video content may vary greatly from one video signal to another (picture features, structural orientation, etc.). This video content variability needs to be addressed to ensure compression efficiency and avoid delays. The problem of lack of encoding / decoding flexibility is particularly prominent when the encoded / decoded signal exhibits specific features that require adaptability in the way encoding / decoding is performed (e.g., video games, screen content, vertical video, etc.).

[0010] Therefore, there is a need for coding and decoding techniques that ensure coding and decoding efficiency and low complexity. In particular, there is a need for compression efficiency and coding / decoding flexibility and adaptability.

[0011] In view of the above circumstances, at least one exemplary embodiment of the present application is designed. Summary of the invention

[0012] The following section provides a simplified summary of at least one embodiment in order to provide a basic understanding of some aspects of the present application. This summary is not an extensive overview of the embodiments. It is not intended to identify the key or important elements of the embodiments. The following summary only presents some aspects of at least one exemplary embodiment in a simplified form as a preface to the more detailed description provided elsewhere in this document.

[0013] According to a first aspect of the present application, a method for encoding a video picture including at least one picture region is provided, the method comprising:

[0014] - selecting a conversion mode defining a combination of at least one flipping operation and at least one rotation operation on said at least one picture region;

[0015] - based on the selected conversion mode, converting the at least one picture region into at least one converted picture region; and

[0016] - encoding at least one converted picture region into a bitstream of coded video picture data.

[0017] Therefore, the present application allows the order of samples of each picture within the bitstream of the encoded video picture data to be reorganized during the encoding stage. The original order of samples in the picture area can be modified or adjusted, thereby allowing greater flexibility and efficiency during encoding. More specifically, by utilizing a combination of at least one flip operation and at least one rotation operation at the picture area level, greater flexibility and adaptability can be achieved in the process of encoding and decoding video pictures. As previously described, the competition between various conversion modes can provide compression coding gains by considering a wider representation of content diversity so that the main direction of the content is aligned with the codec preferred direction. As further described below, by applying flipping and rotation, it is possible to bring about new conversion modes that would otherwise not exist. These new hybrid conversion modes may be particularly applicable in some cases, especially for the efficient encoding / decoding of specific video content, such as gaming content or vertical videos that are becoming mainstream.

[0018] In an exemplary embodiment, a conversion mode is selected from a list of candidate conversion modes obtained by:

[0019] - obtaining at least a partially converted picture region by converting the at least one picture region using the candidate conversion mode; and

[0020] - When a distance between a main direction determined from at least part of the converted picture region and a target direction of at least one picture region meets (or satisfies) a threshold (eg, is higher than or lower than a threshold), adding the candidate conversion mode to the candidate conversion mode list.

[0021] In an exemplary embodiment, a transition mode is selected from a list of candidate transition modes by minimizing a rate-distortion tradeoff.

[0022] In an exemplary embodiment, if a main direction determined from at least a portion of the converted picture region is vertical and / or horizontal, the conversion mode is selected by aligning the main direction with a boundary of a coding unit (CU).

[0023] In an exemplary embodiment, the method further includes signaling, into a bitstream of the encoded video picture data, region conversion information indicating that at least one picture region of the video picture is converted according to the conversion mode.

[0024] In an exemplary embodiment, the region conversion information further defines the conversion mode selected for converting at least one picture region of the video picture.

[0025] According to a second aspect of the present application, a method for decoding a video picture from a bit stream of encoded video picture data is provided, wherein the method comprises:

[0026] - obtaining a decoded video picture by decoding the encoded video picture data from a bit stream of the encoded video picture data; and

[0027] - obtaining a video picture by deconverting at least one picture region of the decoded video picture according to a conversion pattern, wherein the conversion pattern defines a combination of at least one flipping operation and at least one rotation operation on said picture region.

[0028] In an exemplary embodiment, the method further comprises:

[0029] - parsing region conversion information in the bitstream of encoded video picture data; and

[0030] - Based on the region conversion information, determine a conversion mode, and deconvert at least one image region according to the conversion mode.

[0031] In an exemplary embodiment, the at least one rotation operation is a rotation of 90°, 180° or 270°. Therefore, in the case of a 90° or 270° rotation, the width and height of the picture are swapped.

[0032] According to a third aspect of the present application, there is provided a bitstream formatted to include encoded video picture data and component conversion information obtained from one of the methods according to the first aspect of the present application.

[0033] According to a fourth aspect of the present application, a device for encoding a video picture into a bit stream of encoded video picture data is provided. The device includes a component for executing the method according to the first aspect of the present application.

[0034] According to a fifth aspect of the present application, a device for decoding a video picture from a bit stream of encoded video picture data is provided, the device comprising a component for executing the method according to the second aspect of the present application.

[0035] According to a sixth aspect of the present application, a computer program product is provided, which includes instructions. When the program is executed by one or more processors, the instructions cause the one or more processors to perform the method according to the first aspect of the present application.

[0036] According to a seventh aspect of the present application, a non-volatile storage medium is provided, which carries instructions of a program code for executing the method according to the first aspect of the present application.

[0037] According to an eighth aspect of the present application, a computer program product is provided, which includes instructions. When the program is executed by one or more processors, the instructions cause the one or more processors to perform the method according to the second aspect of the present application.

[0038] According to a ninth aspect of the present application, a non-volatile storage medium is provided, which carries instructions of a program code for executing the method according to the second aspect of the present application.

[0039] The specific nature of at least one of the exemplary embodiments and other objects, advantages, features and uses of at least one of the exemplary embodiments will become apparent from the following description of the examples taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Reference will now be made by way of example to the accompanying drawings, which show exemplary embodiments of the present application, in which:

[0041] Figure 1 A schematic block diagram showing the steps of a method 100 for encoding a video picture VP according to the prior art;

[0042] Figure 2 A schematic block diagram showing the steps of a method 200 for decoding a video picture VP according to the prior art;

[0043] Figure 3Various conversion modes according to at least one specific exemplary embodiment of the present application are shown;

[0044] Figure 4 The encoding method and the decoding method according to certain exemplary embodiments of the present application are shown;

[0045] Figure 5A and 5B An encoding method according to a specific exemplary embodiment of the present application is shown;

[0046] Figure 6 An encoding method according to at least one specific exemplary embodiment of the present application is shown;

[0047] Figure 7 shows scanning of blocks of at least one picture component according to certain exemplary embodiments of the present application;

[0048] Figure 8 shows the main directions in the components of a video picture according to a certain exemplary embodiment of the present application;

[0049] Fig. 9 shows the main directions in the components of a video picture according to a certain exemplary embodiment of the present application;

[0050] Fig.10 An encoding method according to at least one specific exemplary embodiment of the present application is shown;

[0051] Fig.11 An encoding method according to at least one specific exemplary embodiment of the present application is shown;

[0052] Fig.12 An encoding method according to at least one specific exemplary embodiment of the present application is shown;

[0053] Fig.13A and 13B An encoding method according to a specific exemplary embodiment of the present application is shown;

[0054] Fig.14 A decoding method according to a specific exemplary embodiment of the present application is shown;

[0055] Fig.15 A decoding method according to a specific exemplary embodiment of the present application is shown; and

[0056] Fig.16 A schematic block diagram of an example of a system in which various aspects and exemplary embodiments are implemented is shown.

[0057] Similar or identical elements are denoted by the same reference numerals. DETAILED DESCRIPTION

[0058] At least one of the embodiments is described more fully below with reference to the accompanying drawings, wherein an example of at least one of the embodiments is illustrated. However, the embodiments may be embodied in many alternative forms and should not be construed as being limited to the examples described herein. Therefore, it should be understood that there is no intention to limit the exemplary embodiments to the specific forms disclosed. On the contrary, the present application is intended to cover all modifications, equivalents, and alternatives that fall within the spirit and scope of the present application.

[0059] At least one aspect generally relates to video picture encoding and decoding, another aspect generally relates to transmitting provided or encoded bitstreams, and another aspect generally relates to receiving / accessing decoded bitstreams.

[0060] At least one of the exemplary embodiments is described for encoding / decoding one video picture, but is extended to encoding / decoding of multiple video pictures (picture sequences) because each video picture is sequentially encoded / decoded as described below.

[0061] In addition, at least one exemplary embodiment is not limited to MPEG standards, such as AVC (ISO / IEC 14496-10 Advanced Video Coding for generic audio-visual services, ITU-T Recommendation H.264, https: / / www.itu.int / rec / T-REC-H.264-202108-P / en), EVC (ISO / IEC 23094-1 Essential video coding), HEVC (ISO / IEC 23008-2 High Efficiency Video Coding, ITU-T Recommendation H.265, https: / / www.itu.int / rec / T-REC-H.265-202108-P / en), VVC (ISO / IEC 23090-3 Versatile Video Coding, ITU-T Recommendation H.266, https: / / www.itu.int / rec / T-REC-H.266-202008-I / en but may also be applied to other standards and recommendations, such as AV1 (AO Media Video 1, http: / / aomedia.org / av1 / specification / ). At least one exemplary embodiment may be applicable to any such standards and recommendations that are pre-existing or developed in the future, as well as extensions of any such standards and recommendations. Unless otherwise specified or technically excluded, the aspects described in this application may be used alone or in combination.

[0062] A pixel corresponds to the smallest display unit on the screen, which can be composed of one or more light sources (a monochrome screen has 1 light source, a color screen has 3 or more light sources).

[0063] A video picture, also denoted as frame or picture frame, comprises at least one component (also referred to as picture component, or channel) determined by a specific picture / video format, which specifies all information related to pixel values ​​and all information that can be used by a display unit and / or any other device to display and / or decode video picture data related to the video picture.

[0064] A video picture comprises at least one component, typically represented in the shape of an array of samples.

[0065] A monochrome video picture includes a single component, and a color video picture may include three components.

[0066] For example, a color video picture may include a luma or luminance component and two chroma components when the picture / video format is the well-known (Y, Cb, Cr) format, or a color video picture may include three color components (one for red, one for green, and one for blue) when the picture / video format is the well-known (R, G, B) format.

[0067] Each component of a video picture may include a plurality of samples relative to a plurality of pixels of a screen on which the video picture is to be displayed. For example, the number of samples included in a component may be the same as the number of pixels of a screen on which the video picture is to be displayed, or a multiple (or fraction) thereof.

[0068] The number of samples included in one component may also be a multiple (or fraction) of the number of samples included in another component of the same video picture.

[0069] For example, in case the video format comprises a luma component and two chroma components, such as the (Y, Cb, Cr) format, the chroma components may contain half the number of samples in width and / or height relative to the luma components, depending on the color format considered.

[0070] A sample is the smallest visual information unit that constitutes a component of a video picture. For example, a sample value may be a brightness value or a chrominance value or a color value in (R, G, B) format.

[0071] The pixel value is the value of a pixel of the screen. For a monochrome video picture, the pixel value can be represented by one sample, and for a color video picture, the pixel value can be represented by multiple co-located samples. The co-located sample associated with a pixel refers to a sample corresponding to the position of the pixel in the screen.

[0072] A video picture is usually considered as a set of pixel values, with each pixel represented by at least one sample.

[0073] A block of a video picture is a group of samples of a component of a video picture. When the picture / video format is the well-known (Y, Cb, Cr) format, a block of at least one luma sample or a block of at least one chroma sample may be considered, or when the picture / video format is the well-known (R, G, B) format, a block of at least one color sample may be considered.

[0074] At least one exemplary embodiment is not limited to a specific picture / video format.

[0075] In general, the present application relates to encoding a video picture into a bitstream of encoded video picture data and to decoding such an encoded video picture bitstream. In particular, the present application relates to transforming a picture region of a video picture as part of preprocessing prior to encoding, so that a combination of at least one flip operation and at least one rotation operation is applied to the picture region. In other words, the concept of the present application is to apply a transformation involving flipping and rotation at the picture region level (i.e., on the entire video picture or its picture region) before encoding into the bitstream of encoded video picture data. Such a bitstream can then be decoded by applying a de-transformation (or non-transformation) at the picture region level, i.e., by applying a transformation opposite to the transformation previously performed in the encoding stage, so as to reconstruct the video picture.

[0076] The conversion of picture areas according to the invention can be performed as part of preprocessing before encoding a video picture, for example before (and therefore outside) the encoding loop. Alternatively, or cumulatively, the conversion can be performed as a pre-stage within the encoding loop.

[0077] As will be apparent from the embodiments further described below, the candidate transformations may be applied during the first (fast) pass of the encoding loop. The first pass may be one in which most encoding tools (e.g., template-based tools such as ITMP, TIMD ... and in-loop filters such as deblocking, ALF, SAO ...) are disabled and partitioning is restricted (in depth splitting and partitioning mode) to quickly select the best candidate transformation mode. The actual encoding using the selected transformation mode may then be performed in the second pass of the encoding loop.

[0078] As further described below, the present invention provides greater flexibility and adaptability in the process of encoding and decoding video pictures by allowing the selection of a conversion mode defining a combination of at least one flip operation and at least one rotation operation (hybrid).

[0079] Other aspects and advantages of the present application will be described below in specific exemplary embodiments with reference to the accompanying drawings.

[0080] Figure 1 and Figure 2 An overview of video encoding / decoding methods used in current video standard compression systems such as VVC is provided.

[0081] Figure 1 A schematic block diagram showing the steps of a method 100 for encoding a video picture VP according to the prior art.

[0082] In step 110, the video picture VP is partitioned into blocks of samples and partition information data is signaled into the bitstream. Each block comprises samples of one component of the video picture VP. Thus, the blocks comprise samples of each component defining the video picture VP.

[0083] For example, in HEVC, a picture is divided into coding tree units (CTUs). Each CTU can be further subdivided using quadtree partitioning, where each leaf of the quadtree is represented as a coding unit (CU). The partition information data may then include data defining the quadtree subdivision of the CTU and each CTU.

[0084] Each block of samples (CU) (block for short) is then encoded within a coding loop using an intra or inter prediction coding mode. In the following, the qualification "in the loop" may also be assigned to steps, functions, etc. implemented within a loop (i.e., an encoding loop in the encoding phase or a decoding loop in the decoding phase).

[0085] Intra prediction (step 120) consists in predicting the current block by a prediction block based on already coded, decoded and reconstructed samples located around the current block in the picture, usually on the top and to the left of the current block. Intra prediction is performed in the spatial domain.

[0086] In inter-frame prediction mode, motion estimation (step 130) and motion compensation (135) are performed. Motion estimation searches for candidate reference blocks that are good predictors of the current block in one or more reference video pictures used for predictive encoding of the current video picture. For example, a good predictor of the current block is a predictor that is similar to the current block. The output of the motion estimation step 130 is one or more motion vectors and (one or more) reference picture indices associated with the current block. Next, motion compensation (step 135) obtains a predicted block by the (one or more) motion vectors and (one or more) reference picture indices determined by the motion estimation step 130. Basically, the block belonging to the selected reference picture and pointed to by the motion vector can be used as the prediction block of the current block. In addition, since the motion vector is represented as a fraction of an integer pixel position (called a sub-pixel precision motion vector representation), motion compensation usually involves spatial interpolation of some reconstructed samples of the reference picture to calculate the predicted block samples. The prediction information data is signaled into the bitstream. The prediction information may include a prediction mode, a prediction information coding mode, an intra prediction mode or (one or more) motion vectors and (one or more) reference picture indexes and any other information for obtaining the same prediction block at the decoding side.

[0087] The method 100 selects one of the intra or inter coding modes by optimizing the rate-distortion tradeoff taking into account the encoding of a prediction residual block, for example calculated by subtracting a candidate prediction block from a current block, and the signaling of prediction information data required to determine the candidate prediction block at the decoding side.

[0088] Typically, the best prediction mode is given as the best coding mode p for the current block. * The prediction model is given by:

[0089] p * =Argmin p∈P {RD cost (p)} (1)

[0090] Where P is the set of all candidate coding modes for the current block, p represents the candidate coding mode in the set, and RD cost (p) is the rate-distortion cost of candidate coding mode p, usually expressed as:

[0091] RD cost(p) =D(p)+λ.R(p).

[0092] D(p) is the distortion between the current block and the reconstructed block obtained after encoding / decoding the current block with candidate coding mode p, R(p) is the rate cost associated with encoding the current block with coding mode p, and λ is a Lagrangian parameter representing the rate constraint for encoding the current block, typically calculated from the quantization parameter used to encode the current block.

[0093] The current block is usually encoded from a prediction residual block PR. More precisely, the prediction residual block PR is calculated, for example, by subtracting the best prediction block from the current block. The prediction residual block PR is then transformed (step 140) using a DCT (Discrete Cosine Transform) or DST (Discrete Sine Transform) type transform or any other suitable transform, and the resulting transform coefficient block is quantized (step 150).

[0094] In a variant, the method 100 may also skip the transform step 140 and directly apply quantization (step 150) to the prediction residual block PR according to a so-called transform-skip coding mode.

[0095] The block of quantized transform coefficients (or the block of quantized prediction residuals) is entropy encoded into a bitstream (step 160).

[0096] Next, the block of quantized transform coefficients (or quantized residual block) is dequantized (step 170) and inverse transformed (180) (or not) as part of the encoding cycle, thereby obtaining a decoded prediction residual block. The decoded prediction residual block is then combined with the prediction block, usually summed, which will provide a reconstructed block.

[0097] In step 160 , other information data may also be entropy encoded to encode the current block of the video picture VP.

[0098] An in-loop filter (step 190) may be applied to the reconstructed picture (including the reconstructed blocks) to reduce compression artifacts. The loop filter may be applied after all picture blocks are reconstructed. For example, they include a deblocking filter, a sample adaptive offset (SAO), or an adaptive in-loop filter.

[0099] The reconstructed block or the filtered reconstructed block forms a reference picture which may be stored in a decoded picture buffer (DPB) so that it may be used as a reference picture for encoding the next current block of the video picture VP or the next video picture to be encoded.

[0100] Figure 2 A schematic block diagram showing steps of a method 200 for decoding a video picture VP according to the prior art is shown.

[0101] In step 210 , partition information data, prediction information data and quantized transform coefficient blocks (or quantized residual blocks) are obtained by entropy decoding the bit stream of the encoded video picture data. For example, the bit stream is generated according to method 100 .

[0102] Other information data may also be entropy decoded from the bitstream for decoding the current block of the video picture VP.

[0103] In step 220, the reconstructed picture is divided into current blocks based on the partition information. Each current block is entropy decoded from the bitstream within a decoding loop. Each decoded current block is a quantized transform coefficient block or a quantized prediction residual block.

[0104] In step 230, the current block is dequantized and possibly inversely transformed (step 240) to obtain a decoded prediction residual block.

[0105] On the other hand, the prediction information data is used to predict the current block. The prediction block is obtained by its intra prediction (step 250) or its motion compensated temporal prediction (step 260). The prediction process performed on the decoding side is the same as the prediction process on the encoding side.

[0106] Next, the decoded prediction residual block and the prediction block are combined, typically summed, to provide a reconstructed block.

[0107] In step 270, the in-loop filter may be applied to the reconstructed picture (including the reconstructed block), and the reconstructed block or the filtered reconstructed block forms a reference picture, which may be stored in a decoded picture buffer (DPB) as described above ( Figure 1 ).

[0108] Now refer to Figure 3-16 Describe specific exemplary embodiments of the present application, referring to the steps of the features described above where applicable ( Figure 1-2 ). However, it should be noted that the present application is not limited to Figure 1 and Figure 2 The present invention relates to specific encoding and decoding examples of the present invention and can be applied to other encoding and decoding exemplary embodiments.

[0109] The present application provides a coding and decoding method for encoding and decoding a video picture. In the following exemplary embodiments, the coding and decoding of a video picture are described. However, it should be understood that the present application can be applied to multiple video pictures, such as video pictures of a video data stream.

[0110] In the following exemplary embodiments, it is considered that the video pictures being encoded and decoded are defined by picture components. However, it should be understood that the nature and number of components contained in the video pictures under consideration may vary from case to case (for example, depending on the picture / video format of the specified video picture), and the present application is more generally applied to video pictures comprising at least one component. In the exemplary embodiments described below, the video pictures being processed are color video pictures. In a first example, the picture components correspond to a luminance (or brightness) component and two chrominance (or chrominance) components (for example, in a well-known format (Y, Cb, Cr)). In a second example, the picture components correspond to three color components, such as red, green and blue. In a variant, the video picture at hand is a monochrome video picture comprising a single picture component.

[0111] As mentioned above, the encoding and decoding methods of the present application are respectively related to converting and deconverting (or non-converting) the picture area of ​​the video picture (2D video picture) by applying at least one of a flip operation and / or a rotation operation to the picture area. In this way, each picture area of ​​the video picture can be independently converted and deconverted according to the respective conversion mode. Converting the picture area means applying a flip operation or a rotation operation, or both, to the picture area. Similarly, deconverting the picture area means applying an inverse conversion to the picture area so as to convert the picture area back to the original state before the conversion. Therefore, deconversion is performed by performing flip and / or rotation operations, which are opposite to the operations performed in the conversion stage. For example, if the picture area is converted by applying a horizontal flip operation to the picture area, the converted picture component can be deconverted by applying a horizontal flip operation to the converted picture component again. In another example, the component converted by a clockwise 90° rotation can be deconverted by applying a counterclockwise 90° rotation to it.

[0112] As further described below, conversion and deconversion of a picture region of a video picture can be performed according to a conversion mode to implement encoding and decoding, respectively, the conversion mode defining a combination of at least one flip operation and at least one rotation operation. In other words, converting a picture region can be implemented by applying one or more flip operations and one or more rotation operations to the picture region at hand in any order. Similarly, deconversion can be implemented by applying an inverse conversion to the picture region so as to convert the picture region back to its original state before conversion. Therefore, deconversion is performed by performing a conversion, i.e., combining flip and rotation operations, which is opposite to the conversion performed in the conversion stage. For example, if a picture region is converted by applying a horizontal flip operation to the picture region and then rotating it 90° clockwise, the converted picture region can be deconverted by applying a 90° counterclockwise rotation to the converted picture region and then performing a horizontal flip operation.

[0113] In this document, applying a flip operation and / or a rotation operation to a picture region means that each picture component of the picture region is subjected to the operation. Similarly, conversion or deconversion of a picture region means applying the same flip and / or rotation operation to each picture component of the picture region. For example, if a combination of at least one flip operation and at least one rotation operation is applied to a picture region, each picture component thereof is subjected to the combination.

[0114] Various flipping and rotation operations may be considered to transform and de-transform picture regions of video pictures. Figure 3 Exemplary transformation modes MD0-MD6 (collectively MD) are shown, according to which picture regions (more specifically, their components) may be transformed. Each transformation mode MD defines at least one of a flipping operation and / or a rotation operation to be applied to a picture region. In other words, a transformation mode MD either involves only a flipping operation (i.e., one or more), only a rotation operation (i.e., one or more), or a combination of a flipping operation and a rotation operation. Thus, a transformation means a flip, a rotation, or a combination of both. The order in which the multiple flipping and / or rotation operations of a transformation are applied may have a direct impact on the transformation result at hand (particularly when the transformation involves a combination of flipping and rotation).

[0115] More specifically, Figure 3 A validation function ID1 is shown, according to which the original picture video 301 remains unchanged. Thus, applying the validation function ID1 to a specific picture region results in an identical picture region, which may be appropriate in certain circumstances.

[0116] Furthermore, the first conversion mode MD0 corresponds to a horizontal flip applied to the video picture, so as to obtain, in this case, for example, the video picture 302. The second conversion mode MD1 corresponds to a 90° clockwise rotation of the video picture, so as to obtain, in this case, for example, the video picture 304. The third conversion mode MD2 corresponds to a 90° counterclockwise rotation of the video picture, so as to obtain, in this case, for example, the video picture 306. The fourth conversion mode MD3 corresponds to a vertical flip (i.e., horizontal symmetry) of the video picture, so as to obtain, in this case, for example, the video picture 308. The fifth conversion mode MD4 corresponds to a horizontal flip (i.e., vertical symmetry) applied to the video picture, followed by a vertical flip, so as to obtain, in this case, for example, the video picture 310. The sixth conversion mode MD5 corresponds to a vertical flip and a 90° clockwise rotation applied to the video picture, so as to obtain, in this case, for example, the video picture 312. The seventh conversion mode MD6 corresponds to a vertical flip applied to the video picture, followed by a 90° counterclockwise rotation, so as to obtain, in this case, for example, the video picture 314. In this particular example, any other combination of the above conversions is a repetition (or equivalent) of these conversions. Therefore, the picture area of ​​the original video picture 301 can be converted by applying any one of the conversion modes MD0-MD6.

[0117] It can be seen that, for example, the conversion mode MD1 is opposite to the conversion mode MD4.

[0118] However, the above examples of conversion modes MD are not limiting and other variants can be considered. The nature and number of conversion modes implemented in the present application can be adjusted according to the specific situation.

[0119] For example, using a syntax where "H" represents horizontal flip, "R" represents 90° (clockwise) rotation, and "+" represents the next / subsequent operation in the operation combination, the above conversion modes MD0-MD6 can be defined as follows:

[0120] Conversion mode MD0=H,

[0121] Conversion mode MD1 = R,

[0122] Conversion mode MD2 = R+R+R (or H+R+H),

[0123] Conversion mode MD3=H+R+R,

[0124] Conversion mode MD4=R+R,

[0125] Conversion mode MD5 = R + H, and

[0126] Conversion mode MD6 = H + R

[0127] It can be seen that it is not possible to realize all of the above conversion modes MD0-MD6 by applying only one or more rotation operations or only one or more flipping operations.

[0128] In fact, if only rotation is used, only the following transformation modes MD can be implemented:

[0129] MD1=R,

[0130] MD2=R+R+R (or 270° rotation)

[0131] MD4=R+R (or 180° rotation)

[0132] When only rotation of the picture region is considered, only the transformation modes MD1 (rotation 90°), MD2 (rotation 270°) and MD4 (rotation 180°) can be implemented. It is worth noting that the combination of rotation 180° with horizontal and vertical flipping provides the same result, except that it is less expensive in terms of processing and also avoids the need for a temporary buffer.

[0133] Furthermore, if only flipping is used, only the following transformation modes MD can be implemented:

[0134] MD0=H

[0135] MD3=V

[0136] MD4=H+V

[0137] When only flipping of picture regions is considered, there are only transformation modes MD0 (horizontal flip), MD3 (vertical flip) and possibly MD4 (horizontal and vertical flip). It is worth noting that the combination of 180° rotation provides the same result as the combination of horizontal and vertical flips, except that it is less expensive in terms of processing and also avoids the need for a temporary buffer.

[0138] By applying a combination of at least one flip operation and at least one rotation operation, the following transformation patterns can thus be achieved:

[0139] MD5=R+H

[0140] MD6=H+R

[0141] Advantageously, the combination of flip and rotation brings about two specific transformation modes, also called "hybrid" transformation modes, which would not be possible without the synergy of rotation and flip, namely: transformation modes MD5 (vertical flip plus 90° rotation, or similar horizontal flip plus 270° rotation) and MD6 (vertical flip plus 270° rotation, or similar horizontal flip plus 90° rotation). These additional transformation modes bring about a diversity of predictor candidates, allowing, for example, efficient processing of specific video content, such as gaming content or vertical videos that are becoming mainstream.

[0142] Therefore, the present invention provides greater flexibility and adaptability in the process of encoding and decoding video pictures by allowing the selection of a conversion mode (hybrid type) that defines a combination of at least one flip operation and at least one rotation operation. In this exemplary embodiment, MD5 and MD6 are two hybrid conversion modes involving flipping and rotation that can be selected and applied in the encoding and decoding stages.

[0143] For example, consider an implementor (such as an embedded device) with enough processing power and memory to implement only horizontal flips and 90° rotations. This would allow the application of transformation patterns MD0 and MD1 as well as transformation patterns MD5 and MD6 (by combining flips and rotations). Assuming that enough power is available, a 90° rotation can be used multiple times in succession to produce a 180° or 270° rotation. In this way, all possible transformation patterns MD0-MD6 can be generated by combining only one rotation and one flip implemented as basic patterns (horizontal flip and 90° rotation).

[0144] In another example, given an implementer on a system with sufficient memory but low processing power or latency constraints, it may be preferable to implement multiple transformation modes that minimize the number of operations. For example, implementing a 180° rotation can save one processing operation for transformation mode MD4 compared to a combination of horizontal flip and vertical flip. Similarly, transformation modes MD5 and MD6 can be implemented directly as one operation, saving processing cost.

[0145] The above examples show that competition between various transformation modes MD can provide compression coding gains by considering a wider representation of content diversity, thereby aligning the content main direction with the codec preferred direction. In particular, significant compression coding gains can be achieved by using a set of transformation modes MD, the set of transformation modes including at least one hybrid transformation mode defining a combination of at least one flip operation and at least one rotation operation. As described above, this combination brings flexibility and higher efficiency to the encoding and decoding process of video pictures.

[0146] Therefore, the present invention allows encoding / decoding of the picture area of ​​2D video pictures with high efficiency. It should be noted that rotation in 2D video encoding is not a mainstream technology because 2D video codecs prefer horizontally dominant natural structures. This bias is due to the influence of the horizontal superposition effect of gravity on the structural layout (which is the same as the fundamental reason why the eyes of most animals may be arranged horizontally). The present application overcomes this bias by combining flipping and rotation into the same conversion mode, which can be applied to the picture area for encoding and decoding.

[0147] In the following examples, each rotation operation is considered to be a clockwise or counterclockwise rotation according to any of the following rotation angles: 90°, 180°, and 270° (multiples of 90°). However, other embodiments are also possible, in which rotations other than 90°, 180°, and 270° are performed for conversion and deconversion.

[0148] In the exemplary embodiments further described below, it is considered that the conversion modes MD0-MD6 together form a conversion mode set in which each picture region of a video picture can be selected for conversion and deconversion. However, other exemplary embodiments using any subset of conversion modes MD0-MD6 are also possible.

[0149] In a particular exemplary embodiment, the set of transformation modes MD from which the image region can be selected for transformation and de-transformation comprises at least one mixed transformation mode, i.e. at least one transformation mode MD (e.g. MD5 and / or MD6) defines a combination of at least a flip operation and at least one rotation operation. As an example, the set of transformation modes MD comprises MD0-MD6 as described above.

[0150] In a specific example, a selection may be made from a set of options including at least one mixed conversion mode and a validation function. For example, a selection may be made between identity function ID1 and conversion modes MD0-MD6.

[0151] It should be understood that when converting and deconverting a video picture in the present application, the conversion and deconversion can be applied to the entire video picture, or can be applied to one or more picture regions of the video picture respectively. Therefore, by applying the conversion and deconversion to the picture region at hand, each picture region of the video picture can be encoded and decoded in a similar manner.

[0152] As further described below, deconverting picture components during decoding means performing a transformation on the picture region that is the opposite of the transformation performed during encoding.Thus, deconversion may be performed according to an appropriate conversion mode in the conversion mode set MD0-MD6 or any subset thereof.

[0153] The present application proposes to transform at least one picture region of a video picture as a preprocessing before encoding, which means that the transformation is performed outside the encoding loop (see Figure 1 ). Similarly, at least one picture area of ​​the encoded video picture is deconverted as a preprocessing before decoding, i.e. outside the decoding loop (see Figure 2 ). Therefore, the encoding and decoding methods of the present application are codec agnostic. In the following exemplary embodiments, the codec used may be any one of VVC, HEVC, AV1, etc.

[0154] Figure 4 A schematic block diagram showing steps 402-404 of an encoding method 400 for encoding a video picture VP and steps 408-410 of a decoding method 406 for decoding a video picture from a bitstream of encoded video picture data according to a specific exemplary embodiment is shown. The figure represents the general concept of encoding and decoding of the present application, in particular exemplary embodiments.

[0155] like Figure 4 As shown, in the encoding method 400, a video picture PCT1 is obtained as an encoding input. As mentioned above, it is currently considered that the picture video PCT1 is a color video picture defined by three picture components.

[0156] In a conversion step 402, at least one picture region of the picture image PCT1 is converted into at least one converted picture region based on a conversion mode MD. Therefore, each picture component of the at least one converted picture region is converted based on the same conversion mode MD. The conversion mode MD used in the conversion step 402 - denoted MDS - is of a hybrid type, i.e. it defines a combination of at least one flip operation and at least one rotation operation. In a specific example, the conversion mode MD combines a flip operation and a rotation operation. The selected conversion mode MDS is, for example, the conversion mode MD5 or MD6 as described above.

[0157] exist Figure 4 The picture region encoded in may represent the whole of the video picture PCT1 or only a sub-part thereof. In the latter case, a similar process may be performed to encode and decode each picture region of the video picture PCT1. For simplicity, the encoding and decoding of a picture region is described in the following example, where the picture region constitutes the whole of the video picture PCT1.

[0158] In a specific exemplary embodiment, a conversion mode MD may be selected for the video picture PCT1, for example from a set of conversion modes MD0-MD6. Thus, each picture component of the video picture PCT1 is converted according to the selected conversion mode, denoted MDS. According to a specific embodiment, the selected conversion mode MDS defines a combination of at least one flip operation and at least one rotation operation on the video picture PCT1. The way in which this selection is performed will be described later in a specific exemplary embodiment.

[0159] Then, the converted components of the video picture are encoded (step 404) into the bit stream BT1 of the encoded video picture data. The encoding method can be adjusted according to each case. For example, it can be considered as previously referred to Figure 1 The entropy coding is performed.

[0160] In addition, the decoding method 406 obtains as input the bit stream BT1 of the encoded video picture data output by the encoding method 400. In the decoding step 408, the decoded video picture is obtained by decoding the encoded video picture data from the bit stream BT1. The way of performing the decoding can be adjusted according to each case. For example, it can be considered that as previously referred to Figure 2 The entropy decoding is performed.

[0161] In a deconversion (or non-conversion) step 410, a video picture PCT1 (i.e., a reconstructed version of the video picture PCT1) is obtained by deconverting the decoded video picture obtained from the decoding step 408 according to a conversion mode MD. As further described below, the conversion mode MD used to deconvert the decoded video picture is a conversion mode opposite to the selected conversion mode MDS previously used to convert the video picture PCT1 in the encoding method 400 (encoding step 402). By deconverting the decoded video picture (i.e., each of its picture components) according to a conversion mode opposite to MDS, a reconstructed video picture PCT2 can be obtained.

[0162] Figure 5A A schematic block diagram showing steps of a coding method 500 for encoding a video picture PCT1 comprising at least one picture region defined by three picture components CP1, CP2 and CP3 according to certain exemplary embodiments.

[0163] In a selection step 502, a transformation mode MD is selected, wherein the selected transformation mode (denoted MDS) defines a combination of at least one flipping operation and at least one rotation operation, which combination of operations is applied to the picture region PCT1. The selected transformation mode MDS may be, for example, as described above with reference to Figure 3 The conversion mode is MD5 or MD6.

[0164] In a conversion step 504, the picture region PCT1 is converted into converted picture components based on the selected conversion mode MDS. To this end, each picture component of the picture region PCT1 is converted according to the selected conversion mode MDS.

[0165] An exemplary implementation of steps 502 and 504 is as follows Figure 5B As shown, the selected conversion mode MDS is MD6 as mentioned above.

[0166] The selected conversion mode MDS is determined at the picture region level.

[0167] Therefore, each picture region of the video picture may be converted based on the corresponding conversion mode MDS selected in the selection step 502 .

[0168] In encoding step 506 ( Figure 5A ), the converted picture area (ie, each converted picture component thereof) is encoded into the bit stream BT1 of the encoded video picture data. Therefore, the set of converted components can be encoded.

[0169] Therefore, the present application allows the order of samples of each picture within the bitstream of the encoded video picture data to be reorganized during the encoding stage. The original order of samples in the picture area can be modified or adjusted, thereby allowing greater flexibility and efficiency during encoding. More specifically, by utilizing a combination of at least one flip operation and at least one rotation operation at the picture area level, greater flexibility and adaptability can be achieved in the encoding and decoding process of the video picture. As mentioned above, the competition between various conversion modes can provide compression coding gains by considering a wider representation of content diversity so that the main direction of the content is aligned with the codec preferred direction. By applying flipping and rotation, new conversion modes can be brought about that would not otherwise exist. These new hybrid conversion modes may be particularly applicable in some cases, especially for efficient encoding / decoding of specific video content, such as gaming content or vertical videos that are becoming mainstream.

[0170] Likewise, flexibility and efficiency can be achieved in a similar way at the decoding stage. Preprocessing the pictures to be encoded allows limiting power consumption and encoding time.

[0171] In a specific exemplary embodiment, the encoding method 500 further includes the step of signaling (or inserting) region conversion information DT1 into the bit stream BT1 of the encoded video picture data, wherein the region conversion information DT1 indicates whether at least one picture region of the video picture PCT1 has been converted according to the conversion mode MD. In this example, the region conversion information DT1 therefore indicates that at least one picture region of the video picture PCT1 has been converted according to the conversion mode MD, and the format and manner in which the information is carried into the bit stream BT1 can be adjusted according to the specific situation. For example, the region conversion information DT1 may include a bit or an indicator, which is at a first value to indicate that no picture region conversion has been performed, or at a second different value to indicate that at least one picture region conversion has been performed.

[0172] In certain exemplary embodiments, the region conversion information DT1 is carried in the bitstream BT1 as a header, parameter or SEI (Supplemental Enhancement Information) message within the bitstream.

[0173] In a particular exemplary embodiment, the region conversion information DT1 further defines at least one conversion mode MDS, which is selected for converting at least one picture region of the video picture PCT1. For example, the region conversion information DT1 may define the selected conversion mode MD5 or MD6 associated with a particular picture region (see Figure 4 ).

[0174] As further described below, the deconversion of the video picture data at the decoding stage can be performed based on the region conversion information DT1 signaled in the bitstream BT1. In other variants, the region conversion information DT1 is not signaled in the bitstream BT1, but the information is obtained during decoding by any other suitable means (for example by transmitting the applied conversion mode MDS from the encoder to the decoder).

[0175] Figure 6 A schematic block diagram showing steps of a coding method 600 for coding a video picture PCT1 according to a specific exemplary embodiment, the video picture PCT1 comprising at least one picture region defined by three picture components CP1, CP2 and CP3 (collectively referred to as CP). This exemplary embodiment may correspond to the coding method 500 ( Figure 5A ). It can be seen that the encoding method 600 includes reference Figure 1 Steps that have already been described, and therefore for the sake of brevity, will not be described in detail again.

[0176] For simplicity, the encoding of a picture region corresponding to the entirety of the video picture PCT1 is considered below, although variants are possible in which one or more picture regions corresponding to sub-portions of the video picture PCT1 are encoded in a similar manner.

[0177] As described above, in the partitioning step 110, the video picture PCT1 is partitioned into blocks of samples and partition information data is signaled into the bitstream. These blocks include samples for each component CP defining the video picture PCT1. For example, these blocks may correspond to a CTU or a subdivision of a CTU, i.e. Figure 6 CU shown.

[0178] In the selection step 602, each sample block is received as input. A selection of a conversion mode MD (denoted as MDS) is performed for the video picture PCT1 (step 602), for example, in the selection step 502 ( Figure 5A ) to select from the conversion modes MD0-MD6 described in the description.

[0179] Then, the video picture PCT1 is converted based on the selected conversion mode MDS (step 604), for example, as described above for the conversion step 504 ( Figure 5A ). The selected conversion mode MDS defines a combination of at least one flipping operation and at least one rotation operation. Therefore, each picture component CP of the video picture PCT1 is converted according to the same conversion mode, i.e. the selected conversion mode MDS. In this example, the converted picture component CP is output as a block BK1.

[0180] The encoding of the video picture PCT1 is then performed by processing each current block in a coding loop which includes the previous reference Figure 1 Described steps. The following describes an iteration of the encoding loop for encoding a current block, similar steps being performed in each iteration to process each current block BK1 in succession.

[0181] More specifically, the encoding loop receives ( Figure 5A ) The converted picture component CP obtained in the conversion step 604 is used as the current block BK1. In this encoding loop, steps 140-180 are performed as described above. Specifically, a prediction residual block is calculated based on the current block BK1 and the prediction block of the current block BK2.

[0182] In the encoding step 160, the converted picture component CP of the current block is encoded into the bitstream BT1 of the encoded video picture data. For example, the quantized transform coefficient block (or quantized prediction residual block) obtained based on the prediction residual block in step 150 is entropy encoded into the bitstream BT1. By successively processing each current block BK1 in the same manner, each converted picture component CP of the video picture PCT1 can be encoded into the bitstream BT1 of the encoded video picture data.

[0183] The encoding step 160 may also include signaling the component conversion information DT1 into the bit stream BT1, as described above ( Figure 5A ), although variants without such signaling are possible.

[0184] In addition, steps 170-180 are performed, and then the decoded prediction residual block and the prediction block are combined, as previously described with reference to Figure 1 As described above, to obtain the reconstructed block labeled BK2 ( Figure 6 As already explained, intra prediction may be performed based on the reconstructed block BK2 (step 120).

[0185] In a deconversion step 608, a deconverted block BK3 is obtained by deconverting the reconstructed block marked BK2 according to the conversion mode MDS selected for the component CP in step 602. In other words, the component CP of the current block is deconverted according to the conversion mode MDS selected for the video picture PCT1.

[0186] In this way, each component CP of the reconstructed video picture can be deconverted according to the same conversion mode MDS selected for said video picture PCT1 in step 602. The deconversion is achieved by applying to each component CP a conversion (flip and rotation) opposite to the conversion MDS applied to said component CP in step 604, thereby obtaining a deconverted block BK3 (having the same orientation or state in terms of flip and rotation) representing the current block BK1.

[0187] Therefore, in the deconversion step 608, the inverse flipping and rotation operations are performed in the reverse order compared to the combination of flipping and rotation operations defined by the selected conversion mode MDS.

[0188] Then, an in-loop filter, such as a cross-component filter, can be applied (step 190) to the deconverted block BK3, and more generally to the deconverted picture (including the deconverted reconstructed block BK3), to reduce compression artifacts, as described above ( Figure 1). For example, after all picture blocks are reconstructed and deconverted, an in-loop filter may be applied, although variants are possible as described later. For example, they include a deblocking filter, sample adaptive offset (SAO), cross-component SAO (CC-SAO), adaptive loop filter (ALF). However, variants without such a loop filter are possible.

[0189] In a particular exemplary embodiment, inter prediction can be implemented by performing motion estimation (step 130) and motion compensation (step 135) as described above. In addition, the inter prediction mode includes an additional conversion step 610 to obtain a good prediction block for the next block BK1 after the current block BK1 by converting the deconverted block BK3 output from the deconversion step 608 (possibly after post-filtering 190) according to the selected conversion mode MDS. This new conversion allows to build a sufficient prediction block for the next current block processed in the encoding loop. In this way, the motion estimation (step 130) is based on a reconstructed block that is in the same flip / rotated state as the video picture in which the motion compensation block is searched.

[0190] As can be seen from the above exemplary embodiments, a conversion decision can be performed at the encoding stage of the video picture PCT1 to select a suitable conversion mode MDS applied to the entire video picture PCT1 (or at least to a picture area of ​​the video picture PCT1). By selecting the most suitable conversion mode MDS, i.e. a hybrid conversion mode involving flipping and rotation, flexibility and adaptability of the encoding can be achieved, and thus the coding efficiency with a large compression gain can be improved. In particular, an optimal rate-distortion trade-off can be achieved.

[0191] In a particular exemplary embodiment, a rate-distortion score (or a rate-distortion tradeoff) achieved by encoding a video picture PCT1 (or at least a portion thereof) is calculated for a plurality of candidate conversion modes MD (e.g., conversion modes MD0-MD6), and the candidate conversion mode having the maximum rate-distortion score is selected as the selected conversion mode MDS for the picture component CP.

[0192] In a particular example, it is observed that the conversion mode MD0-MD2 (eg Figure 3 ) are generally better suited for most natural content (non-screen content).

[0193] In-depth analysis of the encoded video pictures with the best rate-distortion tradeoff may allow a better understanding of the rationale for achieving compression gains with the chosen conversion mode.

[0194] As previously described, each block of the video picture to be encoded is scanned according to the scanning order applicable in each case. Figure 7As shown in the example of , conventional video codecs use raster scanning to successively scan each block or slice in the video picture data. This results in the creation of causal regions in the video picture (i.e., regions of content that have already been encoded or decoded and are known to the current block to be encoded at the decoder), where reference samples used for prediction and other predictions have higher accuracy.

[0195] It has been observed that when raster scanning is used for block scanning, higher coding efficiency can be achieved for picture content that contains directional features that extend along a specific direction, usually from the upper left border to the lower right border of the picture. This is due to the specific L-shape and causal regions of the picture content caused by raster scanning. The reference samples used for prediction produce higher coding accuracy in the top, left and upper left regions of the current block (because they are closer in space) compared to the region in the upper right part of the video picture. In addition, some samples have not been coded and cannot be used for prediction of the current block (right, lower right, bottom, etc.), but some picture content may benefit from these samples for prediction.

[0196] Figure 8 An exemplary video picture 800 is shown, comprising a main direction DR1, i.e. a direction along which one or more picture components CP of the video picture 800 extend. In the present example, the main direction (or main orientation) DR1 represents the general direction of features (e.g. signs, roads, bridges, etc.), so-called directional features, in the sense that they generally extend along the main direction DR1.

[0197] Figure 8 Also shown is an example of a converted video picture 802, which is converted by, for example, flipping horizontally ( Figure 3 800 (i.e., its picture components) by applying the transformation to the video picture 800 (i.e., its picture components). It can be seen that the main direction DR1 is transformed into a part of all features of the transformed picture components. The horizontal flipping results in a rotation of the main direction DR1, which now extends substantially from the upper left area to the lower right area of ​​the video picture. When using raster scanning, this orientation in the horizontally flipped video picture 802 provides better coding efficiency.

[0198] For example, it has been observed that encoding BQ-Terrace sequences exhibiting strong directionality, using horizontal flipping as described above, can achieve up to 2% BD rate gain relative to ECM (Enhanced Compression Test Model) after conversion.

[0199] In contrast, it has been observed that encoding picture content whose main direction is orthogonal to the reference sample positions does not readily exploit compression gains.

[0200] like Fig. 9 As shown, the image has been horizontally flipped compared to the original image. In some cases, the image content may contain directional features extending in (or substantially) an orthogonal direction DR1 (e.g., the upper right to lower left diagonal). In this case, applying the identity function (i.e., no conversion operation) to the image region at hand can allow the best encoding result to be achieved.

[0201] It can be appreciated from the above that the most appropriate conversion mode for encoding a given video picture depends on the scanning order used for encoding and at least one direction along which the features of the video picture can be extended. Therefore, based on at least one of the above two criteria, the most appropriate conversion mode for encoding a given video picture in step 502 ( Figure 5A ) determines the selected conversion mode MDS for the picture area.

[0202] In a specific exemplary embodiment, a picture region of a video picture PCT1 to be encoded contains a main direction DR1, and the conversion mode MDS selected for said picture region is a conversion mode MD with a converted main direction, obtained by converting the main direction DR1 according to said conversion mode, which is most aligned with a target direction DR0, also denoted as a prediction direction (e.g., a desired direction extending typically from an upper left region to a lower right region of the video picture). The target (or predefined) direction DR0 may be adapted according to each case and may be determined, for example, as a function of the scanning order, to maximize compression gain during encoding.

[0203] It will be appreciated that the presence of a dominant direction (along which the directional feature extends) for a given picture region to be encoded in a video picture may have a significant impact on the coding efficiency associated with the selected conversion mode. Therefore, encoding may benefit from a pre-analysis of the picture content to determine potential dominant directions in the picture component CP. Based on the dominant directions determined in the pre-analysis, a conversion mode of interest may be selected to enhance compression gain. For example, it may be desirable to align the dominant direction present in the picture content with a target direction DR0 (e.g., a top left to bottom right diagonal of the picture content).

[0204] In a specific example, for the main direction detected in the video picture, the video picture is divided into picture regions so that a corresponding conversion mode MDS can be selected for each picture region. In this specific case, the in-loop reconstructed picture is deconverted (or the motion compensation block is converted to the appropriate MDS mode) so that motion estimation and motion compensation operate on the blocks converted with the same MDS mode.

[0205] In a specific exemplary embodiment, a conversion mode MDS is selected for a picture region of the video picture PCT1 from a list of candidate conversion modes MD. The list may be obtained by obtaining an at least partially converted picture by converting at least a portion of the picture region with the candidate conversion mode MD, and adding the candidate conversion mode MD to the list of candidate conversion modes when (if) a distance between a main direction DR1 determined from the at least partially converted picture region and a target direction DR0 of the picture region is below a threshold. A specific implementation example will be further described below.

[0206] Fig.10 A schematic block diagram of the steps of a coding method 1000 for coding a video picture PCT1 according to a specific exemplary embodiment is shown, the video picture PCT1 comprising at least one picture area (labeled PA) defined by three picture components CP1, CP2 and CP3. The coding method comprises steps 1002-1010, which can be performed for each picture area of ​​the video picture PCT1. For the sake of simplicity, the method 1000 is described below for a given picture area PA, keeping in mind that the same method can be applied to each picture area PA of the video picture PCT1.

[0207] In the conversion step 1002, the same as in step 402 ( Figure 4 ), step 504( Figure 5A ) or step 604 ( Figure 6 ), at least a portion of a picture area PA of a video picture PCT1 is transformed according to a transformation mode MD (e.g. MD0) to obtain an at least partially transformed picture area. Such transformation allows testing the considered transformation mode MD to assess whether it is a suitable candidate transformation mode for said picture area PA. As further described below, although the entire transformation in the picture area PA may be performed, a variant is also possible in which only a portion of the picture area PA is transformed in step 1002.

[0208] Furthermore, in the selection step 1004, it is determined whether the distance between the main direction DR1 determined from the at least partially converted partial area and the target direction DR0 meets a threshold TH1 (e.g., is lower or higher than the threshold, depending on the metric used). In the affirmative case, the conversion mode MD (e.g., MD0) used for the conversion in the conversion step 1002 is selected as a candidate conversion mode for the picture area PA (step 1004). For this purpose, the conversion mode MD can be added to a list (or set) of candidate conversion modes. In other words, when the conversion mode MD sufficiently aligns the main direction DR1 in the at least partially converted picture area with the target direction DR0, for example, when the angle difference meets (e.g., is lower or higher than) the threshold TH1, the conversion mode MD is selected as a candidate conversion mode.

[0209] The selection step 1004 may include pre-analyzing the at least partially transformed image region to extract the main direction DR1 therefrom. The pre-analysis may be performed to identify directional features from the at least partially transformed image region and determine the main direction DR1 therefrom. As described later in certain exemplary embodiments, various image processing techniques may be used to detect the main direction DR1.

[0210] Steps 1002 and 1004 may be performed for each of a plurality of conversion modes (eg, MD0 to MD6 as described above) to select one or more of them as candidate conversion modes for the picture area PA at hand.

[0211] In a selection step 1006, a conversion mode MDS is selected for the considered picture area PA from among the one or more candidate conversion modes obtained in the selection step 1004. Figure 4-6 In step 502), the selected conversion mode MDS is retained as the most suitable conversion mode for converting the picture area PA before encoding.

[0212] In a first example, the list of candidate conversion modes obtained in the selection step 1004 for the picture area PA contains only a single candidate conversion mode. In this case, the conversion mode MDS selected in the selection step 1006 is the single candidate conversion mode.

[0213] In a second example, the list of candidate conversion modes obtained in the selection step 1004 for the picture area PA contains multiple candidate conversion modes MD. In this case, the candidate conversion mode ( MD ) with the lowest rate-distortion tradeoff (or rate-distortion score) may be selected in step 1008. Fig.10 In other words, if a plurality of candidate conversion modes MD are pre-selected in the selection step 1004 , the candidate conversion mode with the lowest rate-distortion tradeoff may be selected as the selected conversion mode MDS in step 1008 .

[0214] In a specific example, the candidate conversion mode MD with the lowest rate-distortion tradeoff (or rate-distortion score, for example using known rate-distortion optimization (RDO) techniques) may be selected in step 1008 as a first (fast) pass of the encoding loop. This first pass may disable some or most encoding tools (e.g., template-based tools such as ITMP, TIMD, ... and in-loop filters such as deblocking, ALF, SAO, ...) and restrict partitioning (depth segmentation and partitioning mode) in order to quickly select the best candidate conversion mode. The actual encoding using the selected conversion mode may then be performed in a second pass of the encoding loop. In this way, flexibility and efficiency may be achieved in the encoding stage. Preprocessing the image to be encoded may allow power consumption and encoding time to be limited.

[0215] In step 1008, a rate-distortion score may be calculated for each picture (or part of a picture or picture component CP) converted with a candidate conversion mode, and the obtained rate-distortion scores may be compared to identify the candidate conversion mode that produces the lowest rate-distortion score.

[0216] In the encoding step 1010, it can be combined with the encoding step 404 ( Figure 4 ), encoding step 506 ( Figure 5A ) or encoding step 160 ( Figure 6 ) is the same, each picture component CP converted based on the conversion mode MDS selected for the picture area PA in the selection step 1006 is encoded into the bit stream BT1 of the encoded video picture data.

[0217] As mentioned earlier, in Fig.10 In the conversion step 1002, the whole or part of the picture area PA is converted. Fig.11 and Fig.12 describe Fig.10 Exemplary variants of the encoding method.

[0218] Fig.11 A schematic block diagram of the steps of a coding method 1100 for coding a video picture PCT1 comprising at least one picture area PA defined by three picture components CP1, CP2 and CP3 according to a specific exemplary embodiment is shown. The coding method comprises steps 1102-1006, which can be performed for each picture area PA of the video picture PCT1. For the sake of simplicity, the method 1100 is described below for a given picture area PA, keeping in mind that the same method can be applied to each picture area PA of the video picture PCT1.

[0219] In the conversion step 1102, the converted picture components are obtained by fully converting the picture region according to each of the set of candidate conversion modes MD0-MD6, for example, in step 402 ( Figure 4 ), step 504( Figure 5A ) or step 604 ( Figure 6 ) is described. In other words, for each conversion mode MD0-MD6, a respective converted version of the image area PA is obtained. The conversion step 1102 can be regarded as the conversion step 1002 ( Fig.10 ), wherein the entirety of the picture area PA is transformed. As previously described, such a transformation allows testing various transformation modes MD to evaluate whether each of them is a suitable candidate transformation mode for said picture area PA.

[0220] In a determination step 1104, a main direction denoted DR1 is determined for each transformed picture region obtained in step 1102 using transformation modes MD0-MD6, respectively.

[0221] The main direction DR1 in the converted picture area can be determined based on feature extraction analysis of the converted picture area, for example, by performing an edge detection function (e.g., including Sobel and / or Canny filters). To this end, a gradient histogram or a Hough transform (or derivative) can be used. For example, by successively applying an edge detection algorithm (such as a Sobel or Canny filter) and then applying a gradient histogram or a Hough transform (or derivative), one or more main directions DR1 can be determined in the converted picture area.

[0222] In particular, a Hough transform may be calculated to determine which direction(s) are most representative in each converted image region. In a specific example, the gradient histogram is subsampled to identify multiple close directions from the converted image region, and the main direction DR1 is determined by averaging these close directions.

[0223] In a determination step 1106, at least one candidate conversion mode MD (among MD0-MD6) is determined or identified for the picture area PA when the distance between the main direction DR1 and the target direction DR0 determined in step 1104 meets (e.g., is above or below) a threshold value TH1. To this end, a comparison may be made between each main direction DR1 and the target direction DR0 determined in step 1104 to evaluate the distance therebetween and to determine whether the distance meets (e.g., is above or below) the threshold value TH1. The target direction DR0 represents, for example, a top left to bottom right diagonal line in the converted picture component.

[0224] In a particular exemplary embodiment, the distance between the main direction DR1 and the target direction DR0 is evaluated by calculating the scalar product of the vectors representing the main direction DR1 and the target direction DR0, respectively. The higher the scalar product, the closer the main direction DR1 is to the target direction DR0 (the larger the distance DR1-DR0), and thus the better the corresponding conversion mode is as a potential candidate conversion mode. For example, if the scalar product between the vectors of the main direction DR1 (obtained from the picture component converted with the conversion mode) and the target direction DR0 is higher than a threshold TH1, the conversion mode MD is selected as a candidate conversion mode.

[0225] Then, method 1100 may continue as previously described with reference to Fig.10Specifically, a conversion mode MDS may be selected based on one or more candidate conversion modes MD identified in the identification step 1106 (step 1006), and then encoding may be performed (step 1010) to encode the component CP converted according to the selected conversion mode MDS into the bitstream BT1.

[0226] It can be seen that in Fig.11 In a specific exemplary embodiment of , the picture area PA is fully converted according to each conversion mode MD0-MD6, and then the main direction DR1 is determined from each fully converted picture area. Then, the best candidate conversion mode can be determined based on the fully converted pictures.

[0227] As an alternative, the main direction DR1 is extracted only from the original picture PCT1 (or each picture area PA). Knowing DR1, the conversion mode MDS in MD0-MD6 can be determined so as to maximize the scalar product with the target direction DR0. In fact, with each conversion mode MD0-MD only the direction DR1 is converted, the result of each conversion provides a direction to be compared with DR0, without the need to convert the entire picture PCT1 according to each of the modes MD0-MD6 and apply the DR1 extraction process to each converted picture. Possibly, the main direction DR1 extraction process operates on the first component CP1 or a subsampled version of the first component CP1 to save resources (and computing time) at the encoder.

[0228] Fig.12 A schematic block diagram of the steps of a coding method 1200 for coding a video picture PCT1 comprising at least one picture area PA defined by three picture components CP1, CP2 and CP3 according to a specific exemplary embodiment is shown. The coding method comprises steps 1202-1206, which can be performed for each picture area PA of the video picture PCT1. For the sake of simplicity, the method 1200 is described below for a given picture area PA, keeping in mind that the same method can be applied to each picture area PA of the video picture PCT1.

[0229] In a determination step 1202, a main direction denoted DR1a is determined in a given picture area PA of the video picture PCT1. This determination may be performed based on a feature extraction analysis of the picture area PA in a manner similar to that of the determination step 1104 ( Fig.11). For example, such feature extraction analysis may involve performing an edge detection function (e.g., including Sobel and / or Cany filters). To this end, a gradient histogram or a Hough transform (or derivative) may be used. In particular, a Hough transform may be calculated to determine which direction is most representative in the picture area PA. In a specific example, the gradient histogram is subsampled to identify multiple approach directions for the picture area PA, and the main direction DR1a is determined by averaging these approach directions.

[0230] In a conversion step 1204, the main direction DR1a obtained in step 1202 is converted into a main direction labeled DR1 according to each of the conversion modes MD0-MD6. Thus, for each conversion mode MD0-MD6, a respective main direction DR1 (in a converted form) corresponding to the main direction DR1a in the original picture area PA is obtained. For example, a main direction vector corresponding to the main direction DR1a in the picture area PA (in the original picture PCT1) is identified in step 1202, and then converted according to each of the conversion modes MD0-MD6 to determine the corresponding main direction DR1.

[0231] Determining step 1202 and converting step 1204 may be viewed as converting step 1002 ( Fig.10 ) is a specific implementation of .

[0232] In a determination step 1206, when the distance between the main direction DR1 and the target direction DR0 determined in step 1204 meets (e.g., is higher or lower than) a threshold TH1, at least one candidate conversion mode MD (among MD0-MD6) is determined or identified for the picture area PA. To this end, the same method as in the determination step 1106 ( Fig.11 ) The determination step 1206 is performed in a similar manner. In particular, a comparison can be made between each main direction DR1 determined in step 1204 and the target direction DR0 to evaluate the distance therebetween and determine whether the distance complies with (e.g., is lower than or higher than) a threshold TH1. As already pointed out, the target direction DR0 represents, for example, a top left to bottom right diagonal line in the converted picture area.

[0233] Then, the method 1200 may continue to execute steps 1006-1010, as described above with reference to Fig.10 In particular, a conversion mode MDS may be selected based on one or more candidate conversion modes MD identified in the identification step 1206 (step 1006), and then encoding may be performed (step 1010) to encode the picture area PA converted according to the selected conversion mode MDS into the bitstream BT1.

[0234] It can be seen that in Fig.12In a specific exemplary embodiment of the present invention, in the encoding method 1200, one or more candidate conversion modes MD are obtained based on a partially converted picture area, which is obtained by only partially converting the picture area according to each conversion mode MD0-MD6. Only one or more identified main directions in the picture area PA (in the original content) can be converted to determine the direction closest to the desired target direction DR0 (for example, the upper left to lower right diagonal). Therefore, in this specific exemplary embodiment, it is not necessary to fully convert the picture area PA according to each possible conversion mode MD0-MD6, thereby saving time and resources for selecting the most suitable conversion mode MDS for each picture area PA.

[0235] In addition, as mentioned above ( Figure 1 ), the video picture PCT1 may be partitioned into CTUs of a CTU grid (as a pre-processing before the encoding loop). In particular, each picture area PA of the video picture PCT may be partitioned into CTUs of a CTU grid, wherein each CTU is partitioned into one or more coding units (CUs). However, it has been observed that, since the content resolution of the video picture PCT1 is typically not a multiple of the CTU size (e.g. 128), the CTU grid relative to the original video content PCT1 may be spatially aligned in a different way (relative to the video picture PCT1 to be compressed). It has been found that this specific relative arrangement of the picture content (picture areas) relative to the CTU grid may be exploited to further improve the compression efficiency in the encoding stage.

[0236] For picture content showing horizontal and / or vertical main directions, a transformation mode MDS for transforming the picture area PA of the video picture PCT1 may be selected based on the borders (or edges) of the CTU grid (or CU grid) relative to said horizontal and / or vertical main directions. In particular, it is advantageous to select a transformation mode that better aligns the CTU (or CU) grid with said horizontal and / or vertical main directions of the video picture PCT1 (or picture area PA). This situation is particularly suitable for content showing screen content types with strong horizontal and vertical directions.

[0237] For different conversion modes MD, for example for each conversion mode MD0-MD6, the relative position of the CTU (or CU) grid (especially its borders) is known, because this position depends only on the CTU size and the resolution of the video picture PCT1. It is worth noting that the CTU (or CU) grid itself does not move, it starts at the coordinates (0,0) in the upper left corner of the picture. However, once the converted picture is deconverted, the conversion modes operating on the video picture PCT1 act as if the CTU (or CU) grid is moved (see Fig. 13B ).

[0238] In one particular exemplary embodiment, a conversion mode MDS may be selected from a list of candidate conversion modes by aligning the boundaries of a coding unit (CU) (or CTU or block) with the main direction of a picture area PA of a video picture (e.g., Fig.10 In step 1006), each CTU is a picture region subdivided according to the coding tree. The specific implementation will be described in detail below.

[0239] Fig.13A A schematic block diagram of the steps of a coding method 1300 for coding a video picture PCT1 comprising at least one picture area PA defined by three picture components CP1, CP2 and CP3 according to a specific exemplary embodiment is shown. The coding method comprises steps 1302-1306, which can be performed for each picture area PA of the video picture PCT1. For the sake of simplicity, the method 1300 is described below for a given picture area PA, keeping in mind that the same method can be applied to each picture area PA of the video picture PCT1.

[0240] In the conversion step 1302, the same as in the conversion step 1002 ( Fig.10 ), at least a portion of the picture area PA is converted according to a conversion mode MD (e.g., MD1). As described above, the picture area PA can be completely or only partially converted using each conversion mode MD0-MD6 to determine a corresponding main direction DR1 (one or more main directions DR1) from the completely or partially converted picture area. For example, the picture area PA is completely converted according to each conversion mode MD0-MD6, and then the main direction DR1 (one or more main directions DR1) is determined from each converted picture area. Fig.11 , steps 1102-1104), or determining the main direction DR1a in the picture area PA before conversion, and then converting the main direction DR1a into the corresponding main direction DR1 according to each conversion mode MD0-MDA6 ( Fig.12 , steps 1202-1204).

[0241] Note that one or more main directions DR1 may be determined as described above. In the following examples, it is assumed that one main direction DR1 is determined, but multiple main directions DR1 may be determined and processed in a similar manner.

[0242] In the determination step 1304, the Fig.10), the main direction DR1 is determined from the at least partially converted picture area obtained in the converting step 1302, for example based on a pre-analysis of the at least partially converted picture area to extract the main direction DR1 therefrom. Furthermore, still in the determining step 1304, it is determined whether the main direction DR1 is vertical and / or horizontal. In other words, it is determined whether the main direction DR1 is parallel to (or substantially parallel to) the boundary of the coding unit (CU).

[0243] A vertical or horizontal direction (or edge) may correspond to a spacing between two groups of pixels, each group of pixels sharing a particular picture property.

[0244] In certain exemplary embodiments, if the angular deviation of the main direction DR1 relative to the vertical and / or horizontal direction is below a deviation threshold, then the main direction DR2 is determined to be aligned with the horizontal and / or vertical direction in the determination step 1304. For example, if the deviation angle of the main direction DR1 relative to the vertical or horizontal line (or another target direction) does not exceed + / -15 degrees, the main direction DR1 is substantially (approximately) vertical or substantially horizontal. In other words, the main direction DR1 can be regarded as a horizontal or vertical direction within a certain angular tolerance relative to the horizontal or vertical direction.

[0245] If it is determined (step 1304) that the main direction DR1 is not vertical and / or horizontal, the method 1300 continues to select the most appropriate conversion mode MD as described above, for example by executing steps 1004-1006 ( Fig.10 ). For example, using the scalar product based method as described above.

[0246] However, if it is determined (step 1304) that the main direction DR1 is horizontal and / or vertical (or substantially horizontal and / or vertical), the method 1300 proceeds to a selection step 1306, as further described below.

[0247] In the selection step 1306, if the alignment difference (or position offset) between the main direction DR1 and the boundary of the CU (or CTU) of at least a part of the picture area PA satisfies a threshold (e.g., is above or below the threshold, depending on the metric used), the conversion mode MD (i.e., the conversion mode used to convert at least a part of the picture area PA in the conversion step 1302) is selected as the candidate conversion mode MD. In other words, since the main direction DR1 is vertical and / or horizontal, the conversion mode MD (1306) is selected by aligning the main direction DR1 with the boundary of the coding unit CU. For example, the selected conversion mode MD is the conversion mode that makes the main direction DR1 overlap with the maximum number of CU boundaries (or overlaps with the CU boundaries the most).

[0248] In a particular exemplary embodiment, a transformation mode (e.g., between MD0-MD6) that best aligns the CU (or CTU) of at least a portion of the picture area PA with the main direction DR1 is selected as the selected transformation mode MDS in step 1306. In particular, the horizontal or vertical boundaries of the CTU grid may be spatially shifted according to the selected transformation mode MDS to be positioned aligned (or substantially aligned) with the main direction DR1.

[0249] For example, the conversion mode MD for a given picture area PA can be selected based on minimizing the distance between the CU boundary (or CU edge) and the main direction DR1 of the picture content. In a specific example, the conversion mode MD for a given picture area PA can be selected based on the results of the technique, wherein the data to be optimized is the x position of the CTU column (flip / de-flip or rotate / de-rotate) of the conversion mode MD at a given width relative to the vertical edge of the content, and the y position of the CTU row (flip / de-flip or rotate / de-flip) of the conversion mode MD at a given height relative to the horizontal edge of the content. Preferably, the CU boundary or block (contained in the CTU) boundary is aligned with the main direction of the video picture PCT1.

[0250] Fig. 13B Different alignments of the CU grid relative to a picture area PA which has been transformed and de-transformed according to different transformation modes MD0 - MD6 are illustrated by way of example. Depending on the applied transformation mode, the CU grid is more or less aligned with the main direction DR1 of the transformed picture area (in this particular example, the main direction DR1 is vertical).

[0251] In addition, in the previous reference Figure 3-1 In any of the encoding methods described in 3, the encoding method may include converting the reference Figure 5A The encoding method 500 describes the steps of signaling (or inserting) area conversion information DT1 into the bit stream BT1 of the encoded video picture data to indicate whether at least one image area PA of the video picture PCT1 is converted according to the conversion mode MD, and may also define at least one conversion mode MDS (possibly each conversion mode MDS) which is selected for converting at least one image area PA of the video picture.

[0252] In addition, as mentioned above, the present application also relates to decoding video pictures, for example, video pictures that were previously encoded according to any of the previously described encoding methods. The decoding methods according to specific exemplary embodiments will be described below. As will be apparent, the encoding concepts described above in various exemplary embodiments can be applied in a reverse manner to decode the encoded video pictures.

[0253] Fig.14A schematic block diagram showing steps of a decoding method 1400 for decoding a bit stream BT1 of encoded video picture data according to a particular exemplary embodiment is shown. In the following exemplary embodiments, it is assumed that the bit stream BT1 is generated according to any of the previously described encoding methods.

[0254] A bit stream BT1 of coded video picture data is obtained as input to the decoding method 1400. For example, the coded video picture data may include a video picture PCT1 in coded form, the video picture PCT1 including at least one picture region defined by three picture components CP1, CP2 and CP3.

[0255] In the decoding step 1402, a decoded video picture is obtained by decoding the encoded video picture data from the bit stream BT1.

[0256] In the deconversion step 1404, the video picture is obtained by deconverting (or non-converting) at least one picture area of ​​the decoded video picture obtained in the decoding step 1402 according to the conversion mode MD. The conversion mode MD defines a combination of at least one flip operation and at least one rotation operation on the at least one picture area. The description of the conversion mode of the encoding stage provided above applies to the conversion mode of the decoding stage in the same manner. In particular, the conversion mode MD used in the decoding stage can be, for example, any one of MD0-MD6 as described above.

[0257] As mentioned before, deconverting the picture area PA according to a given conversion mode means applying an inverse conversion (flipping and rotation), i.e. a conversion opposite to said given conversion mode (e.g. opposite to the conversion mode previously applied at the encoding stage to encode the video picture into the bitstream BT1). Applying the inverse conversion, i.e. deconversion, allows converting the picture area PA back to its original orientation or state before the conversion was performed at the encoding stage.

[0258] The conversion mode used in the deconversion step 1404 is determined at the picture area level. Therefore, each picture area PA (or a part thereof) of the decoded video picture can be deconverted based on the corresponding conversion mode MD to obtain a video picture. In a specific example, at least two picture areas (or a part thereof) can be deconverted based on different conversion modes MD to obtain a video picture, but in some cases, two picture areas can also be deconverted based on the same conversion mode MD. In a specific example, therefore, a video picture PCT1 previously encoded by performing the encoding method as described above can be obtained in the deconversion step 1404.

[0259] In a specific exemplary embodiment, the region conversion information DT1 may be signaled (or included) in the bitstream BT1 obtained as input to the decoding method 1400, as described above for the encoding method in the specific exemplary implementation. The region conversion information DT1 may indicate whether at least one picture region PA of the video picture PCT1 is converted (i.e., has been converted) according to the conversion mode MD.

[0260] As mentioned above, the format and manner in which the information is carried into the bitstream BT1 can be adjusted according to the specific situation. For example, the region conversion information DT1 may include a bit or an indicator that is at a first value to indicate that no picture region conversion has been performed, or at a second different value to indicate that at least one picture region conversion has been performed. In a specific example, the region conversion information DT1 is carried in the bitstream BT1 as a header, parameter or SEI (supplemental enhancement information) message together with the bitstream BT1.

[0261] As further described below, the deconversion of the video picture data at the decoding stage can be performed based on the region conversion information DT1. In particular, the bitstream BT1 can be formatted to include the encoded video picture data and the region conversion information DT1. The decoding method 1400 ( Fig.14 ) are specific exemplary embodiments.

[0262] In a specific exemplary embodiment, the region conversion information DT1 is detected in the bit stream BT1 of the encoded video picture data. In a specific example, the bit stream BT1 is decoded in a decoding step 1402, and the region conversion information DT1 is detected from the decoded bit stream DT1. The region conversion information DT1 can be carried in the bit stream BT1 in any suitable manner, for example as described in a specific exemplary embodiment of the encoding method of the present application. Based on the detected region conversion information DT1, it is determined that at least one picture region of the decoded video picture must be deconverted, thereby triggering the deconversion step 1404 as described above.

[0263] In a particular exemplary embodiment, the region transformation information DT1 further defines at least one transformation mode MD (also referred to as MDS) selected and applied during the encoding phase for transforming at least one picture area PA of the video picture PCT1. For example, the region transformation information DT1 may explicitly indicate the transformation mode MD5 (or MD6) (see Figure 4 As mentioned above, the conversion mode MD5 (or MD6) defines a combination of a rotation operation and a flip operation. This conversion mode can be selected from the conversion modes MD0-MD6 during the encoding stage.

[0264] In a specific exemplary embodiment, based on the detected region conversion information DT1, a conversion mode MD according to which the at least one picture region PA is deconverted in the deconverting step 1404 is determined. For example, a corresponding conversion mode MD for deconverting each picture region PA may be determined based on the region conversion information DT1 parsed from the bitstream BT1.

[0265] In other variants, the region transition information DT1 is not signaled within the bitstream BT1, but is obtained as part of the decoding method 140 by any other suitable means (e.g. by receiving the applied transition mode MD from the received bitstream BT1 as input to the decoding method 1400).

[0266] Fig.15 A schematic block diagram of the steps of a decoding method 1500 for decoding a video picture PCT1 (or a part thereof) from a bitstream BT1 of encoded video picture data according to a specific exemplary embodiment is shown. In this example, it is assumed that the video picture PCT1 defined in coded form within the bitstream BT1 comprises at least one picture region defined by three picture components CP1, CP2 and CP3, as already described for the encoding method of the present application. It is assumed hereinafter that the at least one picture region to be decoded comprises the entirety of the video picture PCT1, although variants of decoding only a part of the video picture PCT1 are possible.

[0267] Fig.15 A specific exemplary embodiment may correspond to decoding method 1400 ( Fig.14 ). It can be seen that Fig.15 The decoding method 1500 includes the reference Figure 2 The steps described herein are therefore not described in detail for the sake of brevity.

[0268] In step 210, the partition information data, the prediction information data and the quantized transform coefficient block (or the quantized residual block) are obtained by entropy decoding the bit stream BT1 of the encoded video picture data (parsing the data contained in the bit stream BT1). For example, the received bit stream BT1 is generated according to the encoding method described in any specific exemplary embodiment of the present application.

[0269] Other information data may also be entropy decoded from the bitstream BT1 for decoding the current block of the video picture VP, such as the component transformation information DT1 as described above.

[0270] In step 220, the decoded picture is divided into current blocks BK10 based on the partition information. In other words, based on the partition information, the partitions for decoding the picture into the current blocks BK10 are obtained. Each current block BK10 is obtained by entropy decoding from the bitstream BT1 (step 210) and defines (or includes) a component CP (or a sample thereof) of the coded video picture PCT1. Therefore, all blocks BK10 define each component CP of the coded video picture PCT1.

[0271] Each decoded current block BK10 is a block of quantized transform coefficients or a block of quantized prediction residuals. The decoding process is described below for a given current block BK10 corresponding to each component CP of the video picture PCT1, keeping in mind that the same process can be iterated for each consecutive current block BK0 to reconstruct the video picture PCT1.

[0272] In step 230 , the current block BK10 is dequantized and possibly inversely transformed (step 240 ) to obtain a decoded prediction residual block BK11 .

[0273] On the other hand, the prediction information data extracted from the bitstream BT1 is used to predict the current block. The prediction block BK13 is obtained by its intra-frame prediction (step 250) or its motion compensated temporal prediction (step 260). The prediction process performed on the decoding side is the same as the prediction process on the encoding side (as described above).

[0274] Next, the decoded prediction residual block BK11 and the prediction block BK13 are combined, usually summed, which provides the reconstructed block BK12.

[0275] In a deconversion step 1502, the component CP defined by the reconstructed block BK12 is deconverted based on a conversion mode MD, the conversion mode MD defining a combination of at least one flipping operation and at least one rotation operation on the picture component CP, as previously described. The conversion mode MD applied to the deconverting of the reconstructed block BK12 in step 1502 may be determined based on the region conversion information DT1 obtained by any suitable means as previously described, for example based on the region conversion information DT1 extracted from the bitstream BT1 received as input to the decoding method 1500.

[0276] Thus, the video picture PCT1 can be obtained by deconverting each picture component CP defining the decoded video picture PCT1 according to the same conversion mode MD. To this end, each current block BK12 is successively deconverted by applying the same conversion mode MD, i.e. the conversion mode previously used to encode the video picture PCT1 in the encoding stage (step 1502).

[0277] Then, the decoding method 1500 can be used in the same manner as the decoding method 200 ( Figure 2 ) is performed in the same manner. In particular, in step 270, the in-loop filter may be applied to the reconstructed picture (including the deconverted reconstructed block BK14), and the reconstructed block or the filtered reconstructed block forms a reference picture, which may be stored in a decoded picture buffer (DPB) as described above ( Figure 1-2 ).

[0278] Furthermore, in some cases, cross-component filtering (or cross-component tools) may be applied at the encoding stage and / or at the decoding stage to determine at least one component CP of the video picture based on another component CP of the video picture. Figure 1 As shown (cross-component filtering step 190), an in-loop filter may be applied to the reconstructed picture (including the reconstructed blocks) to reduce compression artifacts. After all picture blocks are reconstructed, the cross-component filter may be applied. During decoding, the in-loop filter may be applied to the reconstructed picture in the same manner as described above with reference to Figure 2 As described (cross-component filtering step 270 ), cross-component filtering is a well-known technique, which may include, for example, cross-component linear model (CCLM), CCC-ALF in VVC, CC-SAO in exploratory ECM, and the like.

[0279] In an exemplary embodiment, the sequence parameter set may be modified as follows to indicate activation of the transition mode:

[0280]

[0281] where sps_afr_enabled_flag indicates whether adaptive flipping or rotation is enabled as a sequence level.

[0282] In an exemplary embodiment, the component transformation information DT1 for each component CP as described above is defined in a picture header, a picture parameter set, an adaptation parameter set or other parameter sets as follows:

[0283]

[0284]

[0285] Where afr_data() is defined as follows:

[0286]

[0287] Where afr_mode_idc points to the following mode:

[0288] 0=identical

[0289] 1 = horizontal flip,

[0290] 2 = 90° rotation

[0291] 3 = 270° / -90° rotation

[0292] 4=vertical flip,

[0293] 5 = horizontal and vertical flip,

[0294] 6 = vertical flip plus 90° rotation,

[0295] 7 = vertical flip plus 270° / 90° rotation.

[0296] As a variant, if no transition mode is signalled, the identity mode is implied, ie the confirmation function (identity = default).

[0297] As a variant, the bits signaled to indicate flipping and rotation are separate (ie, some bits indicate horizontal and / or vertical flipping, while other bits indicate rotation, and possibly other bits indicate the direction of rotation).

[0298] The information in the picture header allows determining which afr_data() is used for the current picture.

[0299] In addition, the present application relates to a coding system (or coding device) and a decoding system (or decoding device), each configured to perform any one of the previously described coding and decoding methods according to a specific exemplary embodiment. According to any of the above exemplary embodiments, the coding system and the decoding system may include suitable components (or modules) configured to perform each step of the coding and decoding method. Specific exemplary embodiments of such a system are described below.

[0300] Fig.16 A schematic diagram illustrating an example of a system 1800 is shown in which various aspects and exemplary embodiments are implemented.

[0301] System 1800 can be embedded as one or more devices, including various components described below. In various exemplary embodiments, system 1800 can be configured to implement one or more aspects described in the present application. For example, system 1800 is configured to perform encoding methods and / or decoding according to any of the aforementioned exemplary embodiments. Therefore, system 1800 can constitute an encoding system and / or decoding system in the sense of the present application.

[0302] Examples of devices that may constitute all or part of system 1800 include personal computers, laptops, smartphones, tablets, digital multimedia set-top boxes, digital television receivers, personal video recording systems, networked home appliances, networked vehicles and their associated processing systems, head-mounted display devices (HMDs, perspective glasses), projectors (projectors), "cave" (systems including multiple displays), servers, video encoders, video decoders, post-processors that process output from video decoders, pre-processors that provide input to video encoders, web servers, video servers (e.g., broadcast servers, video-on-demand servers, or web servers), still cameras or video cameras, encoding or decoding chips, or any other communication device. The elements of system 1800 may be implemented individually or in combination in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one exemplary embodiment, the processing and encoder / decoder elements of system 1800 may be distributed across multiple ICs and / or discrete components. In various exemplary embodiments, system 1800 may be communicatively coupled to other similar systems or other electronic devices via, for example, a communication bus or through dedicated input and / or output ports.

[0303] The system 1800 may include at least one processor 1810 configured to execute instructions loaded therein to implement, for example, various aspects described in the present application. The processor 1810 may include embedded memory, input and output interfaces, and various other circuits known in the art. The system 1800 may include at least one memory 1820 (e.g., a volatile memory device and / or a non-volatile memory device). The system 1800 may include a storage device 1840, which may include a non-volatile memory and / or a volatile memory, including but not limited to an electrically erasable programmable read-only memory (EEPROM), a read-only memory (ROM), a programmable read-only memory (PROM), a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash memory, a disk drive, and / or an optical drive. As a non-limiting example, the storage device 1840 may include an internal storage device, an attached storage device, and / or a network accessible storage device.

[0304] System 1800 may include an encoder / decoder module 1830, which is configured to, for example, process data to provide encoded / decoded video image data, and the encoder / decoder module 1830 may include its own processor and memory. The encoder / decoder module 1830 may represent a (one or more) module that may be included in a device to perform encoding and / or decoding functions. As is well known, a device may include one or both of the encoding and decoding modules. In addition, the encoder / decoder module 1830 may be implemented as a separate element of the system 1800, or may be integrated into the processor 1810 as a combination of hardware and software, as known to those skilled in the art.

[0305] Program code to be loaded onto the processor 1810 or the encoder / decoder 1830 to perform various aspects described in the present application may be stored in the storage device 1840 and subsequently loaded onto the memory 1820 for execution by the processor 1810. According to various exemplary embodiments, during the execution of the processes described in the present application, one or more of the processor 1810, the memory 1820, the storage device 1840, and the encoder / decoder module 1830 may store one or more of various items. Such stored items may include, but are not limited to, video image data, information data for encoding / decoding video image data, bit streams, matrices, variables, and intermediate or final results of equations, formulas, operations, and operation logic processing.

[0306] In various exemplary embodiments, memory internal to the processor 1810 and / or encoder / decoder module 1830 may be used to store instructions and provide working memory for processes that may be performed during encoding or decoding.

[0307] However, in other exemplary embodiments, memory external to the processing device (e.g., the processing device may be the processor 1810 or the encoder / decoder module 1830) may be used for one or more of these functions. The external memory may be a memory 1820 and / or a storage device 1840, such as a dynamic volatile memory and / or a non-volatile flash memory. In several exemplary embodiments, an external non-volatile flash memory may be used to store an operating system for the television. In at least one exemplary embodiment, a fast external dynamic volatile memory such as RAM may be used as working memory for video encoding and decoding operations, such as for MPEG-2 Part 2 (also known as ITU-T Recommendation H.262 and ISO / IEC 13818-2, also known as MPEG-2 Video), AVC, HEVC, EVC, VVC, AV1, etc.

[0308] Inputs to the elements of system 1800 may be provided via various input devices as shown in block 1890. Such input devices include, but are not limited to: (i) an RF section that may receive an RF signal transmitted over the air, for example, by a broadcaster, (ii) a composite input terminal, (iii) a USB input terminal, (iv) an HDMI input terminal, (v) a bus, such as a CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data Rate), FlexRay (ISO 17458), or Ethernet (ISO / IEC 802-3) bus when the present invention is implemented in the automotive field.

[0309] In various exemplary embodiments, the input device of block 1890 has associated corresponding input processing elements, as known in the art. For example, the RF portion may be associated with elements necessary for: (i) selecting a desired frequency (also referred to as selecting a signal, or band limiting a signal to a frequency band), (ii) down-converting the selected signal, (iii) again band limiting the frequency band to a narrower frequency band to select a signal frequency band that may be referred to as a channel in certain exemplary embodiments, (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select a desired packet stream. The RF portion of various exemplary embodiments may include one or more elements to perform these functions, such as a frequency selector, a signal selector, a band limiter, a channel selector, a filter, a down-converter, a demodulator, an error corrector, and a demultiplexer. The RF portion may include a tuner that performs various of these functions, including, for example, down-converting a received signal to a lower frequency (e.g., an intermediate frequency or a near-baseband frequency) or baseband.

[0310] In one set-top box embodiment, the RF section and its associated input processing elements can receive RF signals transmitted through a wired (e.g., cable) medium. The RF section can then perform frequency selection by filtering, down-converting, and filtering again to a desired frequency band.

[0311] Various exemplary embodiments rearrange the order of the above-described (and other) elements, remove some of the elements, and / or add other elements that perform similar or different functions.

[0312] Adding components may include inserting components between existing components, such as, for example, inserting an amplifier and an analog-to-digital converter.In various exemplary embodiments, the RF portion may include an antenna.

[0313] In addition, the USB and / or HDMI terminals may include corresponding interface processors for connecting the system 1800 to other electronic devices via USB and / or HDMI connections. It is to be understood that various aspects of input processing (e.g., Reed-Solomon error correction) may be implemented, for example, in a separate input processing IC or in the processor 1810, as necessary. Similarly, various aspects of USB or HDMI interface processing may be implemented in a separate interface IC or in the processor 1810, as necessary. The demodulated, error-corrected, and demultiplexed streams may be provided to various processing elements, including, for example, the processor 1810 and the encoder / decoder 1830, which operate in conjunction with memory and storage elements to process the data streams for presentation on an output device, as necessary.

[0314] The various components of the system 1800 may be provided in an integrated housing. Within the integrated housing, the various components may be interconnected and transmit data between them using appropriate connection arrangements 1890, such as internal buses (including I2C buses), wiring, and printed circuit boards known in the art.

[0315] The system 1800 may include a communication interface 1850 that can communicate with other devices via a communication channel 1851. The communication interface 1850 may include, but is not limited to, a transceiver configured to send and receive data through the communication channel 1851. The communication interface 1850 may include, but is not limited to, a modem or a network card, and the communication channel 1851 may be implemented, for example, in a wired and / or wireless medium.

[0316] In various exemplary embodiments, a Wi-Fi network such as IEEE 802.11 may be used to stream data to the system 1800. The Wi-Fi signals of these exemplary embodiments may be received on a communication channel 1851 and communication interface 1850 suitable for Wi-Fi communications. The communication channel 1851 of these exemplary embodiments may typically connect to an access point or router that provides access to external networks including the Internet to allow streaming applications and other over-the-top communications.

[0317] Other exemplary embodiments may provide streaming data to the system 1800 using a set-top box that passes data through the HDMI connection of the input block 1890 .

[0318] Still other exemplary embodiments may use the RF connection of input block 1890 to provide streaming data to system 1800 .

[0319] The streaming data may be used as a way of signaling information such as region transition information DT1 (as described above) used by the system 1800. The signaling information may include the bitstream BT1 and / or information such as the number of pixels of the video image and / or any encoding / decoding setting parameters.

[0320] It should be noted that signaling can be accomplished in various ways. For example, in various exemplary embodiments, one or more syntax elements, flags, etc. may be used to signal information to a corresponding decoder.

[0321] The system 1800 can provide output signals to various output devices, including a display 1861, speakers 1871, and other peripherals 1881. In various exemplary examples of embodiments, the other peripherals 1881 can include one or more of a stand-alone DVR, a disk player, a stereo system, a lighting system, and other devices that provide functionality based on the output of the system 1800.

[0322] In various exemplary embodiments, control signals may be communicated between the system 1800 and the display 1861, speakers 1871, or other peripheral devices 1881 using signaling such as AV.Link (Audio / Video Link), CEC (Consumer Electronics Control), or other communication protocols that enable device-to-device control with or without user intervention.

[0323] Output devices may be communicatively coupled to system 1800 via dedicated connections through respective interfaces 1860 , 1870 , and 1880 .

[0324] Alternatively, output devices may be connected to the system 1800 via the communication interface 1850 using the communication channel 1851. The display 1861 and the speaker 1871 may be integrated into a single unit with the other components of the system 1800 in an electronic device such as, for example, a television.

[0325] In various exemplary embodiments, the display interface 1860 may include a display driver such as, for example, a timing controller (TCon) chip.

[0326] The display 1861 and the speaker 1871 may optionally be separate from one or more of the other components, for example, if the RF portion of the input 1890 is part of a separate set-top box. In various exemplary embodiments, where the display 1861 and the speaker 1871 may be external components, the output signals may be provided via dedicated output connections (including, for example, an HDMI port, a USB port, or a COMP output).

[0327] exist Figure 1-16In the present invention, various methods are described herein, and each method includes one or more steps or actions to implement the method. Unless a specific order of steps or actions is required for the correct operation of the method, the order and / or use of specific steps and / or actions may be modified or combined.

[0328] Some examples are described with respect to block diagrams and / or operational flow charts. Each block represents a portion of a circuit element, module, or code, which includes one or more executable instructions for implementing (one or more) specified logical functions. It should also be noted that, in other embodiments, the (one or more) functions marked in the block may not occur in the order indicated. For example, two boxes shown in succession may actually be executed substantially concurrently, or sometimes the boxes may be executed in reverse order.

[0329] The embodiments and aspects described herein may be implemented in, for example, a method or process, an apparatus, a computer program, a data stream, a bit stream, or a signal. Even if only discussed in the context of a single form of embodiment (e.g., discussed only as a method), the embodiments of the discussed features may also be implemented in other forms (e.g., an apparatus or a computer program).

[0330] The method may be implemented in a processor, for example, a processor generally refers to a processing device, such as a computer, a microprocessor, an integrated circuit or a programmable logic device. A processor also includes a communication device.

[0331] Furthermore, the methods may be implemented by instructions executed by a processor, and such instructions (and / or data values ​​produced by the embodiments) may be stored on a computer-readable storage medium, such as storage device 1840 ( Fig.16 ). The computer-readable storage medium may take the form of a computer-readable program product implemented in one or more computer-readable media and having a computer-readable program code implemented thereon that can be executed by a computer. Computer-readable storage media as used herein may be considered to be non-transitory storage media, given the inherent ability to store information therein and the inherent ability to provide retrieval of information therefrom. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system, device or apparatus, or any suitable combination of the foregoing. It should be appreciated that the following, although more specific examples of computer-readable storage media to which the present exemplary embodiment may be applied are provided, are merely illustrative and non-exhaustive lists, as those of ordinary skill in the art will readily appreciate: portable computer floppy disk; hard disk; read-only memory (ROM); erasable programmable read-only memory (EPROM or flash memory); portable compact disk read-only memory (CD-ROM); optical storage device; magnetic storage device; or any suitable combination of the foregoing.

[0332] The instructions may form an application program tangibly embodied on a processor-readable medium.

[0333] For example, instructions may be in hardware, firmware, software, or a combination. For example, instructions may be found in an operating system, a separate application, or a combination of both. Thus, a processor may be characterized as, for example, a device configured to perform a process and a device including a processor-readable medium (such as a storage device) having instructions for performing the process. Additionally, in addition to or in lieu of instructions, a processor-readable medium may store data values ​​generated by an embodiment.

[0334] Device can be realized in suitable hardware, software and firmware for example.The example of such device comprises personal computer, laptop computer, smart phone, tablet computer, digital multimedia set-top box, digital television receiver, personal video recording system, connected household appliances, head-mounted display device (HMD, perspective glasses), projector (projector), "cave" (system including multiple displays), server, video encoder, video decoder, post-processor for processing the output from video decoder, pre-processor for providing input to video encoder, web server, set-top box, and any other equipment for processing video image, or other communication equipment.It should be clear that equipment can be mobile and even installed in a mobile vehicle.

[0335] The computer software may be implemented by the processor 1810 or by hardware, or by a combination of hardware and software. As a non-limiting example, the exemplary embodiments may also be implemented by one or more integrated circuits. The memory 1820 may be of any type suitable for the technical environment and may be implemented using any appropriate data storage technology (such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory, and removable memory, as non-limiting examples). The processor 1810 may be of any type suitable for the technical environment and may encompass one or more of a microprocessor, a general-purpose computer, a special-purpose computer, and a processor based on a multi-core architecture, as non-limiting examples.

[0336] As will be apparent to one of ordinary skill in the art based on this application, embodiments may generate various signals formatted to carry information that may be stored or transmitted, for example. The information may include, for example, instructions for executing a method or data generated by one of the described embodiments. For example, a signal may be formatted to carry a bit stream of the described exemplary embodiments. Such a signal may be formatted, for example, as an electromagnetic wave (e.g., using a radio frequency portion of a spectrum) or a baseband signal. Formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information carried by the signal may be, for example, analog or digital information. As is known, the signal may be transmitted over a variety of different wired or wireless links. The signal may be stored on a processor-readable medium.

[0337] The terms used herein are only used to describe the purpose of specific exemplary embodiments and are not intended to be limited. As used herein, the singular forms "one", "a kind of" and "the" may also be intended to include plural forms unless the context clearly indicates otherwise. It will be further understood that when used in this specification, the terms "include / comprise" and / or "including / comprising" may specify the existence of stated, for example, features, integers, steps, operations, elements and / or components, but do not exclude the existence or addition of one or more other features, integers, steps, operations, elements, components and / or their groups. Moreover, when an element is referred to as "response" or "connection" or "associated with" to another element, it may directly respond or be connected to or be associated with another element, or there may be an intermediate element. On the contrary, when an element is referred to as "direct response" or "direct connection to" or "directly associated with" another element, there is no intermediate element.

[0338] It should be appreciated that use of any of the symbols / terms " / ", "and / or", and "at least one of" may be intended to encompass selection of only the first listed option (A), or only the second listed option (B), or both options (A and B), such as in the case of "A / B", "A and / or B", and "at least one of A and B". As a further example, in the case of "A, B, and / or C" and "at least one of A, B, and C", such wording is intended to encompass selection of only the first listed option (A), or only the second listed option (B), or only the third listed option (C), or only the first and second listed options (A and B), or only the first and third listed options (A and C), or only the second and third listed options (B and C), or all three options (A and B and C). This may be extended to as many items as listed, as will be apparent to one of ordinary skill in this and related arts.

[0339] Various numerical values ​​may be used in the present application. Specific values ​​may be used for example purposes and the described aspects are not limited to these specific values.

[0340] It will be understood that although the terms first, second, etc. can be used to describe various elements in this article, these elements are not limited by these terms. These terms are only used to distinguish one element from another element. For example, without departing from the teachings in this application, the first element can be referred to as the second element, and similarly, the second element can be referred to as the first element. There is no suggestion of sorting between the first element and the second element.

[0341] References to "an exemplary embodiment" or "exemplary embodiments" or "one implementation" or "implementation" and other variations thereof are frequently used to convey that a particular feature, structure, characteristic, etc. (described in conjunction with an embodiment / implementation) is included in at least one embodiment / implementation. Thus, the appearances of the phrases "in an exemplary embodiment" or "in an exemplary embodiment" or "in one implementation" or "in an implementation" and any other variations appearing in various places in this application do not necessarily all refer to the same exemplary embodiment.

[0342] Similarly, references herein to "according to an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation" and other variations thereof are frequently used to convey that a particular feature, structure, or characteristic (described in conjunction with an exemplary embodiment / example / implementation) may be included in at least one exemplary embodiment / example / implementation. Therefore, the expressions "according to an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation" appearing in various places in this application do not necessarily all refer to the same exemplary embodiment / example / implementation, nor are separate or alternative exemplary embodiments / examples / implementations necessarily mutually exclusive of other exemplary embodiments / examples / implementations.

[0343] Reference numerals appearing in the claims are for illustration purposes only and have no limiting effect on the scope of the claims.The present exemplary embodiments / examples and variants may be employed in any combination or sub-combination although not explicitly described.

[0344] When a figure is presented as a flow chart, it should be understood that it also provides a block diagram of the corresponding apparatus. Similarly, when a figure is presented as a block diagram, it should be understood that it also provides a flow chart of the corresponding method / process.

[0345] While some diagrams include arrows on communication paths to illustrate a primary direction of communication, it should be understood that communication can occur in the opposite direction to the depicted arrows.

[0346] Various embodiments relate to decoding. As used in this application, "decoding" may encompass, for example, all or part of a process performed on a received video image (which may include a received bitstream encoding one or more video images) to produce a final output suitable for display or further processing in a reconstructed video domain. In various exemplary embodiments, such a process includes one or more of the processes typically performed by a decoder. In various exemplary embodiments, for example, such a process also or alternatively includes a process performed by a decoder of the various embodiments described in this application.

[0347] As a further example, in one exemplary embodiment, "decoding" may refer only to dequantization, in one exemplary embodiment, "decoding" may refer to entropy decoding, in another exemplary embodiment, "decoding" may refer only to differential decoding, and in another embodiment, "decoding" may refer to a combination of dequantization, entropy decoding, and differential decoding. Based on the context of the specific description, whether the phrase "decoding process" may be intended to specifically refer to a subset of operations, or generally refer to a broader decoding process will be clear and is believed to be well understood by those skilled in the art.

[0348] Various embodiments are all related to encoding. In a manner similar to the above discussion about "decoding", "encoding" as used in this application can cover all or part of a process performed, for example, on an input video image to produce an output bitstream. In various exemplary embodiments, such a process includes one or more of the processes typically performed by an encoder. In various exemplary embodiments, such a process also includes or optionally includes a process performed by an encoder of the various embodiments described in this application.

[0349] As a further example, in one exemplary embodiment, "encoding" may refer only to quantization, in one exemplary embodiment, "encoding" may refer only to entropy coding, in another exemplary embodiment, "encoding" may refer only to differential coding, and in another exemplary embodiment, "encoding" may refer to a combination of quantization, differential coding, and entropy coding. Based on the context of the particular description, whether the phrase "encoding process" may be intended to specifically refer to a subset of operations, or to generally refer to a broader encoding process will be clear and is believed to be well understood by those skilled in the art.

[0350] Additionally, the present application may refer to "obtaining" various information. Obtaining information may include, for example, one or more of estimating information, calculating information, predicting information, or retrieving information from a memory, processing information, moving information, copying information, clearing information, calculating information, determining information, predicting information, or estimating information.

[0351] Additionally, this application may refer to "receiving" various information. Receiving information may include one or more of, for example, accessing the information or retrieving the information (eg, from a memory).

[0352] Moreover, as used herein, the word "signaling" especially refers to indicating something to a corresponding decoder, etc. For example, in some exemplary embodiments, the encoder signals specific information, such as encoding parameters or encoded video image data. In this way, in exemplary embodiments, the same parameter can be used on the encoder side and the decoder side. Therefore, for example, the encoder can transmit (explicit signaling) specific parameters to the decoder so that the decoder can use the same specific parameters. On the contrary, if the decoder already has specific parameters and other parameters, signaling can be used without transmission (implicit signaling) to simply allow the decoder to know and select specific parameters. By avoiding the transmission of any actual function, bit saving is achieved in various exemplary embodiments. It should be recognized that signaling can be completed in a variety of ways. For example, in various exemplary embodiments, one or more syntax elements, flags, etc. are used to signal information to the corresponding decoder. Although the verb form of the word "signaling (signal)" is mentioned above, the word "signal" can also be used as a noun in this article.

[0353] A number of embodiments have been described. However, it should be understood that various modifications may be made. For example, elements of different embodiments may be combined, supplemented, modified, or removed to produce other embodiments. In addition, it will be understood by those of ordinary skill that other structures and processes may replace the disclosed structures and processes, and that the resulting embodiments will perform at least substantially the same (one or more) functions in at least substantially the same (one or more) manners to achieve at least substantially the same (one or more) results as the disclosed embodiments. Thus, the present application contemplates these and other embodiments.

Claims

1. A method for encoding a video picture (PCT1) comprising at least one picture region, the method comprising: - selecting a transformation mode (MDS), the transformation mode defining a combination of at least one flipping operation and at least one rotation operation on said at least one picture region; - based on the selected conversion mode (MDS), converting (504) the at least one picture region into at least one converted picture region; as well as - encoding (506) at least one converted picture region into a bitstream (BT1) of coded video picture data. 2 . The method according to claim 1 , wherein the at least one rotation operation is a rotation of 90°, 180° or 270°.

3. The method according to claim 1 or 2, wherein: The conversion mode is selected from a list of candidate conversion modes obtained by: - obtaining (1002) an at least partially converted picture region by converting the at least one picture region with a candidate conversion mode (MD); as well as - When a distance between a main direction (DR1) determined from the at least partially converted picture region and a target direction (DR0) of at least one picture region meets a threshold (TH1), adding (1004) the candidate conversion mode to a list of candidate conversion modes.

4. The method according to claim 3, wherein: A transition mode (MDS) is selected from the candidate transition mode list by minimizing (1008) a rate-distortion tradeoff.

5. The method according to any one of claims 1 to 4, wherein: If the main direction (DR1) determined from at least part of the converted picture area is vertical and / or horizontal, a conversion mode is selected (1306) by aligning the main direction with a boundary of the coding unit CU.

6. A method according to any one of claims 1 to 5, wherein the method further comprises signalling (160) region conversion information (DT1) into a bit stream (BT1) of the encoded video picture data, the region conversion information (DT1) indicating that at least one picture region of the video picture is converted according to a conversion mode.

7. The method according to claim 6, wherein: The region transformation information (DT1) further defines said transformation mode (MDS) selected for transforming at least one picture region of a video picture.

8. A method for decoding a video picture (PCT1) from a bit stream (BT1) of coded video picture data, wherein the method comprises: - obtaining (1402) a decoded video picture by decoding the encoded video image data from a bit stream of the encoded video picture data; as well as - obtaining (1404) a video picture by deconverting at least one picture region of the decoded video picture according to a conversion mode (MDS), wherein the conversion mode defines a combination of at least one flipping operation and at least one rotation operation on said picture region.

9. The method according to claim 8, wherein the method further comprises: - parsing the region conversion information (DT1) in the bit stream (BT1) of the encoded video image data; as well as - Based on the region conversion information, determine a conversion mode (MDS), and deconvert at least one picture region according to the conversion mode.

10. The method according to claim 8 or 9, wherein the at least one rotation operation is a rotation of 90°, 180° or 270°.

11. A bit stream (BT1) formatted to include encoded video image data and region conversion information obtained according to one of the methods of claim 6 or 7.

12. An apparatus (1800) for encoding a video picture (PCT1) into a bitstream (BT1) of coded video picture data, the apparatus comprising means for performing one of the methods as claimed in any one of claims 1 to 7.

13. An apparatus (1800) for video decoding of a video picture (PCT1) from a bit stream (BT1) of coded video picture data, the apparatus comprising means for performing one of the methods as claimed in any one of claims 8 to 10.

14. A computer program product comprising instructions, which, when executed by one or more processors, cause the one or more processors to perform the method according to any one of claims 1 to 10. A non-transitory storage medium carrying program code instructions for executing the method as claimed in any one of claims 1 to 10.

Citation Information

Patent Citations

  • Image decoding device and method thereof using inter-coded predictive encoding code

    US9549195B2

  • Adaptive region-based flipping video coding

    WO2008024345A1

  • Adaptive picture rotation

    WO2012121744A1

  • A method for encoding an input video comprising a luma component and two chroma components, the method comprising reshaping of said input video based on reshaping functions

    CN109155859A

  • Method and device for image encoding / decoding, and recording medium for storing bit stream

    CN112106373A