Method and apparatus for inter-prediction signal-based cross-component prediction
By using motion information to generate prediction signals and derive filter coefficients for chroma blocks in inter-component prediction within IBC and IntraTMP modes, the method enhances video coding efficiency and quality, addressing the challenges of increasing video data sizes and improving chroma component encoding.
Patent Information
- Application Number
- PCT/KR2024/003837
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-26
- Filing Date
- 2024-03-27
- Publication Date
- 2024-11-21
AI Technical Summary
Current video coding technologies face challenges in efficiently encoding and decoding video data due to increasing data sizes, requiring improved compression methods that enhance coding efficiency and picture quality, especially when predicting chroma components from luma components in inter prediction modes.
The method involves generating prediction signals for chroma blocks using motion information, deriving filter coefficients from luma prediction signals, and applying these coefficients to luma restoration samples to improve inter-component prediction, specifically in IBC and IntraTMP modes, thereby enhancing encoding performance and video quality.
This approach improves the encoding efficiency of chroma components and overall video quality by effectively utilizing motion information for inter-component prediction, leading to better compression performance and picture quality.
Smart Images

Figure KR2024003837_21112024_PF_FP_ABST
Abstract
Description
Method and device for inter-component prediction based on inter-prediction signal
[0001] The present disclosure relates to a video coding method and device using inter-component prediction based on an inter prediction signal.
[0002] The content described below merely provides background information related to the present invention and does not constitute prior art.
[0003] Since video data has a large amount of data compared to voice data or still image data, it requires a lot of hardware resources, including memory, to store or transmit it without processing for compression.
[0004] Therefore, when storing or transmitting video data, an encoder is used to compress the video data and store or transmit it, and a decoder receives the compressed video data, decompresses it, and plays it back. Examples of such video compression technologies include H.264 / AVC, HEVC (High Efficiency Video Coding), and VVC (Versatile Video Coding), which improves encoding efficiency by about 30% compared to HEVC.
[0005] However, as the size, resolution, and frame rate of images are gradually increasing, and the amount of data that needs to be encoded is also increasing, a new compression technology that has better encoding efficiency and better image quality improvement than existing compression technologies is required.
[0006] In the next-generation technology, the Enhanced Compression Model (ECM), the Cross-component Residual Model (CCRM) mode is applied to predict chroma components when the corresponding luma block in a single tree is predicted according to the inter prediction or IBC (Intra Block Copy) mode. The CCRM mode derives convolutional filter coefficients based on the relationship between the prediction signals of the corresponding luma components and the prediction signals of the chroma components. The CCRM mode applies the derived filter to the reconstructed signals of the corresponding luma components to predict chroma components.
[0007] In AV1, an open-source video codec, the CFL (Chroma from Luma) mode predicts the AC component of the chroma component using the AC (Alternative Current) component of the reconstructed luma component during intra prediction. The CFL mode generates the AC component of the luma component by subtracting the average, or DC (Direct Current), from the reconstructed luma component. The CFL mode predicts the AC component of the chroma component by multiplying the AC component of the luma component by a scaling parameter, and estimates the DC component of the chroma component using reference samples. The CFL mode adds the predicted DC and AC components to generate the final predicted signals of the chroma component.
[0008] As mentioned above, CCRM mode is applied to inter-component prediction in a single-tree structure, while CFL mode is applied to inter-component prediction in intra-prediction. Therefore, to improve video encoding efficiency and enhance video quality, a method is needed to efficiently utilize corresponding luma components in various environments during inter-component prediction for chroma components.
[0009] The present disclosure aims to provide a video coding method and device for inter-predicting chroma components based on signals predicted according to motion information when a corresponding luma block is encoded in inter prediction, IBC (Intra Block Copy) mode, or IntraTMP (Intra Template Matching Prediction) mode.
[0010] According to an embodiment of the present disclosure, a method for restoring a current chroma block, performed by a video decoding device, is provided, characterized in that the method comprises: generating first prediction signals of the current chroma block using motion information, wherein the motion information is a motion vector or a block vector; obtaining luma prediction signals and luma reconstruction samples of luma blocks in a corresponding luma region; deriving filter coefficients for inter-component prediction of the current chroma block using the luma prediction signals and the first prediction signals; and generating second prediction signals of the current chroma block by applying the filter coefficients to the luma reconstruction samples.
[0011] According to another embodiment of the present disclosure, a method for encoding a current chroma block, performed by a video encoding apparatus, is provided, characterized in that the method comprises: generating first prediction signals of the current chroma block using motion information, wherein the motion information is a motion vector or a block vector; obtaining luma prediction signals and luma reconstruction samples of luma blocks in a corresponding luma region; deriving filter coefficients for inter-component prediction of the current chroma block using the luma prediction signals and the first prediction signals; and generating second prediction signals of the current chroma block by applying the filter coefficients to the luma reconstruction samples.
[0012] According to another embodiment of the present disclosure, a computer-readable recording medium storing a bitstream generated by a video encoding method is provided, characterized in that the video encoding method comprises: generating first prediction signals of a current chroma block using motion information, wherein the motion information is a motion vector or a block vector; obtaining luma prediction signals and luma reconstruction samples of luma blocks in a corresponding luma region; deriving filter coefficients for inter-component prediction of the current chroma block using the luma prediction signals and the first prediction signals; and generating second prediction signals of the current chroma block by applying the filter coefficients to the luma reconstruction samples.
[0013] As described above, according to the present embodiment, when a corresponding luma block is encoded in inter prediction, IBC mode, or IntraTMP mode, a video coding method and device for inter-predicting chroma components based on signals predicted according to motion information are provided, thereby improving encoding performance of chroma components, improving video encoding efficiency, and improving video quality.
[0014] FIG. 1 is an exemplary block diagram of an image encoding device capable of implementing the techniques of the present disclosure.
[0015] Figure 2 is a drawing for explaining a method of dividing a block using the QTBTTT (QuadTree plus BinaryTree TernaryTree) structure.
[0016] FIGS. 3A and 3B are diagrams illustrating multiple intra prediction modes, including wide-angle intra prediction modes.
[0017] Figure 4 is an example diagram of the surrounding blocks of the current block.
[0018] FIG. 5 is an exemplary block diagram of an image decoding device capable of implementing the techniques of the present disclosure.
[0019] Figure 6 is an example diagram showing the prediction of chroma components according to the CCRM (Cross-component Residual Model) mode.
[0020] Figure 7 is an example diagram showing restored signals of luma components to which a convolution filter is applied.
[0021] Figure 8 is an example diagram showing prediction of chroma components according to CFL (Chroma from Luma) mode.
[0022] FIG. 9 is a block diagram illustrating in detail a portion of an image decoding device according to one embodiment of the present disclosure.
[0023] FIG. 10 is a block diagram illustrating in detail a prediction execution unit according to one embodiment of the present disclosure.
[0024] FIG. 11 is an exemplary diagram showing a restored sample area used for deriving a scaling parameter according to one embodiment of the present disclosure.
[0025] FIGS. 12A to 12C are exemplary diagrams showing a restored sample area used for deriving a scaling parameter according to another embodiment of the present disclosure.
[0026] FIG. 13 is an exemplary diagram showing the derivation of a scaling parameter according to one embodiment of the present disclosure.
[0027] FIG. 14 is an exemplary diagram showing restoration signals of a luma component to which a convolution filter is applied, according to one embodiment of the present disclosure.
[0028] FIG. 15 is an exemplary diagram showing inter-component prediction of chroma components according to one embodiment of the present disclosure.
[0029] FIG. 16 is an exemplary diagram showing a predefined location within a corresponding luma area according to one embodiment of the present disclosure.
[0030] FIG. 17 is an exemplary diagram showing locations for checking the prediction mode of a surrounding block according to one embodiment of the present disclosure.
[0031] FIG. 18 is a flowchart illustrating a method by which a video encoding device encodes a current chroma block according to one embodiment of the present disclosure.
[0032] FIG. 19 is a flowchart illustrating a method by which a video decoding device restores a current chroma block according to one embodiment of the present disclosure.
[0033] FIG. 20 is a flowchart illustrating a method by which a video encoding device encodes a current chroma block according to another embodiment of the present disclosure.
[0034] FIG. 21 is a flowchart illustrating a method for a video decoding device to restore a current chroma block according to another embodiment of the present disclosure.
[0035] Hereinafter, embodiments of the present invention will be described in detail with reference to exemplary drawings. When designating components in each drawing, it should be noted that, where possible, identical components are given the same reference numerals, even if they appear in different drawings. Furthermore, in describing the present embodiments, detailed descriptions of related known structures or functions will be omitted if they are deemed to obscure the gist of the present embodiments.
[0036] FIG. 1 is an exemplary block diagram of an image encoding device capable of implementing the techniques of the present disclosure. Hereinafter, the image encoding device and its subcomponents will be described with reference to the illustration in FIG. 1.
[0037] The video encoding device may be configured to include a picture segmentation unit (110), a prediction unit (120), a subtractor (130), a transformation unit (140), a quantization unit (145), a reordering unit (150), an entropy encoding unit (155), an inverse quantization unit (160), an inverse transformation unit (165), an adder (170), a loop filter unit (180), and a memory (190).
[0038] Each component of the video encoding device may be implemented in hardware, software, or a combination of hardware and software. Furthermore, the functions of each component may be implemented in software, with a microprocessor executing the software functions corresponding to each component.
[0039] A single image (video) is composed of one or more sequences containing multiple pictures. Each picture is divided into multiple regions, and encoding is performed for each region. For example, a single picture is divided into one or more tiles and / or slices. Here, one or more tiles can be defined as a tile group. Each tile or slice is divided into one or more Coding Tree Units (CTUs). Each CTU is then divided into one or more Coding Units (CUs) by a tree structure. Information applied to each CU is encoded as the syntax of the CU, and information commonly applied to CUs included in a CTU is encoded as the syntax of the CTU. In addition, information commonly applied to all blocks within a single slice is encoded as the syntax of the slice header, and information applied to all blocks constituting one or more pictures is encoded in the Picture Parameter Set (PPS) or the picture header. Furthermore, information commonly referenced by multiple pictures is encoded in a Sequence Parameter Set (SPS). And, information commonly referenced by one or more SPS is encoded in a Video Parameter Set (VPS). In addition, information commonly applied to one tile or tile group may be encoded as syntax of a tile or tile group header. Syntaxes included in an SPS, PPS, slice header, tile or tile group header may be referred to as high level syntax.
[0040] The picture segmentation unit (110) determines the size of the CTU. Information about the size of the CTU (CTU size) is encoded as the syntax of SPS or PPS and transmitted to the image decoding device.
[0041] The picture segmentation unit (110) divides each picture constituting an image into a plurality of CTUs having a predetermined size, and then recursively divides the CTUs using a tree structure. A leaf node in the tree structure becomes a CU, which is a basic unit of encoding.
[0042] The tree structure may be a QuadTree (QT) in which an upper node (or parent node) is divided into four lower nodes (or child nodes) of the same size, a BinaryTree (BT) in which an upper node is divided into two lower nodes, or a TernaryTree (TT) in which an upper node is divided into three lower nodes in a 1:2:1 ratio, or a structure that mixes two or more of the QT structures, BT structures, and TT structures. For example, a QTBT (QuadTree plus BinaryTree) structure may be used, or a QTBTTT (QuadTree plus BinaryTree TernaryTree) structure may be used. Here, BTTT may be combined and referred to as a MTT (Multiple-Type Tree).
[0043] Figure 2 is a drawing for explaining a method of dividing a block using the QTBTTT structure.
[0044] As illustrated in FIG. 2, a CTU may first be split into a QT structure. The quadtree splitting may be repeated until the size of the splitting block reaches the minimum block size (MinQTSize) of the leaf node allowed in the QT. A first flag (QT_split_flag) indicating whether each node of the QT structure is split into four nodes of the lower layer is encoded by the entropy encoding unit (155) and signaled to the image decoding device. If the leaf node of the QT is not larger than the maximum block size (MaxBTSize) of the root node allowed in the BT, it may be further split into one or more of the BT structure or the TT structure. There may be multiple splitting directions in the BT structure and / or the TT structure. For example, there may be two directions in which the block of the corresponding node is split horizontally and two directions in which the block is split vertically. As illustrated in FIG. 2, when MTT splitting begins, a second flag (mtt_split_flag) indicating whether nodes have been split, and if splitting has occurred, a flag indicating the splitting direction (vertical or horizontal) and / or a flag indicating the splitting type (Binary or Ternary) are encoded by the entropy encoding unit (155) and signaled to the image decoding device.
[0045] Alternatively, before encoding the first flag (QT_split_flag) indicating whether each node is split into four nodes of a lower layer, a CU split flag (split_cu_flag) indicating whether the node is split may be encoded. If the CU split flag (split_cu_flag) value indicates that the node is not split, the block of the corresponding node becomes a leaf node in the split tree structure and becomes a CU (coding unit), which is a basic unit of encoding. If the CU split flag (split_cu_flag) value indicates that the node is split, the video encoding device starts encoding from the first flag in the above-described manner.
[0046] As another example of a tree structure, when QTBT is used, there may be two types: a type that horizontally splits the block of the corresponding node into two blocks of the same size (i.e., symmetric horizontal splitting) and a type that vertically splits it (i.e., symmetric vertical splitting). A split flag (split_flag) indicating whether each node of the BT structure is split into blocks of a lower layer and split type information indicating the type of split are encoded by the entropy encoding unit (155) and transmitted to the image decoding device. Meanwhile, there may additionally be a type that splits the block of the corresponding node into two blocks of an asymmetrical shape. The asymmetric shape may include a shape that splits the block of the corresponding node into two rectangular blocks with a size ratio of 1:3, or a shape that splits the block of the corresponding node in a diagonal direction.
[0047] A CU can have various sizes depending on the QTBT or QTBTTT partitioning from the CTU. Hereinafter, the block corresponding to the CU to be encoded or decoded (i.e., the leaf node of the QTBTTT) is referred to as the "current block." Depending on the QTBTTT partitioning employed, the current block may be rectangular as well as square.
[0048] The prediction unit (120) predicts the current block and generates a prediction block. The prediction unit (120) includes an intra prediction unit (122) and an inter prediction unit (124).
[0049] In general, each current block within a picture can be predictively coded. Prediction of the current block can typically be performed using either intra-prediction (using data from the picture containing the current block) or inter-prediction (using data from a picture coded before the picture containing the current block). Inter-prediction encompasses both unidirectional and bidirectional prediction.
[0050] The intra prediction unit (122) predicts pixels within the current block using pixels (reference pixels) located around the current block within the current picture including the current block. There are multiple intra prediction modes depending on the prediction direction. For example, as shown in Fig. 3a, the multiple intra prediction modes may include two non-directional modes including the Planar mode and the DC mode, and 65 directional modes. The surrounding pixels to be used and the calculation formula are defined differently depending on each prediction mode.
[0051] For efficient directional prediction for a rectangular current block, directional modes (intra prediction modes 67 to 80 and -1 to -14) indicated by dotted arrows in Fig. 3b may be additionally used. These may be referred to as "wide-angle intra-prediction modes." In Fig. 3b, the arrows point to corresponding reference samples used for prediction, and do not indicate the prediction direction. The prediction direction is opposite to the direction indicated by the arrows. Wide-angle intra-prediction modes are modes that perform prediction in the opposite direction of a specific directional mode without additional bit transmission when the current block is rectangular. At this time, among the wide-angle intra-prediction modes, some wide-angle intra-prediction modes available for the current block may be determined based on the ratio of the width and height of the rectangular current block. For example, wide-angle intra prediction modes (intra prediction modes 67 to 80) having an angle less than 45 degrees are available when the current block is a rectangular shape whose height is smaller than its width, and wide-angle intra prediction modes (intra prediction modes -1 to -14) having an angle greater than -135 degrees are available when the current block is a rectangular shape whose width is larger than its height.
[0052] The intra prediction unit (122) can determine an intra prediction mode to be used to encode the current block. In some examples, the intra prediction unit (122) can encode the current block using multiple intra prediction modes and select an appropriate intra prediction mode to be used from the tested modes. For example, the intra prediction unit (122) can calculate bit-rate distortion values using rate-distortion analysis for multiple tested intra prediction modes and select an intra prediction mode with the best bit-rate distortion characteristics among the tested modes.
[0053] The intra prediction unit (122) selects one intra prediction mode from among multiple intra prediction modes and predicts the current block using surrounding pixels (reference pixels) and an operation formula determined according to the selected intra prediction mode. Information about the selected intra prediction mode is encoded by the entropy encoding unit (155) and transmitted to the image decoding device.
[0054] The inter prediction unit (124) generates a prediction block for the current block using a motion compensation process. The inter prediction unit (124) searches for a block most similar to the current block within reference pictures that were encoded and decoded before the current picture, and generates a prediction block for the current block using the searched block. Then, a motion vector (MV) corresponding to the displacement between the current block within the current picture and the prediction block within the reference picture is generated. Generally, motion estimation is performed on the luma component, and the motion vector calculated based on the luma component is used for both the luma component and the chroma component. The motion information including information on the reference picture used to predict the current block and information on the motion vector is encoded by the entropy encoding unit (155) and transmitted to the image decoding device.
[0055] The inter prediction unit (124) may perform interpolation on a reference picture or a reference block to improve prediction accuracy. That is, subsamples between two consecutive integer samples are interpolated by applying filter coefficients to a plurality of consecutive integer samples including the two integer samples. When a process of searching for a block most similar to the current block is performed on the interpolated reference picture, the motion vector can be expressed up to a precision in decimal units rather than a precision in integer sample units. The precision or resolution of the motion vector can be set differently for each target region to be encoded, such as a slice, tile, CTU, CU, etc. When such adaptive motion vector resolution (AMVR) is applied, information on the motion vector resolution to be applied to each target region must be signaled for each target region. For example, when the target region is a CU, information on the motion vector resolution applied to each CU is signaled. Information on the motion vector resolution may be information indicating the precision of a differential motion vector, which will be described later.
[0056] Meanwhile, the inter prediction unit (124) can perform inter prediction using bi-prediction. In the case of bi-prediction, two reference pictures and two motion vectors indicating the block position most similar to the current block within each reference picture are used. The inter prediction unit (124) selects a first reference picture and a second reference picture from reference picture list 0 (RefPicList0) and reference picture list 1 (RefPicList1), respectively, and searches for a block similar to the current block within each reference picture to generate a first reference block and a second reference block. Then, the first reference block and the second reference block are averaged or weighted averaged to generate a prediction block for the current block. Then, motion information including information on two reference pictures used to predict the current block and information on two motion vectors is transmitted to the entropy encoding unit (155). Here, reference picture list 0 may be composed of pictures that are before the current picture in display order among the restored pictures, and reference picture list 1 may be composed of pictures that are after the current picture in display order among the restored pictures. However, this is not necessarily limited to this, and restored pictures that are after the current picture in display order may be additionally included in reference picture list 0, and conversely, restored pictures that are before the current picture may be additionally included in reference picture list 1.
[0057] Various methods can be used to minimize the number of bits required to encode motion information.
[0058] For example, if the reference picture and motion vector of the current block are identical to those of a neighboring block, the motion information of the current block can be transmitted to the image decoding device by encoding information that can identify the neighboring block. This method is called 'merge mode'.
[0059] In merge mode, the inter prediction unit (124) selects a predetermined number of merge candidate blocks (hereinafter referred to as 'merge candidates') from the surrounding blocks of the current block.
[0060] As the surrounding blocks for deriving merge candidates, all or part of the left block (A0), the lower left block (A1), the upper block (B0), the upper right block (B1), and the upper left block (B2) adjacent to the current block within the current picture may be used, as illustrated in FIG. 4. In addition, a block located within a reference picture (which may or may not be the same as the reference picture used to predict the current block) other than the current picture in which the current block is located may be used as a merge candidate. For example, a block co-located with the current block within the reference picture or blocks adjacent to the block at the co-located block may be additionally used as a merge candidate. If the number of merge candidates selected by the method described above is less than a preset number, a 0 vector is added to the merge candidates.
[0061] The inter prediction unit (124) uses these surrounding blocks to construct a merge list containing a predetermined number of merge candidates. Among the merge candidates included in the merge list, the merge candidate to be used as motion information of the current block is selected and merge index information for identifying the selected candidate is generated. The generated merge index information is encoded by the entropy encoding unit (155) and transmitted to the video decoding device.
[0062] Merge Skip mode is a special case of merge mode. After quantization, when all transform coefficients for entropy encoding are close to zero, only neighboring block selection information is transmitted without transmitting residual signals. By utilizing merge skip mode, relatively high encoding efficiency can be achieved for low-motion images, still images, and screen content images.
[0063] Hereinafter, merge mode and merge skip mode are collectively referred to as merge / skip mode.
[0064] Another method for encoding motion information is Advanced Motion Vector Prediction (AMVP) mode.
[0065] In AMVP mode, the inter prediction unit (124) derives predicted motion vector candidates for the motion vector of the current block using neighboring blocks of the current block. As neighboring blocks used to derive predicted motion vector candidates, all or some of the left block (A0), the lower left block (A1), the upper block (B0), the upper right block (B1), and the upper left block (B2) adjacent to the current block in the current picture as shown in FIG. 4 may be used. In addition, a block located in a reference picture (which may or may not be the same as the reference picture used to predict the current block) other than the current picture in which the current block is located may be used as the neighboring block used to derive predicted motion vector candidates. For example, a block co-located with the current block in the reference picture or blocks adjacent to the block in the co-located block may be used. If the number of motion vector candidates is less than a preset number by the method described above, a 0 vector is added to the motion vector candidates.
[0066] The inter prediction unit (124) derives predicted motion vector candidates using the motion vectors of these surrounding blocks, and determines a predicted motion vector for the motion vector of the current block using the predicted motion vector candidates. Then, the predicted motion vector is subtracted from the motion vector of the current block to produce a differential motion vector.
[0067] The predicted motion vector can be obtained by applying a predefined function (e.g., median, mean, etc.) to the predicted motion vector candidates. In this case, the image decoding device also knows the predefined function. In addition, since the surrounding blocks used to derive the predicted motion vector candidates are blocks that have already been encoded and decoded, the image decoding device also already knows the motion vectors of the surrounding blocks. Therefore, the image encoding device does not need to encode information to identify the predicted motion vector candidates. Therefore, in this case, information about the differential motion vector and information about the reference picture used to predict the current block are encoded.
[0068] Alternatively, the predicted motion vector can be determined by selecting one of the predicted motion vector candidates. In this case, information for identifying the selected predicted motion vector candidate is additionally encoded, along with information about the differential motion vector and the reference picture used to predict the current block.
[0069] The subtractor (130) subtracts the prediction block generated by the intra prediction unit (122) or inter prediction unit (124) from the current block to generate a residual block.
[0070] The transformation unit (140) transforms residual signals within a residual block having pixel values in a spatial domain into transform coefficients in a frequency domain. The transformation unit (140) may transform the residual signals within the residual block using the entire size of the residual block as a transformation unit, or may divide the residual block into a plurality of sub-blocks and use the sub-blocks as transformation units to perform the transformation. Alternatively, the residual signals may be transformed using only the transformation domain sub-block as a transformation unit by dividing the sub-blocks into two sub-blocks, that is, a transformation domain and a non-transform domain. Here, the transformation domain sub-block may be one of two rectangular blocks having a size ratio of 1:1 with respect to the horizontal axis (or vertical axis). In this case, a flag (cu_sbt_flag) indicating that only a sub-block has been converted, directionality (vertical / horizontal) information (cu_sbt_horizontal_flag), and / or position information (cu_sbt_pos_flag) are encoded by the entropy encoding unit (155) and signaled to the image decoding device. In addition, the size of the conversion area sub-block may have a size ratio of 1:3 with respect to the horizontal axis (or vertical axis), and in this case, a flag (cu_sbt_quad_flag) distinguishing the corresponding division is additionally encoded by the entropy encoding unit (155) and signaled to the image decoding device.
[0071] Meanwhile, the transformation unit (140) can individually perform transformations on the residual block in the horizontal and vertical directions. For the transformation, various types of transformation functions or transformation matrices can be used. For example, a pair of transformation functions for horizontal transformation and vertical transformation can be defined as a Multiple Transform Set (MTS). The transformation unit (140) can select one transformation function pair with the best transformation efficiency among the MTS and transform the residual block in the horizontal and vertical directions, respectively. Information (mts_idx) on the transformation function pair selected among the MTS is encoded by the entropy encoding unit (155) and signaled to the image decoding device.
[0072] The quantization unit (145) quantizes the transform coefficients output from the transform unit (140) using quantization parameters and outputs the quantized transform coefficients to the entropy encoding unit (155). The quantization unit (145) may directly quantize a related residual block without transformation for a certain block or frame. The quantization unit (145) may also apply different quantization coefficients (scaling values) according to the positions of the transform coefficients within the transform block. The quantization matrix applied to the quantized transform coefficients arranged in two dimensions may be encoded and signaled to an image decoding device.
[0073] The rearrangement unit (150) can perform rearrangement of coefficient values for quantized residual values.
[0074] The reordering unit (150) can change a two-dimensional coefficient array into a one-dimensional coefficient sequence by using coefficient scanning. For example, the reordering unit (150) can output a one-dimensional coefficient sequence by scanning from the DC coefficient to the coefficients of the high-frequency region by using a zig-zag scan or a diagonal scan. Depending on the size of the transformation unit and the intra prediction mode, a vertical scan that scans the two-dimensional coefficient array in the column direction or a horizontal scan that scans the two-dimensional block-shaped coefficients in the row direction may be used instead of the zig-zag scan. That is, depending on the size of the transformation unit and the intra prediction mode, the scanning method to be used may be determined among the zig-zag scan, the diagonal scan, the vertical scan, and the horizontal scan.
[0075] The entropy encoding unit (155) generates a bitstream by encoding a sequence of one-dimensional quantized transform coefficients output from the rearrangement unit (150) using various encoding methods such as CABAC (Context-based Adaptive Binary Arithmetic Code) and Exponential Golomb.
[0076] In addition, the entropy encoding unit (155) encodes information related to block division, such as CTU size, CU division flag, QT division flag, MTT division type, and MTT division direction, so that the image decoding device can divide the block in the same manner as the image encoding device. In addition, the entropy encoding unit (155) encodes information about a prediction type indicating whether the current block is encoded by intra prediction or inter prediction, and encodes intra prediction information (i.e., information about an intra prediction mode) or inter prediction information (information about an encoding mode of motion information (merge mode or AMVP mode), a merge index in the case of a merge mode, and a reference picture index and a differential motion vector in the case of an AMVP mode) according to the prediction type. In addition, the entropy encoding unit (155) encodes information related to quantization, that is, information about a quantization parameter and information about a quantization matrix.
[0077] The inverse quantization unit (160) inversely quantizes the quantized transform coefficients output from the quantization unit (145) to generate transform coefficients. The inverse transform unit (165) transforms the transform coefficients output from the inverse quantization unit (160) from the frequency domain to the spatial domain to restore the residual block.
[0078] An adder (170) adds the restored residual block and the predicted block generated by the prediction unit (120) to restore the current block. The pixels within the restored current block are used as reference pixels when intra-predicting the next block.
[0079] The loop filter unit (180) performs filtering on restored pixels to reduce blocking artifacts, ringing artifacts, blurring artifacts, etc. that occur due to block-based prediction and transformation / quantization. The loop filter unit (180) may include all or part of a deblocking filter (182), a sample adaptive offset (SAO) filter (184), and an adaptive loop filter (ALF, 186) as an in-loop filter.
[0080] The deblocking filter (182) filters the boundaries between restored blocks to remove blocking artifacts caused by block-based encoding / decoding, and the SAO filter (184) and the ALF (186) perform additional filtering on the deblocking-filtered image. The SAO filter (184) and the ALF (186) are filters used to compensate for the differences between restored pixels and original pixels caused by lossy coding. The SAO filter (184) improves not only subjective image quality but also encoding efficiency by applying an offset in units of CTUs. In contrast, the ALF (186) performs block-based filtering, and compensates for distortion by applying different filters by distinguishing the edges and degrees of variation of the corresponding block. Information on filter coefficients to be used in the ALF can be encoded and signaled to an image decoding device.
[0081] The restored blocks filtered through the deblocking filter (182), SAO filter (184), and ALF (186) are stored in the memory (190). When all blocks within a picture are restored, the restored picture can be used as a reference picture for inter-predicting blocks within a picture to be encoded later.
[0082] The video encoding device can store the bitstream of encoded video data on a non-transitory storage medium or transmit it to the video decoding device using a communication network.
[0083] FIG. 5 is an exemplary block diagram of an image decoding device capable of implementing the techniques of the present disclosure. Hereinafter, the image decoding device and its subcomponents will be described with reference to FIG. 5.
[0084] The video decoding device may be configured to include an entropy decoding unit (510), a rearrangement unit (515), an inverse quantization unit (520), an inverse transformation unit (530), a prediction unit (540), an adder (550), a loop filter unit (560), and a memory (570).
[0085] Similar to the video encoding device of FIG. 1, each component of the video decoding device may be implemented in hardware, software, or a combination of hardware and software. Furthermore, the functions of each component may be implemented in software, with a microprocessor executing the software functions corresponding to each component.
[0086] The entropy decoding unit (510) decodes the bitstream generated by the image encoding device to extract information related to block division, thereby determining the current block to be decoded, and extracts prediction information, information on residual signals, etc. required to restore the current block.
[0087] The entropy decoding unit (510) extracts information about the CTU size from the Sequence Parameter Set (SPS) or the Picture Parameter Set (PPS), determines the size of the CTU, and divides the picture into CTUs of the determined size. Then, the CTU is determined as the top layer of the tree structure, i.e., the root node, and the CTU is divided using the tree structure by extracting division information about the CTU.
[0088] For example, when splitting a CTU using the QTBTTT structure, first, the first flag (QT_split_flag) related to the splitting of QT is extracted, and each node is split into four nodes of the lower layer. Then, for the nodes corresponding to the leaf nodes of QT, the second flag (mtt_split_flag) related to the splitting of MTT and the split direction (vertical / horizontal) and / or split type (binary / ternary) information are extracted, and the corresponding leaf nodes are split into the MTT structure. Accordingly, each node below the leaf nodes of QT are split recursively into the BT or TT structure.
[0089] As another example, when splitting a CTU using the QTBTTT structure, the CU split flag (split_cu_flag) indicating whether the CU is split is first extracted, and if the block is split, the first flag (QT_split_flag) may be extracted. During the splitting process, each node may undergo zero or more repeated QT splits followed by zero or more repeated MTT splits. For example, a CTU may undergo an MTT split right away, or conversely, may undergo only multiple QT splits.
[0090] As another example, when splitting a CTU using the QTBT structure, the first flag (QT_split_flag) related to the splitting of QT is extracted, and each node is split into four nodes of the lower layer. Furthermore, for nodes corresponding to leaf nodes of QT, a split flag (split_flag) indicating whether to further split into BTs and splitting direction information are extracted.
[0091] Meanwhile, when the entropy decoding unit (510) determines the current block to be decoded by using the division of the tree structure, it extracts information on the prediction type indicating whether the current block is intra-predicted or inter-predicted. If the prediction type information indicates intra-prediction, the entropy decoding unit (510) extracts syntax elements for intra-prediction information (intra-prediction mode) of the current block. If the prediction type information indicates inter-prediction, the entropy decoding unit (510) extracts syntax elements for inter-prediction information, i.e., information indicating a motion vector and a reference picture referenced by the motion vector.
[0092] Additionally, the entropy decoding unit (510) extracts information about the quantized transform coefficients of the current block as information related to quantization and information about residual signals.
[0093] The rearrangement unit (515) can change the sequence of one-dimensional quantized transform coefficients entropy-decoded in the entropy decoding unit (510) back into a two-dimensional coefficient array (i.e., block) in the reverse order of the coefficient scanning performed by the image encoding device.
[0094] The inverse quantization unit (520) inversely quantizes the quantized transform coefficients and inversely quantizes the quantized transform coefficients using the quantization parameters. The inverse quantization unit (520) may also apply different quantization coefficients (scaling values) to the quantized transform coefficients arranged in two dimensions. The inverse quantization unit (520) may perform inverse quantization by applying a matrix of quantized coefficients (scaling values) from an image encoding device to a two-dimensional array of quantized transform coefficients.
[0095] The inverse transform unit (530) inversely transforms the inverse quantized transform coefficients from the frequency domain to the spatial domain to restore residual signals, thereby generating a residual block for the current block.
[0096] In addition, when the inverse transform unit (530) inversely transforms only a portion of a transform block (sub-block), it extracts a flag (cu_sbt_flag) indicating that only a sub-block of the transform block has been transformed, directionality (vertical / horizontal) information (cu_sbt_horizontal_flag) of the sub-block, and / or position information (cu_sbt_pos_flag) of the sub-block, and inversely transforms the transform coefficients of the corresponding sub-block from the frequency domain to the spatial domain to restore residual signals, and fills “0” values with residual signals for areas that have not been inversely transformed, thereby generating a final residual block for the current block.
[0097] In addition, when MTS is applied, the inverse transform unit (530) determines a transform function or a transform matrix to be applied in the horizontal and vertical directions using MTS information (mts_idx) signaled from the image encoding device, and performs inverse transform on the transform coefficients within the transform block in the horizontal and vertical directions using the determined transform function.
[0098] The prediction unit (540) may include an intra prediction unit (542) and an inter prediction unit (544). The intra prediction unit (542) is activated when the prediction type of the current block is intra prediction, and the inter prediction unit (544) is activated when the prediction type of the current block is inter prediction.
[0099] The intra prediction unit (542) determines the intra prediction mode of the current block among a plurality of intra prediction modes from the syntax elements for the intra prediction mode extracted from the entropy decoding unit (510), and predicts the current block using reference pixels around the current block according to the intra prediction mode.
[0100] The inter prediction unit (544) uses the syntax elements for the inter prediction mode extracted from the entropy decoding unit (510) to determine the motion vector of the current block and the reference picture referenced by the motion vector, and predicts the current block using the motion vector and the reference picture.
[0101] An adder (550) adds the residual block output from the inverse transform unit (530) and the predicted block output from the inter prediction unit (544) or the intra prediction unit (542) to restore the current block. The pixels within the restored current block are used as reference pixels when intra-predicting a block to be decoded later.
[0102] The loop filter unit (560) may include a deblocking filter (562), an SAO filter (564), and an ALF (566) as in-loop filters. The deblocking filter (562) deblocks the boundaries between restored blocks to remove blocking artifacts caused by block-by-block decoding. The SAO filter (564) and the ALF (566) perform additional filtering on restored blocks after deblocking filtering to compensate for differences between restored pixels and original pixels caused by lossy coding. The filter coefficients of the ALF are determined using information about filter coefficients decoded from the non-stream.
[0103] The restored blocks filtered through the deblocking filter (562), SAO filter (564), and ALF (566) are stored in the memory (570). When all blocks within a picture are restored, the restored picture is used as a reference picture for inter-predicting blocks within a picture to be encoded later.
[0104]
[0105] The present embodiment relates to encoding and decoding of images (videos) as described above. More specifically, a video coding method and device are provided for inter-predicting chroma components based on signals predicted according to motion information when a corresponding luma block is encoded in inter-prediction, IBC (Intra Block Copy) mode, or IntraTMP (Intra Template Matching Prediction) mode.
[0106] The following embodiments may be performed by a prediction unit (120) within a video encoding apparatus. Additionally, they may be performed by a prediction unit (540) within a video decoding apparatus.
[0107] The video encoding device can generate signaling information related to the present embodiment in terms of rate distortion optimization in encoding the current block. The video encoding device can encode the signaling information using the entropy encoding unit (155) and then transmit it to the video decoding device. The video decoding device can decode the signaling information related to the decoding of the current block from the bitstream using the entropy decoding unit (510).
[0108] In the following description, the term "target block" may be used interchangeably with the current block or coding unit (CU). Alternatively, the term "target block" may also refer to a portion of a coding unit.
[0109] Also, a value of a flag being true indicates that the flag is set to 1. Also, a value of a flag being false indicates that the flag is set to 0.
[0110] I. Intra Block Copy (IBC) and intraTMP
[0111] IBC performs intra prediction of the current block by copying a reference block within the same frame using a block vector to generate a prediction block of the current block.
[0112] A video encoding device performs block matching to derive an optimal block vector. Here, the block vector represents the displacement from the current block to the reference block. In order to increase encoding efficiency, the video encoding device may not transmit the block vector as is, but may divide it into a block vector predictor (BVP) and a block vector difference (BVD), encode the BVP and BVD, and then transmit them to the video decoding device.
[0113] In terms of utilizing block vectors, IBC features inter prediction. Therefore, IBC can be divided into IBC Merge / Skip mode and IBC AMVP mode.
[0114] In IBC merge / skip mode, a video encoding device constructs an IBC merge list. In order to optimize encoding efficiency, the video encoding device can select a block vector from among the candidates included in the IBC merge list and use the selected candidate as a block vector predictor (BVP). The video encoding device determines a merge index indicating the selected block vector. However, the video encoding device does not generate a BVD. The video encoding device encodes the merge index and transmits it to the video decoding device. The IBC merge list can be constructed by the video encoding device and the video decoding device in the same manner. The video decoding device can decode the merge index and then generate a block vector from the IBC merge list using the merge index.
[0115] The video encoding device uses the same block vector transmission method as the IBC merge mode in the case of the IBC skip mode, but does not transmit a residual block corresponding to the difference between the current block and the predicted block.
[0116] In IBC AMVP mode, in order to optimize encoding efficiency, the video encoding device determines a block vector and constructs an IBC AMVP list. The video encoding device determines a candidate index that designates one of the candidate block vectors included in the IBC AMVP list as a BVP. The video encoding device calculates the BVD, which is the difference between the BVP and the block vector. Thereafter, the video encoding device encodes the candidate index and BVD and transmits them to the video decoding device.
[0117] The video decoding device decodes the candidate index and BVD. The video decoding device can obtain the BVP indicated by the candidate index from the IBC AMVP list, and then restore the block vector by adding the BVP and BVD.
[0118] In the Enhanced Compression Model (ECM), the IntraTMP (Intra Template Matching Prediction) technology sets an L-shaped / left / top template around the current block, searches for the template most similar to the current template in the current frame's undistorted region, and then uses a block adjacent to the searched template and of the same size as the current block as the prediction block for the current block. The IntraTMP technology searches for similar templates based on a loss function, using the Sum of Absolute Differences (SAD) as the loss function.
[0119] II. CCRM and CFL (Chroma from Luma)
[0120] In ECM, the Cross-component Residual Model (CCRM) mode is applied to the prediction of chroma components when the corresponding luma block in a single tree is predicted according to the inter prediction or IBC (Intra Block Copy) mode. As shown in the example of Fig. 6, the CCRM mode derives convolutional filter coefficients based on the relationship between the prediction signals of the corresponding luma components and the prediction signals of the chroma components. In the example of Fig. 6, predY represents the prediction signals of the corresponding luma components, and predCb and predCr represent the prediction signals of the chroma components. resY represents the residual signals of the luma component, and resCb and resCr represent the residual signals of the chroma component.
[0121] As shown in Equation 1, the CCRM mode predicts chroma components by applying the derived filter to the restored signals of the corresponding luma components illustrated in Fig. 7. In the example of Fig. 7, C represents the position of the chroma sample generated by applying the derived filter.
[0122]
[0123] Here, the nonlinear function nonlinear(X) and the offset B are defined as in Equation 2 using the bit depth.
[0124]
[0125] Filter coefficients c0 to c7 are derived from the prediction signals of the luma component and the prediction signals of the chroma component using the Gaussian elimination method. At this time, the image encoding device and the image decoding device derive the filter coefficients using the same method.
[0126] In AV1, an open source-based video codec, the CFL (Chroma from Luma) mode predicts the AC component of the chroma component using the AC (Alternative Current) component of the reconstructed luma component during intra prediction, as shown in the example of Fig. 8. The CFL mode generates the AC component of the luma component by subtracting the average, or DC (Direct Current), from the reconstructed luma component. The CFL mode predicts the AC component of the chroma component by multiplying the AC component of the luma component by a scaling parameter, and estimates the DC component of the chroma component using reference samples. The CFL mode generates the final prediction signals of the chroma component by adding the predicted DC and AC components. The scaling parameter is generated by the video encoding device and then transmitted to the video decoding device. At this time, the optimal scaling parameter is transmitted for the Cb component and the Cr component, respectively.
[0127] As previously described, CCRM mode is applied to inter-component prediction in a single-tree structure, and CFL mode is applied to inter-component prediction in intra-prediction. Below, a method for applying CFL mode to inter-component prediction in inter-prediction or IBC mode, and a method for applying CCRM mode to inter-component prediction in a dual-tree structure are described.
[0128] The following embodiments are described with a focus on an image decoding device, but can be implemented identically or similarly in an image encoding device.
[0129] III. Embodiments according to the present disclosure
[0130] The video decoding device according to the present embodiment determines prediction and transformation units, and performs prediction and inverse transformation on the current block corresponding to the determined unit using the determined prediction technique and prediction mode, thereby finally generating a restoration block of the current block. The example illustrated in FIG. 9 may be performed by the inverse transformation unit (530), the prediction unit (540), and the adder (550) of the video decoding device. Meanwhile, the same operations as the example illustrated in FIG. 9 may be performed by the inverse transformation unit (165), the picture division unit (110), the prediction unit (120), and the adder (170) of the video encoding device. At this time, the video decoding device uses encoding information parsed from the bitstream, but the video encoding device may use encoding information set from a higher level in terms of minimizing rate distortion. Hereinafter, for convenience, the present embodiment will be described with a focus on the video decoding device.
[0131] As shown in the example of FIG. 5, the prediction unit (540) includes an intra prediction unit (542) and an inter prediction unit (544) depending on the prediction technology, but as shown in FIG. 9, the prediction unit (540) may include all or part of the prediction unit determination unit (902), the prediction technology determination unit (904), the prediction mode determination unit (906), and the prediction execution unit (908).
[0132] If the color format of the input video is a YUV format (such as YUV420, YUV411, YUV422, YUV444), the video decoding device can perform prediction and restoration of the chroma component after performing prediction and restoration of the luma component. That is, the luma component and the chroma component can be sequentially restored by the components illustrated in Fig. 9. Meanwhile, if the color format of the input video is RGB, the video encoding device can perform color format conversion from RGB to YUV and then encode the converted video. Here, in the case of the YUV format, the color format represents the correspondence between the pixels of the luma component and the pixels of the chroma component.
[0133] The prediction unit determination unit (902) determines a prediction unit (PU). The prediction technique determination unit (904) determines a prediction technique (e.g., intra prediction, inter prediction, IBC (Intra Block Copy) mode, palette mode, etc.) for the prediction unit. The prediction mode determination unit (906) determines a detailed prediction mode for the prediction technique. The prediction execution unit (908) generates a prediction block of the current block according to the determined prediction mode.
[0134] The inverse transform unit (530) includes a transform unit determination unit (910) and an inverse transform execution unit (912). The transform unit determination unit (910) determines a transform unit (TU) for the inverse quantization signals of the current block, and the inverse transform execution unit (912) inversely transforms the transform unit expressed as the inverse quantization signals to generate residual signals.
[0135] An adder (550) adds the prediction block and residual signals to generate a restoration block. The restoration block is stored in memory and can be used to predict other blocks.
[0136] The prediction unit determined by the prediction unit determination unit (902) may be the current block or one of the sub-blocks into which the current block is divided. At this time, the prediction unit of the chroma component may have a size corresponding to the prediction unit of the luma component according to the color format. Alternatively, after the prediction units of the luma component and the chroma component are determined separately, prediction may be performed on the prediction unit of the chroma component.
[0137] The prediction technology determination unit (904) determines the prediction technology for each prediction unit. As described above, the prediction technology may be one of inter-prediction, intra-prediction, IBC mode, and palette mode. In this case, the prediction technology for the chroma component can be determined in the same manner as the prediction technology for the corresponding luma component, without separate signaling or parsing of information.
[0138] For example, if the prediction technique of the current block is not intra prediction, the video decoding device parses 1-bit flag information. For example, if the parsed flag indicates Skip mode, the video decoding device determines the prediction mode of the current block to be the merge mode of inter prediction or the IBC merge mode. In the case of Skip mode, the video decoding device can use the prediction signals as restored signals without performing the inverse transformation process (i.e., without parsing the residual signals).
[0139] On the other hand, if the parsed flag does not indicate a Skip mode for the current block, the prediction technique determination unit (904) can parse a series of 1-bit flags to determine the prediction technique of the current block as one of techniques such as inter prediction, intra prediction, IBC mode, palette mode, etc.
[0140] For example, if Skip is not applied to the current block and the prediction technique is determined to be Inter-Prediction or IBC mode, the video decoding device parses a 1-bit flag. Depending on the parsed flag, the prediction mode of the current block can be determined as either General Merge mode or Advanced Motion Vector Prediction (AMVP) mode.
[0141] The prediction mode determination unit (906) determines a detailed prediction mode for the prediction technology.
[0142] As an example, if the prediction technique of the current block is intra prediction, the prediction mode determination unit (906) can determine one directional prediction mode, a Planar mode (Horizontal Planar, Vertical Planar, or Regular Planar), or a DC mode as the prediction mode of the current block.
[0143] As another example, if the prediction technique of the current block is intra prediction, the prediction mode determination unit (906) can determine the intra TMP mode as the prediction mode of the current block.
[0144] The prediction execution unit (908) generates a prediction block of the current block according to the determined prediction technology and prediction mode.
[0145] As an example, the prediction performing unit (908) generates a prediction block of the current block using motion information, and the adder (550) generates a restoration block of the luma component. The prediction performing unit (908) performs cross-component prediction (CCP) based on the prediction block of the luma component, the restoration block of the luma component, and the prediction block of the chroma component to generate a prediction block of the chroma component, and the adder (550) generates a restoration block of the chroma component.
[0146] FIG. 10 is a block diagram illustrating in detail a prediction execution unit according to one embodiment of the present disclosure.
[0147] For inter-component prediction, the prediction performing unit (908) includes a current block predictor (1002), a CCP performing determiner (1004), a CCP parameter determiner (1006), and a CCP performing unit (1008), as shown in the example of Fig. 10. In the example of Fig. 10, in addition to the components of the prediction performing unit described above, an adder (550) is additionally included to generate a restored block.
[0148] The current block prediction unit (1002) uses motion information to generate a prediction block of the current block, i.e., a prediction block of a luma block and a prediction block of a chroma block. In the case of inter prediction, the motion information is a motion vector of a block or subblock, and in the case of IBC mode, the motion information is a block vector. In the case of IntraTMP mode, the motion information is a displacement between templates, i.e., a block vector.
[0149] In some embodiments, when the inter prediction mode is skip mode or merge / skip mode, inter-component prediction for the inter prediction block may be additionally performed.
[0150] The adder (550) adds the prediction block of the luma block and the residual signals of the luma block to generate a reconstructed block of the luma component. As described above, the residual signals of the luma component are generated by applying entropy decoding, inverse quantization, and inverse transformation to the bitstream. In addition, after the prediction block of the chroma block is generated, the adder (550) adds the prediction block of the chroma block and the residual signals of the chroma block to generate a reconstructed block of the chroma component. As described above, the residual signals of the chroma component are generated by applying entropy decoding, inverse quantization, and inverse transformation to the bitstream.
[0151] The CCP execution decision unit (1004) explicitly determines whether to perform inter-component prediction for the current chroma block by parsing an additional flag. At this time, the flag may be transmitted if the prediction mode of the corresponding luma block is an inter prediction or a block vector-based prediction mode (e.g., IBC or IntraTMP). Depending on the embodiment, the flag may be parsed on a chroma block or transform block basis.
[0152] Whether to perform inter-component prediction is determined on a block-by-block basis, and if all residual signals of the corresponding luma block are zero, inter-component prediction may not be performed implicitly. In addition, whether to perform inter-component prediction is determined on a transform block-by-transform basis, and if the CBF (Code Block Flag) of the corresponding luma transform unit is 0 (if all residual signals are zero), inter-component prediction may not be performed implicitly.
[0153] The CCP parameter determination unit (1006) determines parameters for inter-component prediction.
[0154] As an example, the image decoding device parses the scaling parameter β of the AC component transmitted by the image encoding device.
[0155] Scaling parameters can be parsed for each unit in which inter-component prediction is performed. The image decoding device can receive scaling parameters for each Cb / Cr component. The scaling parameter can be determined according to the index by parsing an index indicating one of a preset number of values defined according to an agreement between the image encoding device and the image decoding device. There can be multiple scaling parameter categories, and the values and number of scaling parameters can be defined differently for each category. Whether to use a scaling parameter included in a category among the multiple categories can be determined based on surrounding information or related syntax elements.
[0156] As another example, a video decoding device derives scaling parameters based on restored luma signals and restored chroma signals. At this time, the video decoding device can derive the scaling parameters using the same method as the video encoding device.
[0157] When predicting the AC component of a chroma block from the AC component of a reconstructed luma block in inter-component prediction, the video decoding device derives a scaling parameter based on the surrounding already reconstructed luma signals and chroma signals. The reconstructed sample area for calculating the scaling parameter can be set for the corresponding luma block and chroma block as in the example of Fig. 11. At this time, A, B, C, and D are integer values greater than or equal to 0, and can be defined according to an agreement between the video encoding device and the video decoding device, the size of the current block, and / or the availability of reference samples. In the example of Fig. 11, k and l can be determined according to the chroma format of the current picture. For example, when the chroma format is 4:2:0, k and l are set to 2.
[0158] According to an embodiment, a region to be used for deriving a scaling parameter among the first region, the second region, and the third region, such as the examples of FIGS. 12A to 12C, may be explicitly signaled. At this time, A, B, C, and D are integer values greater than or equal to 0, and may be defined according to an agreement between an image encoding device and an image decoding device, the size of the current block, and / or the availability of reference samples. In the examples of FIGS. 12A to 12C, k and l may be determined according to the chroma format of the current picture. For example, when the chroma format is 4:2:0, k and l are set to 2.
[0159] FIG. 13 is an exemplary diagram showing the derivation of a scaling parameter according to one embodiment of the present disclosure.
[0160] The video decoding device calculates scaling parameters based on a reference sample area. The reference sample area used to derive the scaling parameters is predefined according to an agreement between the video encoding device and the video decoding device. Alternatively, the reference sample area can be explicitly determined through signaling.
[0161] The image decoding device subtracts the average value of the reference sample area from the restored luma values (ReconY) of the reference sample area of the corresponding luma block to obtain the AC values (ReconY) of the luma component. AC ) is calculated. The image decoding device subtracts the average value of the reference sample area from the restored chroma values (ReconC) of the reference sample area of the chroma block to obtain AC values (ReconC) of the chroma components. AC ) is calculated. ReconC is Cb signals or Cr signals. The image decoding device can derive the scaling parameter based on the two AC components.
[0162] At this time, the video decoding device can downsample the restored luma values according to the chroma format of the current picture (e.g., YCbCr 4:2:0, YCbCr 4:2:2, etc.) and calculate the AC values of the luma component using the downsampled restored luma values.
[0163] The scaling parameter can be calculated according to Equation 3 based on linear regression.
[0164]
[0165] In some embodiments, the scaling parameter can be calculated using the simplified mathematical expression 4.
[0166]
[0167] In mathematical expression 4, X AC max (k) represents the kth largest value among the AC values calculated in the reference sample area of the restored luma component, and Y AC max (k) represents the chroma value corresponding to the location of the luma pixel. X AC min (k) represents the kth smallest value among the AC values calculated in the reference sample area of the restored luma component, and Y AC min (k) represents the chroma value corresponding to the location of the luma pixel.
[0168] As another example, an image decoding device derives filter coefficients based on restored luma signals and restored chroma signals. At this time, the image decoding device can derive the filter coefficients using the same method as the image encoding device.
[0169] Based on one or more of the inter-predicted luma samples (predL), an offset (B) determined according to a bit depth, an output of a nonlinear function (NL) that uses one or more luma inter-prediction samples as input, and inter-predicted chroma prediction samples (predC), the video decoding device calculates filter coefficients. Here, the nonlinear function, the input to the nonlinear function ( ), and offset (B) can be defined in various ways, for example, as in mathematical expression 5.
[0170]
[0171] In Equation 5, i represents a specific position in a corresponding luma block defined according to an agreement between an image encoding device and an image decoding device based on the position of the current chroma sample, and predL(i) represents a predicted value of the luma component at position i.
[0172] The video decoding device predicts chroma signals according to mathematical expression 6.
[0173]
[0174] In mathematical expression 6, L0 to L5 represent restoration signals of corresponding luma components. In addition, the matrix product in the form of Lx=C shown in mathematical expression 7 is processed using a method such as Gaussian elimination or Cholesky decomposition to calculate the filter coefficients.
[0175]
[0176] If the chroma format of the current picture is 4:2:0, 4:2:2, etc., the derivation of filter coefficients and prediction of chroma components can be performed using inter prediction samples within the corresponding luma block, for example, as illustrated in FIG. 14. At this time, the positions of the inter prediction samples within the corresponding luma block are determined according to an agreement between a video encoding device and a video decoding device. Alternatively, the positions of the inter prediction samples within the corresponding luma block can be explicitly determined in units such as slices, pictures, or sequences according to signaling. In the example of FIG. 14, C represents the position of a chroma sample predicted according to application of the derived filter.
[0177] As inter-prediction samples within a corresponding luma block used for predicting chroma components and deriving filter coefficients, an image decoding device can use a value obtained by subtracting an offset from the corresponding prediction sample. At this time, the offset can be calculated as in mathematical expression 8 depending on the bit depth of the luma signal.
[0178]
[0179] The CCP execution unit (1008) generates prediction signals of chroma components based on inter-component prediction.
[0180] FIG. 15 is an exemplary diagram showing inter-component prediction of chroma components according to one embodiment of the present disclosure.
[0181] As an example, a video decoding device generates prediction signals of chroma components using an AC scaling parameter β. Using the scaling parameter and corresponding restored luma signals derived from the CCP parameter determination unit (1006) or parsed from the bitstream, the video decoding device predicts AC values of the chroma components. The video decoding device performs prediction of the chroma components using the AC scaling parameter, as shown in the example of FIG. 15.
[0182] If downsampling of the reconstructed samples (ReconY) of the corresponding luma block is required according to the chroma format of the current picture, the video decoding device performs downsampling and then calculates AC values of the luma component by subtracting the average value of the corresponding luma block from the downsampled luma reconstructed samples. The video decoding device calculates the reconstructed luma AC value (ReconY) of each position. AC (i,j)) by multiplying the scaling parameter to AC values of chroma components (ReconC) AC (i,j)) is calculated. The video decoding device adds the AC values of the chroma components and the average value of the chroma components to generate the final chroma prediction signals. At this time, the video decoding device calculates the average value of the chroma components based on the surrounding already restored chroma reference samples. Alternatively, the video decoding device may perform motion compensation on the chroma components using the motion information used for prediction of the corresponding luma block, and then use the average value of the corresponding chroma prediction signals as the average value of the chroma components. Here, the motion information may be a motion vector according to inter prediction, as described above, or a block vector according to IBC mode or IntraTMP mode.
[0183] As another example, the video decoding device generates prediction signals of chroma components using the filter derived from the CCP parameter determination unit (1006). For example, the video decoding device can generate prediction signals of chroma components using the filter according to Equation 6. In Equation 6, L0 to L5 represent reconstructed luma samples generated by adding inter prediction signals of corresponding luma components and restoration residual signals. At this time, the inter prediction signals of the luma component are signals predicted according to a motion vector. The video decoding device generates final chroma prediction signals by applying the derived filter to sample values of the reconstructed corresponding luma block.
[0184] As another example, if the corresponding luma block is predicted according to the Intra Block Copy (IBC) or IntraTMP mode, the video decoding device performs the derivation of filter coefficients and the prediction of chroma components in the same manner as for the inter-predicted block. At this time, the video decoding device uses the luma prediction signals and chroma prediction signals predicted according to the block vector to derivate the filter coefficients.
[0185] Below, a case is described where multiple luma blocks correspond to a single chroma block according to the application of a dual tree structure. Multiple luma blocks corresponding to a chroma region are represented as corresponding luma regions.
[0186] For example, if whether to perform inter-component prediction is determined on a block-by-block basis, and the luma block corresponding to the center position of the current chroma block is predicted according to inter prediction using motion vectors or prediction mode (IBC or IntraTMP) using block vectors, the video decoding device may additionally parse a flag to determine whether to perform inter-component prediction. Meanwhile, if all residual signals of the luma block corresponding to the center position of the current chroma block are zero, inter-component prediction may not be performed implicitly.
[0187] In addition, when determining whether to perform prediction for each transform unit (TU), the prediction mode of the luma block corresponding to the center position of the TU is used. For example, when the luma block corresponding to the center position of the TU is predicted according to a prediction mode using a motion vector or a block vector, the image decoding device can parse the flag to determine whether to perform inter-component prediction. Meanwhile, when the CBF of the luma block corresponding to the center position of the TU is 0 (all residual signals are zero), inter-component prediction may not be performed implicitly.
[0188] As an example, if a luma block predicted according to a prediction mode using a motion vector or a block vector exists by checking the prediction mode of the predefined positions within the corresponding luma region according to a predefined order, the video decoding device can parse the flag to determine whether to perform inter-component prediction. At this time, the predefined order and the predefined positions within the corresponding luma region can be set according to an agreement between the video encoding device and the video decoding device. The predefined positions within the corresponding luma region can include the center, upper left, upper right, lower left, lower right, etc. of the region, as in the example of FIG. 16.
[0189] Meanwhile, if there are multiple blocks predicted according to a prediction mode using motion vectors or block vectors at predetermined locations, the video decoding device first utilizes the block predicted according to the prediction mode using motion vectors or block vectors in the predetermined order. That is, the video decoding device can derive filter coefficients using signals predicted based on the motion vector or block vector of the first block and perform inter-component prediction using the derived filter.
[0190] For example, when filter coefficients are derived based on a signal predicted according to motion information and a chroma component is predicted using the derived filter, the video decoding device can generate final prediction signals by averaging or weighting the chroma prediction signals generated using the filter and the chroma prediction signals generated according to the motion information. Here, the motion information may be a motion vector according to inter prediction, or a block vector according to the IBC mode or IntraTMP mode, as described above. When inter-component prediction is performed, the video decoding device can always perform weighted-sum prediction. Alternatively, the video decoding device can explicitly parse a flag to determine whether to additionally perform weighted-sum prediction.
[0191] Weights for weighted summation may be defined in advance according to an agreement between an image encoding device and an image decoding device. Alternatively, the image decoding device calculates weights for prediction signals according to motion information and inter-component prediction signals based on prediction mode information of surrounding blocks. When calculating weights based on the prediction modes of surrounding blocks, the locations where the prediction modes are checked may vary depending on the embodiment. As in the example of FIG. 17, the image decoding device can derive weights by checking the prediction modes of surrounding blocks at locations such as TR / BL or TR / BL / TL0 / TL1.
[0192] The number of inter-predicted blocks among the prediction modes of surrounding blocks based on the current chroma block is N. inter , and the number of non-interpretable blocks is N. noninter is defined as . At this time, N inter may include blocks predicted according to a prediction mode using a block vector. The image decoding device may weight prediction signals according to motion information (W inter ) and the weights of the prediction signals between components (W interCC ) can be determined as shown in Table 1.
[0193]
[0194] In Table 1, 2 P is used to divide the predicted value according to the weighted sum. q0(2 p - q0> q0) and q1(2 p - q1> q1) are values defined according to the agreement between the image encoding device and the image decoding device.
[0195] When performing weighted summation, the image decoding device generates final predicted values of chroma components according to mathematical expression 9.
[0196]
[0197] In Equation 11, P interrepresents the prediction signals of chroma components generated according to inter prediction, and P interCC represents the prediction signals of chroma components generated according to inter-component prediction. At this time, P inter may be prediction signals of chroma blocks generated according to a prediction mode using a block vector.
[0198] Hereinafter, using the illustrations of FIGS. 18 to 21, a method for inter-component prediction of a current chroma block based on derived filter coefficients is described. Below, a case in which multiple luma blocks correspond to a single chroma block is described by applying a dual-tree structure. Multiple luma blocks corresponding to chroma regions are denoted as corresponding luma regions.
[0199] In the cities of FIGS. 18 and 19, a flag is used to indicate whether a weighted sum is performed for the two predictors.
[0200] FIG. 18 is a flowchart illustrating a method by which a video encoding device encodes a current chroma block according to one embodiment of the present disclosure.
[0201] The video encoding device generates first prediction signals of the current chroma block using motion information (S1800). Here, in the case of inter prediction, the motion information is a motion vector of a block or subblock, and in the case of IBC mode, the motion information is a block vector. In the case of IntraTMP mode, the motion information is a displacement between templates, i.e., a block vector.
[0202] The video encoding device obtains luma prediction signals and luma restoration samples of luma blocks within a corresponding luma area (S1802).
[0203] The video encoding device performs inter-component prediction when a luma block corresponding to the center position of the current chroma block is predicted according to a prediction mode using motion information.
[0204] The video encoding device implicitly omits inter-component prediction when all residual signals of the luma block corresponding to the center position of the current chroma block are zero.
[0205] When it is determined for each transformation unit whether prediction is performed and a luma block corresponding to the central position of the transformation unit is predicted according to a prediction mode using motion information, the image encoding device performs inter-component prediction.
[0206] The video encoding device implicitly omits inter-component prediction when all residual signals of the luma block corresponding to the central position of the transform unit are zero.
[0207] The video encoding device checks the prediction modes of the predetermined positions within the corresponding luma region according to a predetermined order, and performs inter-component prediction when a luma block predicted according to the prediction mode using motion information exists.
[0208] The video encoding device derives filter coefficients for inter-component prediction of the current chroma block using luma prediction signals and first prediction signals (S1804).
[0209] An image encoding device derives filter coefficients based on one or more of luma prediction signals, an offset (B) determined according to a bit depth, an output of a nonlinear function (NL) that uses one or more luma prediction signals as input, and one or more of the first prediction signals.
[0210] The video encoding device applies filter coefficients to luma restoration signals to generate second prediction signals of the current chroma block (S1806).
[0211] The video encoding device calculates a prediction signal of the current chroma sample by applying filter coefficients derived from the output of a nonlinear function and an offset to luma restoration samples corresponding to the current chroma sample.
[0212] The video encoding device calculates weights (S1808). The video encoding device calculates weights of the first prediction signals and weights of the second prediction signals based on the prediction modes of the surrounding blocks of the current chroma block.
[0213] The video encoding device generates final prediction signals of the current chroma block by weighting the first prediction signals and the second prediction signals using weights (S1810).
[0214] The image encoding device determines a flag indicating whether to perform inter-component prediction based on the first prediction signals, the second prediction signals, and the final prediction signals (S1812).
[0215] In terms of rate distortion optimization, the video encoding device determines a flag indicating whether to perform inter-component prediction. For example, if the first prediction signals are optimal, the flag is set to false. Conversely, if the second prediction signals or the final prediction signals are optimal, the flag is set to true.
[0216] The image encoding device encodes a flag indicating whether to perform inter-component prediction (S1814).
[0217] The image encoding device checks a flag indicating whether to perform inter-component prediction (S1816).
[0218] If the flag indicating whether to perform inter-component prediction is true (Yes in S1816), the image encoding device performs the following steps.
[0219] The video encoding device determines a flag indicating whether to perform a weighted sum based on the second prediction signals and the final prediction signals (S1818).
[0220] In terms of rate-distortion optimization, the video encoding device determines a flag indicating whether to perform weighted summation. For example, if the second prediction signals are optimal, the flag is set to false. Conversely, if the final prediction signals are optimal, the flag is set to true.
[0221] The video encoding device encodes a flag indicating whether to perform weighted summation (S1820).
[0222] If the flag indicating whether to perform inter-component prediction is false (No in S1816), the image encoding device omits the determination and encoding of the flag indicating whether to perform weighted sum.
[0223] Thereafter, the video encoding device generates residual signals by subtracting the first prediction signals, the second prediction signals, or the final prediction signals from the current chroma block according to a flag indicating whether to perform inter-component prediction and a flag indicating whether to perform weighted summation. The video encoding device transforms / quantizes the residual signals to generate quantized transform coefficients, and encodes the quantized transform coefficients.
[0224] FIG. 19 is a flowchart illustrating a method by which a video decoding device restores a current chroma block according to one embodiment of the present disclosure.
[0225] The video decoding device generates first prediction signals of the current chroma block using motion information (S1900). Here, in the case of inter prediction, the motion information is a motion vector of a block or subblock. In the case of IBC mode, the motion information is a block vector. In the case of IntraTMP mode, the motion information is a displacement between templates, i.e., a block vector.
[0226] The video decoding device obtains luma prediction signals and luma restoration samples of luma blocks within a corresponding luma area (S1902).
[0227] The video decoding device decodes a flag indicating whether to perform inter-component prediction from the bitstream (S1904).
[0228] The video decoding device decodes the flag if the luma block corresponding to the center position of the current chroma block is predicted according to a prediction mode using motion information.
[0229] The video decoding device implicitly omits inter-component prediction when all residual signals of the luma block corresponding to the center position of the current chroma block are zero.
[0230] When it is determined whether prediction is performed for each transformation unit and a luma block corresponding to the central position of the transformation unit is predicted according to a prediction mode using motion information, the image decoding device decodes the flag.
[0231] The video decoding device implicitly omits inter-component prediction when all residual signals of the luma block corresponding to the central position of the transform unit are zero.
[0232] The video decoding device checks the prediction modes of the predetermined positions within the corresponding luma area in a predetermined order, and decodes the flag if a luma block predicted according to the prediction mode using motion information exists.
[0233] The video decoding device checks a flag indicating whether to perform inter-component prediction (S1906).
[0234] If the flag indicating whether to perform inter-component prediction is false (No in S1906), the video decoding device determines the first prediction signals as the final prediction signals of the current chroma block.
[0235] On the other hand, if the flag indicating whether to perform inter-component prediction is true (Yes in S1906), the image decoding device performs the following steps.
[0236] The video decoding device derives filter coefficients for inter-component prediction of the current chroma block using luma prediction signals and first prediction signals (S1908).
[0237] The video decoding device derives filter coefficients based on one or more of the luma prediction signals, an offset (B) determined according to a bit depth, an output of a nonlinear function (NL) that uses one or more luma prediction signals as input, and one or more of the first prediction signals.
[0238] The video decoding device applies filter coefficients to luma restoration samples to generate second prediction signals of the current chroma block (S1910).
[0239] The video decoding device calculates a prediction signal of the current chroma sample by applying filter coefficients derived from the output of a nonlinear function and offset to luma restoration samples corresponding to the current chroma sample.
[0240] The video decoding device decodes a flag indicating whether to perform weighted summation (S1912).
[0241] The video decoding device checks a flag indicating whether to perform weighted summation (S1914).
[0242] If the flag indicating whether to perform weighted summation is false (No of S1914), the video decoding device determines the second prediction signals as the final prediction signals of the current chroma block.
[0243] If the flag indicating whether to perform weighted summation is true (Yes in S1914), the image decoding device performs the following steps.
[0244] The video decoding device calculates weights (S1916). The video decoding device calculates weights of the first prediction signals and weights of the second prediction signals based on the prediction modes of the surrounding blocks of the current chroma block.
[0245] The video decoding device generates final prediction signals of the current chroma block by weighting the first prediction signals and the second prediction signals using weights (S1918).
[0246] The video decoding device decodes quantized transform coefficients from the bitstream and dequantizes / inversely transforms the quantized transform coefficients to restore residual signals. The video decoding device adds the final prediction signals and residual signals to generate restored signals for the current chroma block.
[0247] In the cities of Figures 20 and 21, weighted summation is always performed, without using a flag indicating whether to perform weighted summation for the two predictors.
[0248] FIG. 20 is a flowchart illustrating a method by which a video encoding device encodes a current chroma block according to another embodiment of the present disclosure.
[0249] In the city of Fig. 20, the step of generating the first prediction signals of the current chroma block to the step of generating the final prediction signals of the current chroma block (S2000 to S2010) are performed in the same manner as in Fig. 18. Hereinafter, steps that are different from those in the city of Fig. 18 will be described.
[0250] The image encoding device determines a flag indicating whether to perform inter-component prediction based on the first prediction signals and the final prediction signals (S2012).
[0251] In terms of rate-distortion optimization, the video encoding device determines a flag indicating whether to perform inter-component prediction. For example, if the first prediction signals are optimal, the flag is set to false. Conversely, if the final prediction signals are optimal, the flag is set to true.
[0252] The image encoding device encodes a flag indicating whether to perform inter-component prediction (S2014).
[0253] Thereafter, the video encoding device generates residual signals by subtracting the first prediction signals or the final prediction signals from the current chroma block according to a flag indicating whether to perform inter-component prediction. The video encoding device transforms / quantizes the residual signals to generate quantized transform coefficients and encodes the quantized transform coefficients.
[0254] FIG. 21 is a flowchart illustrating a method for a video decoding device to restore a current chroma block according to another embodiment of the present disclosure.
[0255] In the city of Fig. 21, the step of generating the first prediction signals of the current chroma block and the step of generating the second prediction signals of the current chroma block (S2100 to S2110) are performed in the same manner as in Fig. 19. Hereinafter, steps that are different from the city of Fig. 19 will be described.
[0256] The video decoding device calculates weights (S2112). The video decoding device calculates weights of the first prediction signals and weights of the second prediction signals based on the prediction modes of the surrounding blocks of the current chroma block.
[0257] The video decoding device generates final prediction signals of the current chroma block by weighting the first prediction signals and the second prediction signals using weights (S2114).
[0258] The video decoding device decodes quantized transform coefficients from the bitstream and dequantizes / inversely transforms the quantized transform coefficients to restore residual signals. The video decoding device adds the final prediction signals and residual signals to generate restored signals for the current chroma block.
[0259] Although the flowchart / timing diagram of this specification describes each process as being executed sequentially, this is merely an illustrative description of the technical idea of one embodiment of the present disclosure. In other words, a person of ordinary skill in the art to which one embodiment of the present disclosure belongs may modify and apply various modifications and variations by changing the order described in the flowchart / timing diagram without departing from the essential characteristics of one embodiment of the present disclosure, or by executing one or more of the processes in parallel. Therefore, the flowchart / timing diagram is not limited to a chronological order.
[0260] It should be understood that the exemplary embodiments described above can be implemented in many different ways. The functions or methods described in one or more examples can be implemented in hardware, software, firmware, or any combination thereof. It should be understood that the functional components described herein are labeled as "units" to further emphasize their implementation independence.
[0261] Meanwhile, the various functions or methods described in this embodiment may also be implemented as instructions stored on a non-transitory storage medium that can be read and executed by one or more processors. Non-transitory storage media include, for example, all types of storage devices that store data in a form readable by a computer system. For example, non-transitory storage media include storage media such as erasable programmable read-only memory (EPROM), flash drives, optical drives, magnetic hard drives, and solid-state drives (SSDs).
[0262] The above description is merely an example of the technical idea of the present embodiment, and those skilled in the art will appreciate that various modifications and variations can be made without departing from the essential characteristics of the present embodiment. Therefore, the present embodiments are not intended to limit the technical idea of the present embodiment, but rather to explain it, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of the present embodiment should be interpreted by the claims below, and all technical ideas within a scope equivalent thereto should be interpreted as being included in the scope of rights of the present embodiment.
[0263] (Explanation of symbols)
[0264] 120: Prediction Department
[0265] 540: Forecasting Department
[0266] 902: Prediction Unit Decision Unit
[0267] 904: Prediction Technology Decision Division
[0268] 906: Prediction mode decision unit
[0269] 908: Prediction Performance Department
[0270] 1002: Current block prediction unit
[0271] 1004: CCP Execution Decision Department
[0272] 1006: CCP parameter determination unit
[0273] 1008: CCP Executive Department
[0274]
[0275] CROSS-REFERENCE TO RELATED APPLICATION
[0276] This patent application claims priority to Korean patent application No. 10-2023-0062589, filed on May 15, 2023, and Korean patent application No. 10-2024-0041180, filed on March 26, 2024, the entire contents of which are incorporated herein by reference.
Claims
1. A method for restoring a current chroma block performed by a video decoding device, A step of generating first prediction signals of the current chroma block using motion information, wherein the motion information is a motion vector or a block vector; A step of obtaining luma prediction signals and luma restoration samples of luma blocks within a corresponding luma area; A step of deriving filter coefficients for inter-component prediction of the current chroma block using the above luma prediction signals and the first prediction signals; and A step of generating second prediction signals of the current chroma block by applying the filter coefficients to the luma restoration samples. A method, characterized by including:
2. In paragraph 1, A step of decoding a flag indicating whether to perform inter-component prediction from the bitstream; and Steps to check the above flags Including more, A method characterized in that the step of deriving the filter coefficients is performed when the above flag is true.
3. In paragraph 2, A method characterized in that the step of decoding the flag is performed when a luma block corresponding to the center position of the current chroma block is predicted according to a prediction mode using the motion information.
4. In paragraph 2, A method characterized in that the inter-component prediction is implicitly omitted when all residual signals of a luma block corresponding to the center position of the current chroma block are zero.
5. In paragraph 2, A method characterized in that, when it is determined for each transformation unit whether prediction is performed and a luma block corresponding to the central position of the transformation unit is predicted according to a prediction mode using the motion information, a step of decoding the flag is performed.
6. In paragraph 5, A method characterized in that the inter-component prediction is implicitly omitted when all residual signals of the luma block corresponding to the central position of the above transformation unit are zero.
7. In paragraph 2, A method characterized in that the step of decoding the flag is performed by checking the prediction mode of the predetermined positions within the corresponding luma area according to the predetermined order and, if a luma block predicted according to the prediction mode using the motion information exists.
8. In paragraph 1, a step of obtaining weights; and A step of generating final prediction signals of the current chroma block by weighting the first prediction signals and the second prediction signals using the above weights. A method, characterized in that it further comprises:
9. In paragraph 8, The steps for obtaining the above weights are: A method characterized by using predefined weights according to an agreement between an image encoding device and the image decoding device.
10. In paragraph 1, The step of deriving the above filter coefficients is: A method characterized in that the filter coefficients are derived based on the above luma prediction signals, an offset (B) determined according to a bit depth, an output of a nonlinear function (NL) that uses one or more of the above luma prediction signals as input, and one or more of the above first prediction signals.
11. In paragraph 1, The step of generating the above second prediction signals is: A method characterized in that a prediction signal of the current chroma sample is calculated by applying the filter coefficients to luma restoration samples corresponding to the current chroma sample, the output of the nonlinear function, and the offset.
12. A method for encoding a current chroma block performed by a video encoding device, A step of generating first prediction signals of the current chroma block using motion information, wherein the motion information is a motion vector or a block vector; A step of obtaining luma prediction signals and luma restoration samples of luma blocks within a corresponding luma area; A step of deriving filter coefficients for inter-component prediction of the current chroma block using the above luma prediction signals and the first prediction signals; and A step of generating second prediction signals of the current chroma block by applying the filter coefficients to the luma restoration samples. A method, characterized by including:
13. In paragraph 12, A method characterized in that the step of deriving the filter coefficients is performed when a luma block corresponding to the center position of the current chroma block is predicted according to a prediction mode using the motion information.
14. In paragraph 12, a step of obtaining weights; and A step of generating final prediction signals of the current chroma block by performing a weighted sum of the first prediction signals and the second prediction signals using the above weights. A method, characterized in that it further comprises:
15. In paragraph 14, A step of determining a flag indicating whether to perform inter-component prediction based on the first prediction signals and the final prediction signals; and A step of encoding a flag indicating whether to perform prediction between the above components. A method, characterized in that it further comprises:
16. A computer-readable recording medium storing a bitstream generated by an image encoding method, wherein the image encoding method comprises: A step of generating first prediction signals of a current chroma block using motion information, wherein the motion information is a motion vector or a block vector; A step of obtaining luma prediction signals and luma restoration samples of luma blocks within a corresponding luma area; A step of deriving filter coefficients for inter-component prediction of the current chroma block using the above luma prediction signals and the first prediction signals; and A step of generating second prediction signals of the current chroma block by applying the filter coefficients to the luma restoration samples. A recording medium, characterized by including:
Citation Information
Patent Citations
Growing tree-friendly bolt
KR1020230031622A
A device, a method and a computer readable storage medium for industrial safety management
KR1020240081730A
Adaptive cross component residual prediction
KR102519241B1
Guided cross-component prediction
WO2016065538A1
