Image encoding / decoding method and apparatus

IN607184BActive Publication Date: 2026-10-27INTELLECTUAL DISCOVERY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
IN202117045012
Authority / Receiving Office
IN · IN
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-03-26
Filing Date
2021-10-04
Publication Date
2026-10-27
Estimated Expiration
2040-03-26

AI Technical Summary

Technical Problem

Current video compression technologies face inefficiencies in encoding and decoding high-resolution and stereo-scopic image contents, particularly in inter prediction and transform methods, which affect encoding efficiency and accuracy.

Method used

The proposed method generates prediction blocks based on pre-defined prediction modes and residual blocks based on predetermined transform types, using intra prediction with derived intra reference samples and motion compensation with modified motion vectors, and performs multi-type based transforms to enhance encoding efficiency.

Benefits of technology

This approach improves encoding efficiency by optimizing inter prediction and transform processes, leading to better accuracy and efficiency in handling high-resolution and stereo-scopic image contents.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

An image encoding / decoding method and apparatus according to the present invention may generate a prediction block of a current block on the basis of a pre-defined prediction mode, generate a residual block of the current block on the basis of a predetermined transformation type, and reconstruct the current block on the basis of the prediction block and the residual block.
Need to check novelty before this filing date? Find Prior Art

Description

[One]The present invention relates to a video signal processing method and apparatus.background[2]The market demand for high-resolution video is increasing, and accordingly, a technology capable of efficiently compressing high-resolution video is required. In response to these market demands, ISO / IEC's MPEG (Moving Picture Expert Group) and ITU-T's VCEG (Video Coding Expert Group) jointly formed JCT-VC (Joint Collaborative Team on Video Coding) to form HEVC (High Efficiency Video Coding) development of video compression standard was completed in January 2013, and research and development of next-generation compression standard has been actively carried out.[3]Video compression is largely composed of intra prediction (or intra prediction), inter prediction (or inter prediction), transform, quantization, entropy coding, and in-loop filter. Meanwhile, as the demand for high-resolution images increases, the demand for stereoscopic image content as a new image service is also increasing. A video compression technique for effectively providing high-resolution and ultra-high-resolution stereoscopic image content is being discussed.DETAILED DESCRIPTION OF THE INVENTIONtechnical challenge[4]An object of the present invention is to provide an image encoding / decoding method and apparatus with improved efficiency.[5]An object of the present invention is to provide a prediction method and apparatus for each inter mode.[6]An object of the present invention is to provide a multi-type-based conversion method and apparatus.[7]An object of the present invention is to provide a computer-readable recording medium for storing a bitstream generated by an image encoding method and apparatus.means of solving the problem[8]An image encoding / decoding method and apparatus according to the present invention generates a prediction block of a current block based on a pre-defined prediction mode, generates a residual block of the current block based on a predetermined transform type, and The current block may be reconstructed based on the prediction block and the residual block.[9]In the image encoding / decoding method and apparatus according to the present invention, when the prediction mode of the current block is the intra mode, the prediction block of the current block may be generated using a predetermined intra reference sample and the intra prediction mode.

[10] In the image encoding / decoding method and apparatus according to the present invention, the intra reference sample may be derived from any one of a plurality of intra reference lines, and the intra prediction mode may be determined in consideration of the shape of the current block.

[11] In the video encoding / decoding method and apparatus according to the present invention, when the prediction mode of the current block is a merge mode, the generating the prediction block includes generating a merge candidate list of the current block, the merge candidate The method may include deriving motion information of the current block based on a list and performing motion compensation of the current block based on the derived motion information.

[12] In the video encoding / decoding method and apparatus according to the present invention, the merge candidate list includes at least one of a spatial merge candidate, a temporal merge candidate, and a merge candidate of a motion information list, and the motion information list is located before the current block. It may be composed of motion information of one or more decoded previous blocks.

[13] In the image encoding / decoding method and apparatus according to the present invention, the spatial merge candidate is determined in consideration of a predetermined parallel merge region, and the parallel merge region is encoded / decoded independently or in parallel with a plurality of coding blocks. It may mean an area composed of

[14] In the video encoding / decoding method and apparatus according to the present invention, the merge candidate in the motion information list may not overlap with the spatial merge candidate pre-added to the merge candidate list.

[15] In the image encoding / decoding method and apparatus according to the present invention, one or more coding blocks belonging to the parallel merge region may share one and the same motion information list.

[16] In the image encoding / decoding method and apparatus according to the present invention, the method may further include updating the motion information list based on the motion information of the current block.

[17] In the video encoding / decoding method and apparatus according to the present invention, the update may be performed only when the current block is a block having the last decoding order in the parallel merge region.

[18] In the image encoding / decoding method and apparatus according to the present invention, the motion information of the current block may include at least one of a motion vector, a reference picture index, and prediction direction information.

[19] In the video encoding / decoding method and apparatus according to the present invention, the performing motion compensation of the current block includes correcting the motion vector of the current block based on a predetermined differential motion vector (MVD), , the motion compensation may be performed using a corrected motion vector.

[20] In the video encoding / decoding method and apparatus according to the present invention, the differential motion vector includes a differential motion vector (MVD L0 ) in a first direction and a differential motion vector (MVD L1 ) in a second direction, and the second The differential motion vector in the direction may be set as a vector having the same magnitude as the differential motion vector in the first direction and having an opposite direction to the differential motion vector in the first direction.

[21] In the video encoding / decoding method and apparatus according to the present invention, the motion vector is corrected based on an encoding parameter of the current block, and the encoding parameter is selected from among a prediction mode, motion information, or size of the current block. It may include at least one.

[22] The image encoding method and apparatus according to the present invention may determine a transformation type of a current block based on a table pre-defined in the encoding apparatus, and may encode information indicating the determined transformation type.

[23] The image decoding method and apparatus according to the present invention may determine the transformation type of the current block based on information explicitly signaled from the encoding apparatus and a table pre-defined in the decoding apparatus.

[24] In the method and apparatus for encoding / decoding an image according to the present invention, the pre-defined table may define at least one of a transform type in a horizontal direction and a transform type in a vertical direction available for each of the encoded information.

[25] In the image encoding / decoding method and apparatus according to the present invention, the transform type may be implicitly derived based on at least one of a size, a shape, an intra prediction mode, and a component type of the current block.

[26] The computer-readable recording medium according to the present invention may store a bitstream generated according to the above-described image encoding method / apparatus or a bitstream decoded by the above-described image decoding method / apparatus.Effects of the Invention

[27] According to the present invention, encoding efficiency of inter prediction can be improved by using various types of merge candidates.

[28] The present invention can improve the accuracy of inter prediction through correction of motion information.

[29] According to the present invention, coding efficiency of residual samples can be improved by performing additional transform as well as multi-type-based transform.

[30] According to the present invention, a computer-readable recording medium for storing a bitstream generated by the image encoding method / apparatus according to the present invention can be provided.Brief description of the drawing

[31] 1 is a block diagram illustrating an image encoding apparatus according to the present invention.

[32] 2 is a block diagram illustrating an image decoding apparatus according to the present invention.

[33] 3 to 5 are diagrams illustrating a method of dividing a picture into a plurality of blocks as an embodiment to which the present invention is applied.

[34] 6 schematically illustrates a process of reconstructing a current block as an embodiment to which the present invention is applied.

[35] 7 to 16 show an intra prediction method as an embodiment to which the present invention is applied.

[36] 17 illustrates an inter prediction method as an embodiment to which the present invention is applied.

[37] 18 to 30 illustrate an affine inter prediction method as an embodiment to which the present invention is applied.

[38] 31 illustrates a merge mode-based inter prediction method as an embodiment to which the present invention is applied.

[39] 32 to 33 show neighboring blocks usable as spatial merge candidates according to an embodiment to which the present invention is applied.

[40] 34 to 40 show a method of configuring and updating a motion information list according to an embodiment to which the present invention is applied.

[41] 41 to 43 show a method of configuring and updating a motion information list in a parallel merge region according to an embodiment to which the present invention is applied.

[42] 44 illustrates a method of correcting a motion vector based on a differential motion vector as an embodiment to which the present invention is applied.

[43] 45 and 46 show a conversion method in an encoding / decoding apparatus as an embodiment to which the present invention is applied.

[44] 47 and 48 show a method of applying an in-loop filter to a reconstruction block as an embodiment to which the present invention is applied.

[45] 49 to 55 are diagrams illustrating a method of dividing one picture into various types of fragment regions according to an embodiment to which the present invention is applied.Best mode for carrying out the invention

[46] An image encoding / decoding method and apparatus according to the present invention generates a prediction block of a current block based on a pre-defined prediction mode, generates a residual block of the current block based on a predetermined transform type, and The current block may be reconstructed based on the prediction block and the residual block.

[47] In the image encoding / decoding method and apparatus according to the present invention, when the prediction mode of the current block is the intra mode, the prediction block of the current block may be generated using a predetermined intra reference sample and the intra prediction mode.

[48] In the image encoding / decoding method and apparatus according to the present invention, the intra reference sample may be derived from any one of a plurality of intra reference lines, and the intra prediction mode may be determined in consideration of the shape of the current block.

[49] In the video encoding / decoding method and apparatus according to the present invention, when the prediction mode of the current block is a merge mode, the generating the prediction block includes generating a merge candidate list of the current block, the merge candidate The method may include deriving motion information of the current block based on a list and performing motion compensation of the current block based on the derived motion information.

[50] In the video encoding / decoding method and apparatus according to the present invention, the merge candidate list includes at least one of a spatial merge candidate, a temporal merge candidate, and a merge candidate of a motion information list, and the motion information list is located before the current block. It may be composed of motion information of one or more decoded previous blocks.

[51] In the image encoding / decoding method and apparatus according to the present invention, the spatial merge candidate is determined in consideration of a predetermined parallel merge region, and the parallel merge region is encoded / decoded independently or in parallel with a plurality of coding blocks. It may mean an area composed of

[52] In the video encoding / decoding method and apparatus according to the present invention, the merge candidate in the motion information list may not overlap with the spatial merge candidate pre-added to the merge candidate list.

[53] In the image encoding / decoding method and apparatus according to the present invention, one or more coding blocks belonging to the parallel merge region may share one and the same motion information list.

[54] In the image encoding / decoding method and apparatus according to the present invention, the method may further include updating the motion information list based on the motion information of the current block.

[55] In the video encoding / decoding method and apparatus according to the present invention, the update may be performed only when the current block is a block having the last decoding order in the parallel merge region.

[56] In the image encoding / decoding method and apparatus according to the present invention, the motion information of the current block may include at least one of a motion vector, a reference picture index, and prediction direction information.

[57] In the video encoding / decoding method and apparatus according to the present invention, the performing motion compensation of the current block includes correcting the motion vector of the current block based on a predetermined differential motion vector (MVD), , the motion compensation may be performed using a corrected motion vector.

[58] In the video encoding / decoding method and apparatus according to the present invention, the differential motion vector includes a differential motion vector (MVD L0 ) in a first direction and a differential motion vector (MVD L1 ) in a second direction, and the second The differential motion vector in the direction may be set as a vector having the same magnitude as the differential motion vector in the first direction and having an opposite direction to the differential motion vector in the first direction.

[59] In the video encoding / decoding method and apparatus according to the present invention, the motion vector is corrected based on an encoding parameter of the current block, and the encoding parameter is selected from among a prediction mode, motion information, or size of the current block. It may include at least one.

[60] The image encoding method and apparatus according to the present invention may determine a transformation type of a current block based on a table pre-defined in the encoding apparatus, and may encode information indicating the determined transformation type.

[61] The image decoding method and apparatus according to the present invention may determine the transformation type of the current block based on information explicitly signaled from the encoding apparatus and a table pre-defined in the decoding apparatus.

[62] In the method and apparatus for encoding / decoding an image according to the present invention, the pre-defined table may define at least one of a transform type in a horizontal direction and a transform type in a vertical direction available for each of the encoded information.

[63] In the image encoding / decoding method and apparatus according to the present invention, the transform type may be implicitly derived based on at least one of a size, a shape, an intra prediction mode, and a component type of the current block.

[64] The computer-readable recording medium according to the present invention may store a bitstream generated according to the above-described image encoding method / apparatus or a bitstream decoded by the above-described image decoding method / apparatus.Modes for carrying out the invention

[65] An embodiment of the present invention will be described in detail with reference to the accompanying drawings in this specification so that those of ordinary skill in the art to which the present invention pertains can easily implement it. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

[66] Throughout this specification, when a part is 'connected' to another part, it includes not only a case in which it is directly connected, but also a case in which it is electrically connected with another element interposed therebetween.

[67] In addition, when a part 'includes' a certain component throughout this specification, this means that other components may be further included, rather than excluding other components, unless otherwise specifically stated.

[68] Also, terms such as first and second may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

[69] In addition, in the embodiments related to the apparatus and method described in this specification, a part of the configuration of the apparatus or a part of the steps of the method may be omitted. Also, the order of some of the components of a device or some of the steps of a method may be changed. Also, other components or other steps may be inserted into some of the components of a device or some of the steps of a method.

[70] In addition, some components or some steps of the first embodiment of the present invention may be added to or substituted for some components or some steps of the second embodiment of the present invention.

[71] In addition, the components shown in the embodiment of the present invention are shown independently to represent different characteristic functions, and it does not mean that each component is made up of separate hardware or a single software component. That is, each component is listed as each component for convenience of description, and at least two components of each component are combined to form one component, or one component can be divided into a plurality of components to perform a function. Integrated embodiments and separate embodiments of each of these components are also included in the scope of the present invention without departing from the essence of the present invention.

[72] In the present specification, a block may be variously expressed as a unit, an area, a unit, a partition, and the like, and a sample may be variously expressed as a pixel, a pel, a pixel, and the like.

[73] Hereinafter, with reference to the accompanying drawings, an embodiment of the present invention will be described in more detail. In describing the present invention, repeated descriptions of the same components will be omitted.

[74]

[75] 1 is a block diagram illustrating an image encoding apparatus according to the present invention.

[76] Referring to FIG. 1 , the conventional image encoding apparatus 100 includes a picture division unit 110 , prediction units 120 and 125 , a transform unit 130 , a quantization unit 135 , a rearrangement unit 160 , and an entropy encoding unit. 165 , an inverse quantizer 140 , an inverse transform unit 145 , a filter unit 150 , and a memory 155 .

[77] The picture divider 110 may divide the input picture into at least one processing unit. In this case, the processing unit may be a prediction unit (PU), a transform unit (TU), or a coding unit (CU). Hereinafter, in an embodiment of the present invention, a coding unit may be used as a unit for performing encoding or may be used as a meaning for a unit for performing decoding.

[78] A prediction unit may be split in the form of at least one square or rectangle of the same size within one coding unit, and one prediction unit among the split prediction units within one coding unit is a prediction of another. It may be divided to have a shape and / or size different from the unit. When a prediction unit for performing intra prediction based on a coding unit is generated, if it is not the minimum coding unit, intra prediction may be performed without dividing the prediction unit into a plurality of prediction units NxN.

[79] The prediction units 120 and 125 may include an inter prediction unit 120 performing inter prediction or inter prediction and an intra prediction unit 125 performing intra prediction or intra prediction. Whether to use inter prediction or to perform intra prediction for a prediction unit may be determined, and specific information (eg, intra prediction mode, motion vector, reference picture, etc.) according to each prediction method may be determined. A residual value (residual block) between the generated prediction block and the original block may be input to the transform unit 130 . Also, prediction mode information, motion vector information, etc. used for prediction may be encoded by the entropy encoder 165 together with a residual value and transmitted to a decoder.

[80] The inter prediction unit 120 may predict a prediction unit based on information on at least one of a picture before or after a picture of the current picture, and in some cases, prediction based on information of a partial region in the current picture for which encoding has been completed Units can also be predicted. The inter prediction unit 120 may include a reference picture interpolator, a motion prediction unit, and a motion compensator.

[81] The reference picture interpolator may receive reference picture information from the memory 155 and generate pixel information of integer pixels or less in the reference picture. In the case of luminance pixels, a DCT-based 8-tap interpolation filter in which filter coefficients are different to generate pixel information of integer pixels or less in units of 1 / 4 pixels may be used. In the case of a color difference signal, a DCT-based 4-tap interpolation filter in which filter coefficients are different to generate pixel information of integer pixels or less in units of 1 / 8 pixels may be used.

[82] The motion prediction unit may perform motion prediction based on the reference picture interpolated by the reference picture interpolator. As a method for calculating the motion vector, various methods such as Full search-based Block Matching Algorithm (FBMA), Three Step Search (TSS), and New Three-Step Search Algorithm (NTS) may be used. The motion vector may have a motion vector value of 1 / 2 or 1 / 4 pixel unit based on the interpolated pixel. The motion prediction unit may predict the current prediction unit by using a different motion prediction method. Various methods such as skip mode, merge mode, AMVP mode, intra block copy mode, and affine mode may be used as the motion prediction method.

[83] The intra prediction unit 125 may generate a prediction unit based on reference pixel information around the current block, which is pixel information in the current picture. When a neighboring block of the current prediction unit is a block on which inter prediction is performed, and thus a reference pixel is a pixel on which inter prediction is performed, a reference pixel included in the block on which inter prediction is performed is a reference pixel of the block on which intra prediction is performed. information can be used instead. That is, when the reference pixel is not available, the unavailable reference pixel information may be replaced with at least one reference pixel among the available reference pixels.

[84] In addition, a residual block including residual information that is a difference value from the original block of the prediction unit that is predicted based on the prediction unit generated by the prediction units 120 and 125 may be generated. The generated residual block may be input to the transform unit 130 .

[85] The transform unit 130 converts the original block and the residual block including residual information of the prediction units generated by the prediction units 120 and 125 to DCT (Discrete Cosine Transform), DST (Discrete Sine Transform), KLT and It can be converted using the same conversion method. Whether to apply DCT, DST, or KLT to transform the residual block may be determined based on intra prediction mode information of a prediction unit used to generate the residual block.

[86] The quantization unit 135 may quantize values ​​transformed in the frequency domain by the transform unit 130 . The quantization coefficient may change according to blocks or the importance of an image. The value calculated by the quantization unit 135 may be provided to the inverse quantization unit 140 and the rearrangement unit 160 .

[87] The reordering unit 160 may rearrange the coefficient values ​​on the quantized residual values.

[88] The rearranging unit 160 may change the two-dimensional block form coefficient into a one-dimensional vector form through a coefficient scanning method. For example, the rearranging unit 160 may scan from DC coefficients to coefficients in a high frequency region using a zig-zag scan method and may change it into a one-dimensional vector form. A vertical scan for scanning a two-dimensional block shape coefficient in a column direction and a horizontal scan for scanning a two-dimensional block shape coefficient in a row direction may be used instead of the zig-zag scan according to the size of the transform unit and the intra prediction mode. That is, it may be determined whether any of the zig-zag scan, the vertical scan, and the horizontal scan is used according to the size of the transform unit and the intra prediction mode.

[89] The entropy encoding unit 165 may perform entropy encoding based on the values ​​calculated by the reordering unit 160 . For entropy encoding, various encoding methods such as Exponential Golomb, Context-Adaptive Variable Length Coding (CAVLC), and Context-Adaptive Binary Arithmetic Coding (CABAC) may be used. In relation to this, the entropy encoder 165 may encode residual value coefficient information of a coding unit from the reordering unit 160 and the prediction units 120 and 125 . In addition, according to the present invention, it is possible to signal and transmit information indicating that motion information is derived and used from the decoder side and information on a technique used for inducing motion information.

[90] The inverse quantizer 140 and the inverse transform unit 145 inversely quantize the values ​​quantized by the quantizer 135 and inversely transform the values ​​transformed by the transform unit 130 . The residual values ​​generated by the inverse quantizer 140 and the inverse transform unit 145 are combined with the prediction units predicted through the motion estimation unit, the motion compensator, and the intra prediction unit included in the prediction units 120 and 125 and restored. You can create a Reconstructed Block.

[91] The filter unit 150 may include at least one of a deblocking filter, an offset correcting unit, and an adaptive loop filter (ALF). The deblocking filter may remove block distortion caused by the boundary between blocks in the reconstructed picture. The offset correcting unit may correct an offset from the original image in units of pixels with respect to the image on which the deblocking has been performed. In order to perform offset correction on a specific picture, a method of dividing pixels included in an image into a certain number of regions, determining the region to be offset and applying the offset to the region, or taking edge information of each pixel into account can be used to apply Adaptive loop filtering (ALF) may be performed based on a value obtained by comparing the filtered reconstructed image and the original image. After dividing pixels included in an image into a predetermined group, one filter to be applied to the corresponding group is determined, and filtering can be performed differentially for each group.

[92] The memory 155 may store the reconstructed block or picture calculated through the filter unit 150 , and the stored reconstructed block or picture may be provided to the predictors 120 and 125 when inter prediction is performed.

[93]

[94] 2 is a block diagram illustrating an image decoding apparatus according to the present invention.

[95] Referring to FIG. 2 , the image decoder 200 includes an entropy decoding unit 210, a reordering unit 215, an inverse quantization unit 220, an inverse transform unit 225, prediction units 230 and 235, and a filter unit ( 240) and a memory 245 may be included.

[96] When an image bitstream is input from an image encoder, the input bitstream may be decoded by a procedure opposite to that of the image encoder.

[97] The entropy decoding unit 210 may perform entropy decoding in a procedure opposite to that performed by the entropy encoding unit of the image encoder. For example, various methods such as Exponential Golomb, Context-Adaptive Variable Length Coding (CAVLC), and Context-Adaptive Binary Arithmetic Coding (CABAC) may be applied to the method performed by the image encoder.

[98] The entropy decoder 210 may decode information related to intra prediction and inter prediction performed by the encoder.

[99] The reordering unit 215 may perform rearrangement based on a method of rearranging the entropy-decoded bitstream by the entropy decoding unit 210 by the encoder. Coefficients expressed in a one-dimensional vector form may be restored and rearranged in a two-dimensional block form.

[100] The inverse quantization unit 220 may perform inverse quantization based on the quantization parameter provided by the encoder and the reordered coefficient values ​​of the blocks.

[101] The inverse transform unit 225 may perform inverse transforms, ie, inverse DCT, inverse DST, and inverse KLT, on the transforms performed by the transform unit, ie, DCT, DST, and KLT, on the quantization result performed by the image encoder. Inverse transform may be performed based on a transmission unit determined by the image encoder. The inverse transform unit 225 of the image decoder may selectively perform a transformation technique (eg, DCT, DST, KLT) according to a plurality of pieces of information such as a prediction method, a size of a current block, and a prediction direction.

[102] The prediction units 230 and 235 may generate a prediction block based on the prediction block generation related information provided from the entropy decoding unit 210 and previously decoded block or picture information provided from the memory 245 .

[103] As described above, when the size of the prediction unit and the size of the transformation unit are the same when intra prediction or intra prediction is performed in the same manner as in the operation in the image encoder, a pixel located on the left side of the prediction unit and a pixel present on the upper left side of the prediction unit , when intra prediction is performed on the prediction unit based on the pixel present at the top, but when the size of the prediction unit and the size of the transformation unit are different when performing intra prediction, intra prediction is performed using the reference pixel based on the transformation unit prediction can be made. In addition, intra prediction using NxN splitting may be used only for the smallest coding unit.

[104] The prediction units 230 and 235 may include a prediction unit determiner, an inter prediction unit, and an intra prediction unit. The prediction unit determiner receives various information such as prediction unit information input from the entropy decoder 210, prediction mode information of the intra prediction method, and motion prediction related information of the inter prediction method, and divides the prediction unit from the current coding unit, and predicts It may be determined whether the unit performs inter prediction or intra prediction. On the other hand, if the encoder 100 does not transmit the motion prediction related information for the inter prediction, but instead transmits information indicating that motion information is derived and used from the decoder side and information on a technique used to derive motion information. In this case, the prediction unit determining unit determines the prediction performance of the inter prediction unit 230 based on the information transmitted from the encoder 100 .

[105] The inter prediction unit 230 uses information required for inter prediction of the current prediction unit provided from the image encoder, and predicts the current based on information included in at least one picture before or after the current picture including the current prediction unit. Inter prediction may be performed on a unit. In order to perform inter prediction, a motion prediction method of a prediction unit included in a corresponding coding unit based on a coding unit is a skip mode, a merge mode (Merge mode), an AMVP mode (AMVP mode), an intra block copy mode ( Intra block copy mode) and affine mode (Affine mode) can be determined whether any method is used.

[106] The intra prediction unit 235 may generate a prediction block based on pixel information in the current picture. When the prediction unit is a prediction unit on which intra prediction is performed, intra prediction may be performed based on intra prediction mode information of the prediction unit provided by the image encoder.

[107] The intra prediction unit 235 may include an adaptive intra smoothing (AIS) filter, a reference pixel interpolator, and a DC filter. The AIS filter is a part that performs filtering on the reference pixel of the current block, and may be applied by determining whether to apply the filter according to the prediction mode of the current prediction unit. AIS filtering may be performed on the reference pixel of the current block by using the prediction mode and AIS filter information of the prediction unit provided by the image encoder. When the prediction mode of the current block is a mode in which AIS filtering is not performed, the AIS filter may not be applied.

[108] When the prediction mode of the prediction unit is a prediction unit in which intra prediction is performed based on a pixel value obtained by interpolating the reference pixel, the reference pixel interpolator may interpolate the reference pixel to generate the reference pixel in units of pixels having an integer value or less. When the prediction mode of the current prediction unit is a prediction mode that generates a prediction block without interpolating the reference pixel, the reference pixel may not be interpolated. The DC filter may generate the prediction block through filtering when the prediction mode of the current block is the DC mode.

[109] The reconstructed block or picture may be provided to the filter unit 240 . The filter unit 240 may include a deblocking filter, an offset correcting unit, and an ALF.

[110] Information on whether a deblocking filter is applied to a corresponding block or picture and information on whether a strong filter or a weak filter is applied when the deblocking filter is applied may be provided from the video encoder. The deblocking filter of the image decoder may receive deblocking filter-related information provided from the image encoder, and the image decoder may perform deblocking filtering on the corresponding block.

[111] The offset correction unit may perform offset correction on the reconstructed image based on the type of offset correction applied to the image during encoding and information on the offset value. ALF may be applied to a coding unit based on information on whether ALF is applied, ALF coefficient information, etc. provided from the encoder. Such ALF information may be provided by being included in a specific parameter set.

[112] The memory 245 may store the reconstructed picture or block to be used as a reference picture or reference block, and may also provide the reconstructed picture to an output unit.

[113]

[114] 3 to 5 are diagrams illustrating a method of dividing a picture into a plurality of blocks as an embodiment to which the present invention is applied.

[115] Referring to FIG. 3 , a picture is divided into a plurality of basic coding units (Coding Tree Units, hereinafter, CTUs).

[116] The size of the CTU may be defined in units of pictures or video sequences, and each CTU is configured not to overlap with other CTUs. For example, the CTU size may be set to 128x128 in the entire sequence, and any one of 128x128 to 256x256 may be selected and used in units of pictures.

[117] By hierarchically dividing the CTU, a coding block / coding unit (Coding Unit, hereinafter, CU) may be generated. Prediction and transformation may be performed in units of coding units, and it becomes a basic unit for determining a prediction mode. The prediction mode indicates a method of generating a prediction image, and examples include intra prediction (hereinafter, intra prediction), inter prediction (hereinafter, inter prediction), or combined prediction. . Specifically, for example, a prediction block may be generated by using at least one prediction mode of intra prediction, inter prediction, or complex prediction in units of coding units. When the reference picture points to the current picture in the inter prediction mode, a prediction block may be generated based on an already decoded region in the current picture. This may be included in inter prediction since a prediction block is generated using a reference picture index and a motion vector. Intra prediction is a method of generating a prediction block using information of a current picture, inter prediction is a method of generating a prediction block using information of another picture that has already been decoded, and complex prediction is a method of generating a prediction block by mixing inter prediction and intra prediction. method to use. In the complex prediction, some regions among a plurality of sub-regions constituting one coding block may be encoded / decoded using inter prediction, and the remaining regions may be encoded / decoded using intra prediction. Alternatively, in the complex prediction, inter prediction may be primarily performed on a plurality of sub-regions, and intra prediction may be secondarily performed. In this case, the predicted value of the coding block is It may be derived by weighted average of the prediction value according to the inter prediction and the prediction value according to the intra prediction. The number of sub-regions constituting one coding block may be 2, 3, 4 or more, and the shape of the sub-regions may be a rectangle, a triangle, or other polygons.

[118] 4, the CTU may be divided (partitioned) in the form of a quad tree, a binary tree, or a triple tree. The divided block may be further divided in the form of a quad tree, binary tree, or triple tree. The method of dividing the current block into 4 square partitions is called quad tree partitioning, the method of dividing the current block into 2 square or non-square partitions is called binary tree partitioning, and the method of dividing the current block into 3 partitions is binary This is defined as tree partitioning.

[119] Binary partitioning in the vertical direction (SPLIT_BT_VER in Fig. 4) is called vertical binary tree partitioning, and binary tree partitioning in the horizontal direction (SPLIT_BT_HOR in Fig. 4) is defined as horizontal binary tree partitioning.

[120] Triple partitioning in the vertical direction (SPLIT_TT_VER in FIG. 4) is called vertical triple-tree partitioning, and triple-tree partitioning (SPLIT_TT_HOR in FIG. 4) in the horizontal direction is defined as horizontal triple-tree partitioning.

[121] The number of divisions is called a partitioning depth, and the maximum value of the partitioning depth can be set differently for each sequence, picture, subpicture, slice, or tile. It can be set to have a different partitioning depth, and a syntax indicating this can be signaled.

[122] In a method such as quad tree partitioning, binary tree partitioning, or triple tree partitioning, the divided coding unit is further divided to configure the coding unit of the leaf node, or the A coding unit may be configured.

[123] Referring to FIG. 5 , a coding unit may be configured by hierarchically dividing one CTU, and the coding unit may be divided using at least one of binary tree partitioning and quad tree partitioning / triple tree partitioning. Such a method is defined as multi-tree partitioning.

[124] A coding unit generated by dividing an arbitrary coding unit having a partitioning depth of k is called a lower coding unit, and the partitioning depth is (k+1). A coding unit having a partitioning depth k including a lower coding unit having a partitioning depth (k+1) is referred to as a higher coding unit.

[125] The partitioning type of the current coding unit may be limited according to the partitioning type of the higher coding unit and / or the partitioning type of the coding unit in the vicinity of the current coding unit.

[126] Here, the partitioning type represents an indicator indicating which partitioning among binary tree partitioning and quad tree partitioning / triple tree partitioning is used.

[127]

[128] 6 schematically illustrates a process of reconstructing a current block as an embodiment to which the present invention is applied.

[129] Referring to FIG. 6 , a prediction block of a current block may be generated based on a prediction mode pre-defined in the encoding / decoding apparatus ( S600 ).

[130] In video encoding / decoding, a prediction image may be generated by a plurality of methods, and a method of generating the prediction image is referred to as a prediction mode. The prediction mode may include an intra prediction mode, an inter prediction mode, a current picture reference encoding mode, or a combined prediction mode.

[131] The inter prediction mode is a prediction mode that generates a prediction block (prediction image) of the current block using information of a previous picture, and the intra prediction mode is a prediction mode that generates a prediction block using samples adjacent to the current block. . A prediction block may be generated using an already reconstructed image of the current picture, which is defined as a current picture reference mode or an intra block copy mode. A prediction block may be generated using at least two prediction modes among an inter prediction mode, an intra prediction mode, or a current picture reference mode, and this is defined as a combined prediction mode.

[132] The intra prediction mode will be described in detail with reference to FIGS. 13 to 24 . The inter prediction mode will be described in detail with reference to FIGS. 7 to 12 .

[133] Referring to FIG. 6 , a residual block of the current block may be generated ( S610 ).

[134] The encoding apparatus may generate a residual block through a difference between the original block and the prediction block of the current block. At least one of transform or quantization is performed on the residual data of the residual block to generate a residual coefficient, and the generated residual coefficient may be encoded. Conversely, the decoding apparatus may reconstruct the residual block by decoding the residual coefficient encoded from the bitstream and performing at least one of inverse quantization and inverse transformation on the decoded residual coefficient.

[135] Here, the transform or inverse transform may be performed based on at least one of n transform types pre-defined in the encoding / decoding apparatus. n may be an integer of 1, 2, 3, 4, or more. As an example, the transform type may include at least one of DCT-2, DCT-8, DST-7, and transform skip mode. Only one and the same transform type may be applied to the vertical / horizontal direction of one block, or different transform types may be applied to each of the vertical / horizontal directions. For this, a flag indicating whether one and the same transform type is applied may be used. The flag may be signaled by the encoding device.

[136] The transform type of the current block may be determined by selectively using either a method determined based on information explicitly signaled by an encoding apparatus or a method implicitly determined by a decoding apparatus. Here, the selection may be performed based on a flag indicating whether information specifying a transformation type is explicitly signaled. That is, when the flag is the first value, it may indicate that information specifying the transformation type is explicitly signaled, otherwise, it may indicate that the transformation type is implicitly determined. The flag may be signaled at at least one level of a sequence, a picture, a slice, a CTU, a CU, or a TU. Alternatively, the flag may be derived based on a predetermined encoding parameter. Here, the encoding parameter may mean at least one of a block size, a shape, an intra prediction mode, or a component type (eg, luminance and color difference). The size of a block can be expressed as width, height, ratio of width and height, product of width and height, sum / difference of width and height, etc. For example, when the size of the current block is greater than a predetermined threshold size, the flag may be derived as a first value, otherwise, the flag may be derived as a second value. Here, the current block may mean a transform block corresponding to the current block, and the size may mean a maximum value or a minimum value among width and height. In addition, the threshold size is a value pre-promised to the encoding / decoding device, and may be 16, 32, 64 or more.

[137] Specifically, when the flag is the first value, the transform type may be determined based on at least one of information (mts_idx) explicitly signaled by the encoding apparatus or a table pre-defined in the decoding apparatus. mts_idx may specify at least one of whether the transformation types in the vertical / horizontal direction are the same as each other or the transformation types applied in the vertical / horizontal direction. The table may be defined as shown in Table 1 below.

[138] [Table 1]mts_idx 0 One 2 3 4trTypeHor 0 One 2 One 2trTypeVer 0 One One 2 2

[139] In Table 1, trTypeHor may indicate a horizontal transformation type and trTypeVer may indicate a vertical transformation type. When trTypeHor is 0, it means that DCT-2 is used as the transform type in the horizontal direction, and when trTypeHor is 1, it means that DSCT-7 is used as the transform type in the horizontal direction, and when trTypeHor is 3, This may mean that DCT-8 is used as a transform type in the horizontal direction. TrTypeVer may also be defined in the same way as trTypeHor.

[140] When the flag is the second value, the transform type may be determined based on the above-described encoding parameter. For example, when the size of the current block is greater than a predetermined threshold, the transform type is determined as the first transform type (eg, DST-7), otherwise, the transform type is the second transform type (eg, DCT). -2) can be determined.

[141] Here, the transformation type may be determined for each of the vertical direction and the horizontal direction. That is, a horizontal transformation type may be determined through comparison between the width of the current block and the threshold value, and a vertical transformation type may be determined through a comparison between the current block height and the threshold value. The threshold value may be an integer of 0, 4, 8, 16, 32 or more. The above-described transform and inverse transform will be described with reference to FIGS. 45 and 46 .

[142] Referring to FIG. 6 , the current block may be reconstructed based on the prediction block and the residual block ( S620 ).

[143] The current block may be reconstructed by adding the pre-generated prediction block and the residual block. A predetermined in-loop filter may be applied to the reconstructed current block. The in-loop filter may include at least one of a deblocking filter, a sample adaptive offset (SAO) filter, and an adaptive loop filter (ALF), which will be described with reference to FIGS. 47 and 48 .

[144]

[145] 7 to 16 show an intra prediction method as an embodiment to which the present invention is applied.

[146] Referring to FIG. 7 , intra prediction uses already coded / decoded boundary samples around the current block, and this is defined as an intra reference sample.

[147] Set the average value of the intra reference sample to the value of all samples of the prediction block (DC mode) A prediction sample may be generated by performing weighted prediction (Planar mode), or intra prediction may be performed using a directional intra prediction mode or the like.

[148] Referring to FIG. 8(a), as shown in the left figure, intra prediction can be performed using 33 directional modes and 2 non-directional modes (ie, planar mode and DC mode), see FIG. 8(b) If it is, 65 directional modes and 2 non-directional modes may be used. When directional intra prediction is used, an intra reference sample (reference sample) is generated in consideration of the directionality of the intra prediction mode, and intra prediction may be performed using the generated intra reference sample.

[149] The intra reference sample on the left side of the coding unit is referred to as a left intra reference sample, and the intra reference sample on the upper side of the coding unit is referred to as an upper intra reference sample.

[150] When directional intra prediction is performed, as shown in Table 2, an intra direction parameter (intraPredAng), which is a parameter indicating a prediction direction (or prediction angle), may be set according to an intra prediction mode. Table 2 is only an example based on a directional mode having values ​​of 2 to 34 among 35 intra prediction modes. It goes without saying that the prediction direction (or prediction angle) of the directional mode is further subdivided, so that more than 33 directional modes can be used.

[151] [Table 2]PredModeIntra One 2 3 4 5 6 7IntraPredAng - 32 26 21 17 13 9PredModeIntra 8 9 10 11 12 13 14IntraPredAng 5 2 0 -2 -5 -9 -13PredModeIntra 15 16 17 18 19 20 21IntraPredAng -17 -21 -26 -32 -26 -21 -17PredModeIntra 22 23 24 25 26 27 28IntraPredAng -13 -9 -5 -2 0 2 5PredModeIntra 29 30 31 32 33 34 IntraPredAng 9 13 17 21 26 32

[152] When intraPredAng is a negative number (for example, when the intra prediction mode index is between 11 and 25), the left intra reference sample and the upper intra reference sample are configured in 1D according to the angle of the intra prediction mode in the current block as shown in FIG. It can be reconstructed as a one-dimensional reference sample (Ref_1D).

[153] When the intra prediction mode index is between 11 and 18, as shown in FIG. 10 , one-dimensional reference samples may be generated in a counterclockwise direction from the intra reference sample located at the upper right to the intra reference sample located at the lower left of the current block. In other modes, a one-dimensional reference sample may be generated using only the upper intra reference sample or the left intra reference sample.

Claims

WE CLAIMS

1. generating a prediction block of a current block based on a pre-defined prediction mode; generating a residual block of the current block based on a predetermined transform type; and reconstructing the current block based on the prediction block and the residual block, wherein when the prediction mode of the current block is a merge mode, generating the prediction block includes: a merge candidate of the current block generating a list; deriving motion information of the current block based on the merge candidate list and the merge index of the current block; and performing motion compensation of the current block based on the derived motion information, wherein the merge candidate list includes at least one of a spatial merge candidate, a temporal merge candidate, and a merge candidate of a motion information list, The motion information list is composed of motion information of one or more previous blocks decoded before the current block.

2. The method of claim 1 , further comprising updating the motion information list based on the motion information of the current block.

3. The region of claim 2, wherein the updating is performed only when the current block is a block having the last decoding order in the parallel merge region, and the parallel merge region is a region composed of a plurality of coding blocks that are decoded independently of each other. means, an image decoding method.

4. The method of claim 1, wherein the motion information of the current block includes at least one of a motion vector, a reference picture index, and prediction direction information, and the performing motion compensation of the current block comprises: a predetermined differential motion vector (MVD) Comprising the step of correcting the motion vector of the current block based on, the video decoding method.

5. 5. The method of claim 4, wherein the differential motion vector comprises a differential motion vector (MVD L0 ) in a first direction and a differential motion vector (MVD L1 ) in a second direction, wherein the differential motion vector in the second direction comprises: An image decoding method, wherein the differential motion vector in the first direction is set to a vector having the same magnitude and opposite direction to the differential motion vector.

6. The image decoding according to claim 4, wherein the motion vector is corrected based on an encoding parameter of the current block, and the encoding parameter includes at least one of a prediction mode, motion information, and a size of the current block. Way.

7. The method of claim 1 , wherein the transform type is determined based on information explicitly signaled from an encoding apparatus and a table pre-defined in a decoding apparatus.

8. The method of claim 1 , wherein the transform type is implicitly derived based on at least one of a size, a shape, an intra prediction mode, and a component type of the current block.

9. generating a prediction block of a current block based on a pre-defined prediction mode; generating a residual block of the current block through a difference between the original block of the current block and the prediction block; and encoding residual data of the residual block, wherein when the prediction mode of the current block is a merge mode, generating the prediction block includes: generating a merge candidate list of the current block; determining motion information of the current block from the merge candidate list; and performing inter prediction of the current block based on the determined motion information, wherein the merge candidate list includes at least one of a spatial merge candidate, a temporal merge candidate, and a merge candidate of a motion information list, the The motion information list is composed of motion information of one or more previous blocks encoded before the current block.

10. A computer-readable recording medium storing a bitstream decoded by a video signal decoding method, the video signal decoding method comprising: generating a prediction block of a current block based on a pre-defined prediction mode; generating a residual block of the current block based on a predetermined transform type; and reconstructing the current block based on the prediction block and the residual block, wherein when the prediction mode of the current block is a merge mode, generating the prediction block includes: a merge candidate of the current block generating a list; deriving motion information of the current block based on the merge candidate list and the merge index of the current block; and performing motion compensation of the current block based on the derived motion information, wherein the merge candidate list includes at least one of a spatial merge candidate, a temporal merge candidate, and a merge candidate of a motion information list, The motion information list is composed of motion information of one or more previous blocks decoded before the current block.