Intra-frame prediction device and method based on prediction mode estimation

By using intra prediction device in video encoding technology, the prediction mode of the current block is derived by referring to the prediction mode of adjacent blocks, the problems of encoding efficiency and quality of high resolution and high frame rate video data are solved, and higher encoding is achieved Efficiency and resource conservation.

CN113892268BActive Publication Date: 2024-12-03HYUNDAI MOTOR CO LTD +2
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202080037443.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-03-20
Filing Date
2020-03-20
Publication Date
2024-12-03
Estimated Expiration
2040-03-20

AI Technical Summary

Technical Problem

When existing video encoding technologies face high resolution and high frame rate video data, encoding efficiency and image quality are difficult to meet the needs, resulting in excessive hardware resource consumption.

Method used

Using an intra prediction device and method, the intra prediction mode of the current block is derived by referring to the intra prediction mode of the previously reconstructed neighboring blocks, and the intra prediction is performed using the deduced prediction mode to generate a prediction sample of the current block.

Benefits of technology

The compression performance of image encoding and decoding devices is improved, encoding efficiency and image quality are improved, and the consumption of hardware resources is reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113892268B_ABST
    Figure CN113892268B_ABST
Patent Text Reader

Abstract

The present embodiment provides an intra-frame prediction method, which is used by an intra-frame prediction device, and the intra-frame prediction method includes the following steps: decoding mode information indicating a prediction estimation mode using a prediction mode block from a bit stream; taking a pixel group including one or more pixels in the prediction mode block as a unit, estimating the intra-frame prediction mode of the corresponding pixel group according to the intra-frame prediction modes of reference pixels at multiple pre-reconstructed positions around the prediction mode block; and performing intra-frame prediction on the pixels in the corresponding pixel group by utilizing the intra-frame prediction mode of the corresponding pixel group.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an intra-frame prediction method used in an image encoding and decoding device, and more particularly, to an intra-frame prediction method that refers to an intra-frame prediction mode of a previously reconstructed adjacent block to derive an intra-frame prediction mode of a current block. Background Art

[0002] The contents described in this section merely provide background information about the present invention and do not constitute prior art.

[0003] Since the amount of video data is larger than that of voice data or still image data, storing or transmitting the video data without compression processing requires a large amount of hardware resources, including memory.

[0004] Accordingly, when storing or transmitting video data, an encoder is usually used to compress the video data to facilitate storage or transmission of the video data. Then, a decoder receives the compressed video data and decompresses and reproduces the video data. Compression technologies used for such videos include H.264 / AVC and High Efficiency Video Coding (HEVC), which has an approximately 40% improvement in coding efficiency over H.264 / AVC.

[0005] However, the image size, resolution and frame rate are gradually increasing, and accordingly, the amount of data to be encoded is also increasing. Therefore, a new compression technology with better encoding efficiency and higher image quality than the existing compression technology is needed. Summary of the invention

[0006] Technical issues

[0007] The present invention aims to provide an intra-frame prediction device and method, which are used to derive the intra-frame prediction mode of a current block by referring to the intra-frame prediction mode of a previously reconstructed adjacent block, perform intra-frame prediction using the derived intra-frame prediction mode, and generate predicted samples of the current block.

[0008] Technical Solution

[0009] According to one aspect of the present invention, for an intra-frame prediction method used by an intra-frame prediction device, a method is provided, the method comprising: decoding mode information indicating the use of a prediction derivation mode of a prediction mode block from a bit stream; for each pixel group including one or more pixels in the prediction mode block, deriving the intra-frame prediction mode of each pixel group based on the intra-frame prediction modes of pre-reconstructed reference pixels at multiple positions near the prediction mode block; and performing intra-frame prediction on the pixels in each pixel group using the intra-frame prediction mode of each pixel group.

[0010] According to another aspect of the present invention, an intra-frame prediction device is provided, which includes: an entropy decoding unit, which is configured to decode mode information indicating the use of a prediction derivation mode of a prediction mode block from a bit stream; a prediction mode derivation unit, which is configured to derive, for each pixel group including one or more pixels in the prediction mode block, the intra-frame prediction mode of each pixel group based on the intra-frame prediction modes of pre-reconstructed reference pixels at multiple positions near the prediction mode block; and a prediction sample generation unit, which is configured to perform intra-frame prediction on pixels in each pixel group using the intra-frame prediction mode of each pixel group.

[0011] Beneficial Effects

[0012] As described above, according to the implementation scheme, by providing such an intra-frame prediction device and method, the compression performance of the image encoding and decoding device can be improved, and the intra-frame prediction device and method are used to derive the intra-frame prediction mode of the current block with reference to the intra-frame prediction mode of the previously reconstructed adjacent block, perform intra-frame prediction based on the derived intra-frame prediction mode, and generate predicted samples of the current block. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is an exemplary block diagram of an image encoding device capable of implementing the technology of the present invention.

[0014] Figure 2 2 is a schematic diagram showing a method of partitioning a block using a Quad Tree, Binary Tree, and Ternary Tree (QTBTTT) structure.

[0015] Figure 3a and Figure 3b A plurality of intra prediction modes including a wide-angle intra prediction mode are exemplarily shown.

[0016] Figure 4 This is an exemplary block diagram of an image decoding device capable of implementing the technology of the present invention.

[0017] Figure 5 is a block diagram of an intra prediction apparatus according to an embodiment of the present invention.

[0018] Figure 6 is an exemplary diagram illustrating a reference position for deriving a prediction mode according to an embodiment of the present invention.

[0019] Figure 7 is an exemplary diagram illustrating a derived prediction mode according to an embodiment of the present invention.

[0020] Figure 8is an exemplary diagram illustrating a derived prediction mode according to another embodiment of the present invention.

[0021] Fig. 9 is an exemplary diagram illustrating locations of previously reconstructed reference samples for generating intra-predicted samples according to an embodiment of the present invention.

[0022] Fig.10 is an exemplary diagram illustrating locations of previously reconstructed reference samples for generating intra-predicted samples according to another embodiment of the present invention.

[0023] Fig.11 is an exemplary diagram illustrating intra prediction of a chroma block according to an embodiment of the present invention.

[0024] Fig.12 is a flowchart of an intra prediction method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that when reference numerals are added to the constituent elements in the various drawings, the same reference numerals also represent the same elements even though the elements are shown in different drawings. In addition, in the following description of the embodiments, the detailed description of the known functions and configurations incorporated herein will be omitted to avoid blurring the subject matter of the embodiments.

[0026] Figure 1 is an exemplary block diagram of a video encoding device capable of implementing the technology of the present invention. Figure 1 A video encoding apparatus and elements of the apparatus are described.

[0027] The video encoding device includes: an image divider 110, a predictor 120, a subtractor 130, a transformer 140, a quantizer 145, a rearrangement unit 150, an entropy encoder 155, an inverse quantizer 160, an inverse transformer 165, an adder 170, a filtering unit 180 and a memory 190.

[0028] Each element of the video encoding device may be implemented in hardware or software, or a combination of hardware and software. The functions of each element may be implemented as software, and a microprocessor may be implemented to execute the software functions corresponding to each element.

[0029] A video includes multiple images. Each image is divided into multiple regions, and encoding is performed on each region. For example, an image is divided into one or more tiles (tile) or / and slices (slice). Here, one or more tiles can be defined as tile groups. Each tile or slice is divided into one or more coding tree units (coding treeunit, CTU). Each CTU is divided into one or more coding units (coding unit, CU) through a tree structure. The information applied to each CU is encoded as the syntax of the CU, and the information commonly applied to the CU included in a CTU is encoded as the syntax of the CTU. In addition, the information commonly applied to all blocks in a slice is encoded as the syntax of the slice header, and the information applied to all blocks constituting an image is encoded in the picture parameter set (Picture Parameter Set, PPS) or the picture header. In addition, the information commonly referenced by multiple images is encoded in the sequence parameter set (Sequence Parameter Set, SPS). In addition, the information commonly referenced by one or more SPSs is encoded in the video parameter set (VideoParameter Set, VPS). Information commonly applied to one tile or tile group may be encoded as the syntax of a tile header or tile group header.

[0030] The image divider 110 determines the size of a coding tree unit (CTU). Information on the size of the CTU (CTU size) is encoded as a syntax of an SPS or a PPS and transmitted to a video decoding apparatus.

[0031] The image divider 110 divides each image constituting a video into a plurality of CTUs having a predetermined size, and then recursively divides the CTUs using a tree structure. In the tree structure, a leaf node is used as a coding unit (CU), which is a basic unit of coding.

[0032] The tree structure can be a quadtree (QuadTree, QT), a binary tree (BinaryTree, BT), a ternary tree (TernaryTree, TT), or a structure formed by a combination of two or more QT structures, BT structures and TT structures, wherein the quadtree (QT) is a node (or parent node) that is divided into four slave nodes (or child nodes) of the same size, the binary tree (BT) is a node that is divided into two slave nodes, and the ternary tree (TT) is a node that is divided into three slave nodes at a ratio of 1:2:1. For example, a quadtree plus binary tree (QuadTree plus BinaryTree, QTBT) structure can be used, or a quadtree plus binary tree ternary tree (QuadTree plus BinaryTree TernaryTree, QTBTTT) structure can be used. Here, BTTT can be collectively referred to as a multiple-type tree (MTT).

[0033] Figure 2 The QTBTTT segmentation tree structure is shown as an example. Figure 2 As shown, the CTU can be first split into a QT structure. The QT splitting can be repeated until the size of the split block reaches the minimum block size MinQTSize of the leaf node allowed in the QT. The first flag (QT_split_flag) indicating whether each node of the QT structure is split into four nodes of the lower layer is encoded by the entropy encoder 155 and notified to the video decoding device with a signal. When the leaf node of the QT is not larger than the maximum block size (MaxBTSize) of the root node allowed in the BT, it can be further split into one or more BT structures or TT structures. The BT structure and / or the TT structure can have multiple splitting directions. For example, there can be two directions, namely, a direction of splitting the blocks of nodes horizontally and a direction of splitting the blocks vertically. As Figure 2 As shown, when MTT splitting starts, the entropy encoder 155 encodes a second flag (mtt_split_flag) indicating whether the node is split, a flag indicating the splitting direction (vertical or horizontal) in the case of splitting, and / or a flag indicating the splitting type (binary or trifurcated), and notifies the video decoding device with a signal.

[0034] Alternatively, before encoding the first flag (QT_split_flag) indicating whether each node is split into 4 nodes of the lower layer, the CU split flag (split_cu_flag) indicating whether the node is split may be encoded. When the value of the CU split flag (split_cu_flag) indicates that the split is not performed, the block of the node becomes a leaf node in the split tree structure and is used as a coding unit (CU), which is a basic unit of encoding. When the value of the CU split flag (split_cu_flag) indicates that the split is performed, the video encoding device starts encoding the flags from the first flag in the above-described manner.

[0035] When QTBT is used as another example of a tree structure, there may be two types of segmentation, namely, a type of horizontally segmenting a block into two blocks of the same size (i.e., symmetrical horizontal segmentation) and a type of vertically segmenting a block into two blocks of the same size (i.e., symmetrical vertical segmentation). The entropy encoder 155 encodes a segmentation flag (split_flag) indicating whether each node of the BT structure is segmented into blocks of the lower layer and segmentation type information indicating the segmentation type, and transmits it to the video decoding device. There may be an additional type of segmenting a block of a node into two asymmetric blocks. The asymmetric segmentation type may include a type of segmenting a block into two rectangular blocks at a size ratio of 1:3, or a type of segmenting a block of a node diagonally.

[0036] A CU may have various sizes according to the QTBT or QTBTTT partitioning of a CTU. Hereinafter, a block corresponding to a CU to be encoded or decoded (i.e., a leaf node of a QTBTTT) is referred to as a "current block". When QTBTTT partitioning is adopted, the shape of the current block may be a square or a rectangle.

[0037] The predictor 120 predicts the current block to generate a predicted block. The predictor 120 includes an intra predictor 122 and an inter predictor 124.

[0038] Typically, each current block in an image can be predictively encoded. Typically, the prediction of the current block is performed using an intra-frame prediction technique (which uses data from an image including the current block) or an inter-frame prediction technique (which uses data from an image encoded before the image including the current block). Inter-frame prediction includes unidirectional prediction and bidirectional prediction.

[0039] The intra-frame predictor 122 predicts pixels in the current block using pixels (reference pixels) around the current block in the current image including the current block. There are multiple intra-frame prediction modes according to the prediction direction. For example, Figure 3aAs shown, multiple intra prediction modes may include 2 non-directional modes and 65 directional modes, wherein the 2 non-directional modes include a planar mode and a DC mode. The neighboring pixels and equations to be used are defined differently for each prediction mode. The following table lists the intra prediction mode numbers and their names.

[0040] In order to perform effective directional prediction for the current block of rectangular shape, the additional use of Figure 3b The dotted arrows in the figure indicate the directional modes (intra-prediction modes 67 to 80 and -1 to -14). These modes may be referred to as "wide-angle intra-prediction modes". Figure 3b In the figure, the arrows indicate the corresponding reference samples used for prediction without indicating the prediction direction. The prediction direction is opposite to the direction indicated by the arrow. The wide-angle intra prediction mode is a mode in which prediction is performed in a direction opposite to a specific direction mode without additional bit transmission when the current block is a rectangular shape. In this case, in the wide-angle intra prediction mode, some wide-angle intra prediction modes that can be used for the current block can be determined based on the ratio of the width to the height of the rectangular current block. For example, when the current block has a rectangular shape with a height less than the width, a wide-angle intra prediction mode (intra prediction modes 67 to 80) with an angle less than 45 degrees can be used. When the current block has a rectangular shape with a width greater than the height, a wide-angle intra prediction mode (intra prediction modes -1 to -14) with an angle greater than -135 degrees can be used.

[0041] The intra-frame predictor 122 may determine an intra-frame prediction mode to be used when encoding the current block. In some examples, the intra-frame predictor 122 may encode the current block using several intra-frame prediction modes and select an appropriate intra-frame prediction mode to be used from the tested modes. For example, the intra-frame predictor 122 may calculate rate-distortion values ​​using rate-distortion analysis of several tested intra-frame prediction modes and may select an intra-frame prediction mode having the best rate-distortion characteristics from the tested modes.

[0042] The intra predictor 122 selects an intra prediction mode from a plurality of intra prediction modes and predicts the current block using adjacent pixels (reference pixels) and equations according to the selected intra prediction mode. Information about the selected intra prediction mode is encoded by the entropy encoder 155 and transmitted to the video decoding device.

[0043] The inter-frame predictor 124 generates a prediction block for the current block by motion compensation. The inter-frame predictor 124 searches for a block that is most similar to the current block in a reference image that has been encoded and decoded earlier than the current image, and uses the searched block to generate a prediction block for the current block. Then, the inter-frame predictor generates a motion vector corresponding to the displacement between the current block in the current image and the prediction block in the reference image. Typically, motion estimation is performed on the luminance component, and the motion vector calculated based on the luminance component is used for both the luminance component and the chrominance component. Motion information including information about the reference image and information about the motion vector used to predict the current block is encoded by the entropy encoder 155 and transmitted to the video decoding device.

[0044] The subtractor 130 subtracts the prediction block generated by the intra predictor 122 or the inter predictor 124 from the current block to generate a residual block.

[0045] The transformer 140 transforms the residual signal in the residual block having pixel values ​​in the spatial domain into a transform coefficient in the frequency domain. The transformer 140 may transform the residual signal in the residual block using the entire size of the residual block as a transform unit. Alternatively, the residual block may be divided into a plurality of sub-blocks, and the transform may be performed using the sub-block as a transform unit. Alternatively, the residual signal may be transformed by dividing the block into two sub-blocks, namely a transform region and a non-transform region, and using only the transform region sub-block as a transform unit. Here, the transform region sub-block may be one of two rectangular blocks having a size ratio of 1:1 based on a horizontal axis (or a vertical axis). In this case, the entropy encoding unit 155 encodes a flag (cu_sbt_flag) indicating that only the sub-block is transformed, direction (vertical / horizontal) information (cu_sbt_horizontal_flag) and / or position information (cu_sbt_pos_flag), and notifies the video decoding device with a signal. In addition, the size of the transform region subblock may have a size ratio of 1:3 based on the horizontal axis (or vertical axis). In this case, a flag (cu_sbt_quad_flag) distinguishing the corresponding partition is additionally encoded by the entropy encoder 155 and signaled to the video decoding apparatus.

[0046] The transformer 140 can transform the residual block separately in the horizontal direction and the vertical direction. For the transformation, various types of transformation functions or transformation matrices can be used. For example, paired transformation functions for horizontal transformation and vertical transformation can be defined as a multiple transform set (MTS). The transformer 140 can select a pair of transformation functions with the best transformation efficiency in the MTS, and transform the residual block in the horizontal direction and the vertical direction respectively. The information (mts_idx) about the transformation function pair selected in the MTS is encoded by the entropy encoder 155 and notified to the video decoding device with a signal. The size of the transform block to which the MTS is applied can be limited to 32×32.

[0047] The quantizer 145 quantizes the transform coefficient output from the transformer 140 , and outputs the quantized transform coefficient to the entropy encoder 155 .

[0048] The rearrangement unit 150 may reorganize coefficient values ​​of the quantized residual value.

[0049] The rearrangement unit 150 can change the 2D coefficient array into a 1D coefficient sequence by coefficient scanning. For example, the rearrangement unit 150 can scan the coefficients from the DC coefficient to the coefficients in the high frequency region by zig-zag scanning or diagonal scanning to output a 1D coefficient sequence. According to the size of the transform unit and the intra-frame prediction mode, the zig-zag scan can be replaced by a vertical scan or a horizontal scan, wherein the vertical scan is to scan the two-dimensional array of coefficients in the column direction, and the horizontal scan is to scan the coefficients in the two-dimensional block shape in the row direction. That is, the scanning mode to be used can be determined among the zig-zag scan, the diagonal scan, the vertical scan, and the horizontal scan according to the size of the transform unit and the intra-frame prediction mode.

[0050] The entropy encoder 155 encodes the one-dimensional quantized transform coefficient output from the rearrangement unit 150 using various encoding techniques such as Context-based Adaptive Binary Arithmetic Code (CABAC) and exponential Golomb to generate a bitstream.

[0051] The entropy encoder 155 encodes information related to block partitioning (e.g., CTU size, CU partition flag, QT partition flag, MTT partition type, and MTT partition direction) so that the video decoding device can partition the block in the same manner as the video encoding device. In addition, the entropy encoder 155 encodes information about a prediction type indicating whether the current block is encoded by intra-frame prediction or inter-frame prediction, and encodes intra-frame prediction information (i.e., information about an intra-frame prediction mode) or inter-frame prediction information (information about a reference image index and a motion vector) according to the prediction type.

[0052] The inverse quantizer 160 inversely quantizes the quantized transform coefficient output from the quantizer 145 to generate a transform coefficient. The inverse transformer 165 transforms the transform coefficient output from the inverse quantizer 160 from the frequency domain to the spatial domain, and reconstructs a residual block.

[0053] The adder 170 adds the reconstructed residual block to the prediction block generated by the predictor 120 to reconstruct the current block. When performing intra prediction of a subsequent block, pixels in the reconstructed current block are used as reference pixels.

[0054] The filtering unit 180 filters the reconstructed pixels to reduce blocking artifacts, ringing artifacts, and blurring artifacts caused by block-based prediction and transform / quantization. The filtering unit 180 may include a deblocking filter 182 and a pixel adaptive offset (SAO) filter 184.

[0055] The deblocking filter 180 filters the boundary between the reconstructed blocks to remove the block artifacts caused by block-by-block encoding / decoding, and the SAO filter 184 performs additional filtering on the deblocking filtered video. The SAO filter 184 is a filter for compensating for the difference between the reconstructed pixels and the original pixels caused by lossy encoding.

[0056] The reconstructed blocks filtered by the deblocking filter 182 and the SAO filter 184 are stored in the memory 190. Once all blocks in one image are reconstructed, the reconstructed image can be used as a reference image for inter-frame prediction of blocks in subsequent images to be encoded.

[0057] Figure 4 is an exemplary functional block diagram of a video decoding device capable of implementing the technology of the present invention. Figure 4 A video decoding apparatus and elements of the apparatus are described.

[0058] The video decoding apparatus may include an entropy decoder 410 , a rearrangement unit 415 , an inverse quantizer 420 , an inverse transformer 430 , a predictor 440 , an adder 450 , a filtering unit 460 , and a memory 470 .

[0059] Similar to Figure 1 In the video encoding device of the present invention, each element of the video decoding device can be implemented by hardware, software, or a combination of hardware and software. In addition, the function of each element can be implemented as software, and the microprocessor can be implemented to execute the software function corresponding to each element.

[0060] The entropy decoder 410 determines a current block to be decoded by decoding a bit stream generated by a video encoding device and extracting information related to block partitioning, and extracts prediction information required for reconstructing the current block, information on a residual signal, and the like.

[0061] The entropy decoder 410 extracts information about the CTU size from a sequence parameter set (SPS) or a picture parameter set (PPS), determines the size of the CTU, and divides the image into CTUs of the determined size. Then, the decoder determines the CTU as the highest level of the tree structure, that is, the root node, and extracts partition information about the CTU to partition the CTU using the tree structure.

[0062] For example, when the CTU is segmented using the QTBTTT structure, the first flag (QT_split_flag) related to the segmentation of the QT is extracted to segment each node into four nodes of the sublayer. For the node corresponding to the leaf node of the QT, the second flag (MTT_split_flag) related to the segmentation of the MTT and the information about the segmentation direction (vertical / horizontal) and / or the segmentation type (binary / trifurcated) are extracted to segment the corresponding leaf node with the MTT structure. Thus, each node below the leaf node of the QT is recursively segmented with the BT or TT structure.

[0063] As another example, when a CTU is split using a QTBTTT structure, a CU split flag (split_cu_flag) indicating whether the CU is split may be extracted. When the corresponding block is split, a first flag (QT_split_flag) may be extracted. In a split operation, after zero or more recursive QT splits, zero or more recursive MTT splits may occur for each node. For example, a CTU may directly undergo MTT splitting without undergoing QT splitting, or may only undergo multiple QT splits.

[0064] As another example, when the CTU is segmented using the QTBT structure, the first flag (QT_split_flag) related to the QT segmentation is extracted, and each node is segmented into four nodes of the lower layer. Then, the segmentation flag (split_flag) indicating whether the node corresponding to the leaf node of the QT is further segmented with the BT and the segmentation direction information are extracted.

[0065] Once the current block to be decoded is determined by tree structure partitioning, the entropy decoder 410 extracts information about the prediction type indicating whether the current block is intra-predicted or inter-predicted. When the prediction type information indicates intra-prediction, the entropy decoder 410 extracts syntax elements for intra-prediction information (intra-prediction mode) of the current block. When the prediction type information indicates inter-prediction, the entropy decoder 410 extracts syntax elements for inter-prediction information (i.e., information indicating a motion vector and a reference image referenced by the motion vector).

[0066] The entropy decoder 410 also extracts information about the quantized transform coefficient of the current block as information about the residual signal.

[0067] The rearrangement unit 415 may change a sequence of one-dimensional quantized transform coefficients entropy-decoded by the entropy decoder 410 into a 2-dimensional coefficient array (ie, block) in the reverse order of coefficient scanning performed by the video encoding apparatus.

[0068] The inverse quantizer 420 inversely quantizes the quantized transform coefficients. The inverse transformer 430 inversely transforms the inversely quantized transform coefficients from the frequency domain to the spatial domain to reconstruct a residual signal, thereby generating a residual block of the current block.

[0069] In addition, when the inverse transformer 430 performs inverse transformation on only a partial region (sub-block) of the transform block, the inverse transformer 430 extracts a flag (cu_sbt_flag) indicating that only the sub-block of the transform block has been transformed, directional (vertical / horizontal) information (cu_sbt_horizontal_flag) about the sub-block, and / or position information (cu_sbt_pos_flag) about the sub-block, and inversely transforms the transform coefficient of the sub-block from the frequency domain to the spatial domain. Then, the residual signal is reconstructed, and the region without inverse transformation is filled with a "0" value as a residual block, thereby generating a residual block of the final current block.

[0070] In addition, when MTS is applied, the inverse transformer 430 uses the MTS information (mts_idx) notified by the video encoding device using a signal to determine the transformation function or transformation matrix to be applied in the horizontal direction and the vertical direction, respectively, and uses the determined transformation function to inversely transform the transformation coefficients in the transformation block in the horizontal direction and the vertical direction.

[0071] The predictor 440 may include an intra predictor 442 and an inter predictor 444. The intra predictor 442 is activated when the prediction type of the current block is intra prediction, and the inter predictor 444 is activated when the prediction type of the current block is inter prediction.

[0072] The intra predictor 442 determines an intra prediction mode of a current block among a plurality of intra prediction modes based on a syntax element of the intra prediction mode extracted from the entropy decoder 410 , and predicts the current block using reference pixels around the current block according to the intra prediction mode.

[0073] The inter predictor 444 determines a motion vector of a current block and a reference image referred to by the motion vector using a syntax element of the inter prediction mode extracted from the entropy decoder 410 , and predicts the current block based on the motion vector and the reference image.

[0074] The adder 450 reconstructs the current block by adding the residual block output from the inverse transformer 430 and the prediction block output from the inter predictor 444 or the intra predictor 442. When intra-predicting a subsequent block to be decoded, pixels in the reconstructed current block are used as reference pixels.

[0075] The filtering unit 460 may include a deblocking filter 462 and an SAO filter 464. The deblocking filter 462 performs deblocking filtering on the boundaries between the reconstructed blocks to remove block artifacts caused by block-by-block decoding. The SAO filter 464 performs additional filtering on the reconstructed blocks after deblocking filtering the corresponding offsets to compensate for the difference between the reconstructed pixels and the original pixels caused by lossy coding. The reconstructed blocks filtered by the deblocking filter 462 and the SAO filter 464 are stored in the memory 470. When all blocks in one image are reconstructed, the reconstructed image is used as a reference image for inter-frame prediction of blocks in subsequent images to be encoded.

[0076] This embodiment discloses a new intra-frame prediction technology, which can be implemented by the image encoding and decoding device described above. More specifically, an intra-frame prediction device and method are provided, which are used to refer to the intra-frame prediction mode of the previously reconstructed adjacent block to derive the intra-frame prediction mode of the current block, and use the derived intra-frame prediction mode to perform intra-frame prediction.

[0077] Figure 5 is a block diagram of an intra prediction apparatus according to an embodiment of the present invention.

[0078] In an embodiment according to the present invention, the intra prediction device 500 refers to the intra prediction mode of the previously reconstructed adjacent block, rather than the transmission of the prediction mode, to derive the prediction mode, and uses the derived prediction mode to perform intra prediction on the current block. The intra prediction device 500 includes an entropy decoder 410 and an intra predictor 442 included in the decoding device.

[0079] The operation of the intra predictor 122 included in the encoding device is similar to that of the intra predictor 442 included in the decoding device, and thus the following description will focus on the intra predictor 442 included in the decoding device.

[0080] The intra prediction apparatus 500 according to this embodiment uses a prediction derivation mode (hereinafter referred to as a derivation mode) to improve the efficiency of intra prediction.

[0081] The entropy decoder 410 decodes information about whether the derivation mode is applied to the prediction mode block from the bitstream. Here, the prediction mode block refers to a block unit in which prediction information including the derivation mode is transmitted. In the following, for ease of description, the current block indicates a prediction mode block.

[0082] In order to use the derivation mode, the encoding device may transmit mode information about whether to use the derivation mode by using a bit stream, and the decoding device may determine whether to apply the derivation mode by using the corresponding information. The mode information may be information in the form of a flag indicating whether to use the prediction derivation mode. Alternatively, the mode information may be information in the form of an index indicating one of a plurality of intra-frame prediction modes, the plurality of intra-frame prediction modes further including the derivation mode as a new intra-frame prediction mode.

[0083] When the derivation mode is applied, the intra-frame predictor 442 according to the embodiment refers to the intra-frame prediction mode of the previously reconstructed adjacent block to derive the intra-frame prediction mode of the prediction mode block and its sub-partition structure. The intra-frame predictor 442 may include all or some of the reference position setting unit 502, the prediction mode derivation unit 504 and the predicted sample generation unit 506.

[0084] Figure 6 is an exemplary diagram illustrating a reference position for deriving a prediction mode according to an embodiment of the present invention.

[0085] like Figure 6 As shown, the reference position setting unit 502 may use pixels (pixels a to j) of adjacent blocks (blocks B to G) as reference pixels to derive the prediction mode of the prediction mode block A (M×N, M and N are natural numbers) and its sub-partition structure.

[0086] The reference position setting unit 502 can adaptively set the reference position according to the partition structure of the pre-constructed blocks near the prediction mode block. Figure 6 When the image is partitioned into blocks B to G as shown in FIG. 1 , the pixels at predetermined positions of the blocks B to G (for example, the pixels at the lower right corner of each block) can be set as reference positions. Figure 6 As shown, the reference position setting unit 502 may use a predefined position (eg, pixel a, d, g, or an additional pixel c at the center of an upper row, or pixel i or h at the center of a left column) as a reference position.

[0087] In addition, the reference position setting unit 502 may use a predefined position in the reference position group (e.g., one of pixels a, b, and j, one of pixels d and e, one of pixels g and f, etc.) as a reference position. For example, in the case of the reference position group {a, b, j}, whether the reference pixel is a valid reference pixel is determined in the order of a, b, j, and the first valid position is set as the reference position. Here, the valid reference pixel may refer to a pixel in which intra-frame prediction is used and has a corresponding intra-frame prediction mode. In addition, in the case of the reference position group {d, e} or {g, f}, the reference position may be set in the order of d and e or in the order of g and f.

[0088] The reference position setting unit 502 can adaptively set the reference position according to the dimension of the prediction mode block (the number of horizontal pixels, the number of vertical pixels, the product of the number of horizontal pixels and the number of vertical pixels, etc.). For example, in the case of "the number of horizontal pixels" > "the number of vertical pixels", more reference positions can be set on the top side, and vice versa, more reference positions can be set on the left side. The preset number of reference positions can be determined according to the predefined positions as described above, and the reference position can be added at the center of the longer side.

[0089] Furthermore, the reference position setting unit 502 may set the number of reference positions according to the product of the number of horizontal pixels and the number of vertical pixels, and may use the set number of predefined positions as the reference positions as described above.

[0090] The reference position setting unit 502 may set the reference position at a predetermined position according to an agreement between the encoding device and the decoding device.

[0091] As described above, the reference position setting unit 502 may determine the reference position using at least one of the dimension of the prediction mode block, a position predetermined according to an agreement between the encoding device and the decoding device, and a partition structure of blocks near the prediction mode block.

[0092] On the other hand, alternatively, information about available reference positions may be transmitted from the encoding device to the decoding device. In this case, the reference position setting unit 502 determines the reference position using the received information.

[0093] When the derivation mode according to this embodiment is applied, the intra-frame predictor 442 can partition the prediction mode block into a pixel group including one or more pixels. The pixel group including multiple pixels is collectively represented as a partition block or a sub-block, and intra-frame prediction can be performed in units of each partition block. Therefore, the prediction mode block in which the derivation mode is decoded will not have the same level as the block in which the intra-frame prediction is performed.

[0094] According to the partition structure of the prediction mode block, the pixel group may be in the form of a block such as a square, rectangle or triangle, or in the form of a linear unit such as M×1 or 1×N. On the other hand, the pixel groups obtained by partitioning may have the same size and form.

[0095] In another embodiment of the present invention, the pixel group may include only one pixel. In yet another embodiment, the pixel group may be a prediction mode block. That is, the pixel group may include all pixels of the prediction mode block.

[0096] When the prediction mode block is partitioned into pixel groups, the decoding apparatus may derive information about the partition structure from the prediction mode block and neighboring blocks, or receive the information from the encoding apparatus.

[0097] The decoding device may determine the partition structure according to the dimension of the prediction mode block (the number of horizontal pixels, the number of vertical pixels, the product of the number of horizontal pixels and the number of vertical pixels, etc.). For example, a horizontal partition structure in which "the number of horizontal pixels" > "the number of vertical pixels" may be used, or conversely, a vertical partition structure may be used. In addition, the decoding device may set the number of pixel groups according to the product of the number of horizontal pixels and the number of vertical pixels.

[0098] The decoding device may use predetermined partition information according to an agreement between the encoding device and the decoding device. For example, the prediction mode block may always be partitioned into multiple sub-blocks of the same size horizontally or vertically. The number of sub-blocks may be determined according to the dimension of the prediction mode block. Alternatively, the prediction mode block may always be partitioned into sub-blocks of a fixed size (e.g., 4×4).

[0099] The decoding device may use the partition structure of the block near the prediction mode block. For example, when there is an adjacent block of the same size as the prediction mode block, the partition structure of the adjacent block may be used or referenced without change. As another example, Figure 7As shown in (a), when multiple blocks are on the left side of the prediction mode block, the prediction mode block can be partitioned horizontally by extending the horizontal boundary line between the blocks. Similarly, if multiple blocks are on the top side of the prediction mode block, the prediction mode block can be partitioned vertically by extending the vertical boundary line between the multiple blocks.

[0100] As described above, the intra-frame predictor 442 of the image decoding device can determine the partition structure of the prediction mode block based on the dimension of the prediction mode block, a predetermined partition structure agreed upon between the encoding device and the decoding device, and all or some combinations of the partition structures of blocks near the prediction mode block.

[0101] In another embodiment of the present invention, information on the partition structure of the prediction mode block may be transmitted from the encoding device.

[0102] In another embodiment of the present invention, a list of partition structures of the prediction mode block may be generated, and the partition structure may be selected from the list.

[0103] Figure 7 is an exemplary diagram illustrating prediction mode derivation according to an embodiment of the present invention.

[0104] The prediction mode derivation unit 504 derives the prediction mode of the current block using the reference positions of the neighboring blocks in units of pixel groups.

[0105] exist Figure 7 In the example of , a rectangle indicated by a thick solid line represents a prediction mode block, and a dotted line represents a unit in which a prediction mode block is partitioned and intra prediction is performed therein, that is, a partition block (a pixel group in the form of a block). Figure 7 (a) shows a case where the prediction mode block is equally divided into two parts horizontally. Figure 7 (b) shows a case where the prediction mode block is equally divided into four parts vertically.

[0106] The prediction mode deriving unit 504 may derive the prediction mode of the prediction mode block using the prediction modes indicated by at least two reference positions. Figure 7 In the example of , the prediction mode deriving unit 504 uses the prediction modes of three adjacent reference positions to derive the prediction mode of the prediction mode block.

[0107] exist Figure 7 In the example of , the dotted arrow indicates the prediction mode of the adjacent block, and the solid arrow indicates the prediction mode of each partition block derived from the prediction mode of the adjacent block. The setting of the adjacent reference position and the derivation of the prediction mode can be performed by the encoding device and the decoding device in the same manner.

[0108] The prediction mode derivation unit 504 derives the intra prediction mode of each partition block based on the position of each partition block in the current block by using at least one of the reference positions. The intra prediction mode of the partition block is likely to be similar to the intra prediction mode of the nearby reference position. Therefore, the prediction mode of the corresponding partition block is bound to be affected by the reference position closer to the partition block. For example, the weight of each reference position can be determined based on the distance between each partition block and the reference position. The closer the distance, the greater the weight that can be assigned. Here, the position of the partition block can be the position of the central pixel of the partition block.

[0109] The prediction mode derivation unit 504 may derive the intra prediction direction of each partition block by weighted summing the prediction directions of the reference positions based on the weight of each reference position. Alternatively, the prediction mode closest to the weighted sum among all intra prediction modes may be derived as the prediction mode of the corresponding partition block.

[0110] In another embodiment of the present invention, when the pixel group includes one pixel, the intra prediction mode may be derived in units of each pixel in the prediction mode block.

[0111] Figure 8 is an exemplary diagram illustrating prediction mode derivation according to another embodiment of the present invention.

[0112] exist Figure 8 In the example of , a rectangle indicated by a thin line refers to a pixel of a current block on which intra prediction is performed.

[0113] exist Figure 8 In the example (a), the dotted arrows indicate the prediction mode of each neighboring pixel, while Figure 8 In the example (b) of FIG. 5 , the adjacent pixels including three dotted arrows are reference positions set for reference. Referring to the prediction modes of the three reference positions, the prediction mode derivation unit 504 can determine the intra prediction mode of each pixel in the current block, such as Figure 8 as shown in (b).

[0114] The prediction mode derivation unit 504 uses at least one of the reference positions to derive the intra-frame prediction mode of the corresponding pixel based on the position of each pixel in the current block. The prediction mode of the corresponding pixel will inevitably be affected by the reference position closer to the partition block. For example, the weight of each reference position can be determined according to the distance between each pixel and the reference position.

[0115] The prediction mode derivation unit 504 may derive the intra prediction mode of the corresponding pixel by weighted summing the prediction directions of the reference positions based on the weight of each reference position. Alternatively, the prediction mode closest to the weighted sum among all intra prediction modes may be derived as the prediction mode of the corresponding pixel.

[0116] On the other hand, when the prediction mode of the set reference position is not useful, the prediction mode deriving unit 504 can replace the reference position with a new position near the prediction mode block. In addition, when the prediction modes of all reference positions are not useful, the prediction mode of the current block can be determined as one of the prediction modes preset between the encoding device and the decoding device.

[0117] According to the above-described embodiments of the present invention, a plurality of partition units (eg, one pixel, one line, and partition blocks) of a prediction mode block may have different prediction modes. It is not necessary to separately signal information about the intra prediction mode for each partition unit.

[0118] On the other hand, in another embodiment, when the pixel group is the entire prediction mode block, the prediction mode derivation unit 504 may derive an intra-frame prediction mode of the prediction mode block according to the intra-frame prediction modes of multiple reference positions. For example, the intra-frame prediction mode of the entire current block may be derived by averaging the intra-frame prediction modes (prediction directions) of multiple reference positions.

[0119] The predicted sample generation unit 506 according to the embodiment generates predicted samples by predicting the prediction mode block (current block) in units of pixel groups according to the intra prediction mode derived by the prediction mode derivation unit 504 .

[0120] Fig. 9 is an exemplary diagram illustrating locations of previously reconstructed reference samples for generating intra-predicted samples according to an embodiment of the present invention.

[0121] exist Fig. 9 In the example of , the portion indicated by the circle refers to the reference sample included in the pre-reconstructed block referenced by the current block A. The range of the reference sample may be extended according to the usefulness of the reference sample corresponding to the decoding order and the range of the intra prediction mode. In addition, the intra predictor 442 may determine the prediction ranges Mr and Nr according to M and N, which are the size of the current block A, and the range of the intra prediction mode.

[0122] The predicted sample generation unit 506 can use the intra-frame prediction mode derived in units of pixel groups according to the following example: Fig. 9 The predicted samples are generated from sample values ​​of pre-reconstructed reference samples near the prediction mode block as shown.

[0123] In the case of an implementation scheme in which an intra prediction mode is derived for each partition block obtained by partitioning the prediction mode block, the predicted sample generation unit 506 determines a reference sample of a target pixel to be predicted in the corresponding partition block according to the intra prediction mode derived for the partition block. In addition, the target pixel is predicted using the sample value of the determined reference sample.

[0124] In the case of another embodiment in which the intra prediction mode is derived in units of pixels in a prediction mode block, the predicted sample generation unit 506 determines a pre-reconstructed reference sample using the intra prediction mode derived for the corresponding pixel, and predicts the corresponding pixel using a sample value of the determined reference sample.

[0125] In the case of another embodiment in which one intra prediction mode is derived for the entirety of the prediction mode block, the predicted sample generation unit 506 uses the intra prediction mode of the prediction mode block to determine a pre-reconstructed reference sample for a target pixel to be predicted in the prediction mode block. In addition, the sample value of the determined reference sample is used to predict the target pixel.

[0126] Fig.10 is an exemplary diagram illustrating locations of previously reconstructed reference samples for generating intra-predicted samples according to another embodiment of the present invention.

[0127] In the case of an implementation scheme in which the prediction mode block is partitioned into K (K is a natural number) partition blocks (dashed rectangles), the predicted sample generation unit 506 performs intra prediction using the sample value of the reference sample, such as Fig.10 shown.

[0128] exist Fig.10 In the example of , the rectangle indicated by the thick line is the position of the reference sample with respect to the boundary of the prediction mode block, and the rectangle indicated by the thin line is the position of the reference sample with respect to the boundary of the partition block A.

[0129] When intra prediction is performed on the partition block A in the prediction mode block, the predicted sample generation unit 506 may generate the predicted sample using the sample value of the reference sample at the boundary of the prediction mode block, or may use the pre-reconstructed partition block as the reference sample about the boundary of the partition block A. The reference sample to be used may be determined by agreement between the encoding device and the decoding device. Alternatively, information indicating the reference sample to be used may be signaled in units of blocks (e.g., each partition block and prediction mode block).

[0130] In order to use the pre-reconstructed partition blocks in the prediction mode block as reference samples, the partition blocks in the prediction mode block need to be sequentially reconstructed. That is, the first partition block in the prediction mode block is predicted in a predefined order (e.g., raster scan order), and then the first partition block is reconstructed by adding the corresponding residual signal to the predicted partition block. The samples in the reconstructed partition block are used as reference samples to predict the subsequent partition blocks adjacent to the reconstructed partition block. For example, in Fig.10In the example, the decoding device can predict and reconstruct the upper left partition block by the prediction mode corresponding to the block derivation (i.e., generate the final reconstructed samples in combination with the residual), and then use the reconstructed samples in the upper left partition block when reconstructing the upper right partition block.

[0131] In another embodiment, the predicted samples in the previously predicted partition block can be used as reference samples for predicting the subsequent partition block. That is, the predicted sample generation unit 506 predicts any one of the partition blocks in the prediction mode block in a predefined order (e.g., a raster scan order). Then, the predicted samples in the predicted partition block (the block is not a reconstructed block generated by adding the predicted samples and the residual signal) are used to predict the pixels in the subsequent partition block.

[0132] The intra prediction mode derivation technique described above can be used for both luma blocks and chroma blocks. Alternatively, the intra prediction mode of the chroma block can be determined by the intra prediction mode of the luma block using intra direct mode (DM).

[0133] Fig.11 is an exemplary diagram illustrating intra prediction of a chroma block according to an embodiment of the present invention.

[0134] like Fig.11 As shown, the intra prediction mode derived for each pixel group in the luminance block can be set as the intra prediction mode of the pixel group at the corresponding position in the chrominance block. The intra predictor 442 performs intra prediction on each pixel group in the chrominance block using the intra prediction mode corresponding to the pixel group.

[0135] On the other hand, when color components have different resolutions, the intra predictor 442 may use the intra prediction mode of the luma block sampled according to a specific sampling method as the prediction mode of the chroma block.

[0136] Fig.12 is a flowchart of an intra prediction method according to an embodiment of the present invention.

[0137] The intra-frame prediction device 500 according to this embodiment decodes mode information indicating the use of the prediction derivation mode of the prediction mode block from the bit stream (S1200). Here, the prediction mode block refers to a block unit that transmits prediction information including the prediction derivation mode (hereinafter referred to as "derivation mode"). In the following, for the convenience of description, the current block indicates the prediction mode block.

[0138] In order to use the derivation mode, the encoding device may transmit mode information about whether to use the derivation mode by using a bit stream, and the decoding device may determine whether to apply the derivation mode by using the corresponding information. The mode information may be information in the form of a flag indicating whether to use the prediction derivation mode. Alternatively, the mode information may be information in the form of an index indicating one of a plurality of intra-frame prediction modes, the plurality of intra-frame prediction modes further including the derivation mode as a new intra-frame prediction mode.

[0139] When the derivation mode according to this embodiment is applied, the intra prediction device 500 can partition the prediction mode block into a pixel group including one or more pixels. The pixel group including a plurality of pixels is collectively represented as a partition block or a sub-block, and intra prediction can be performed in units of each partition block. Therefore, the prediction mode block in which the derivation mode is decoded will not have the same level as the block in which intra prediction is performed.

[0140] According to the partition structure of the prediction mode block, the pixel group may be in the form of a block such as a square, rectangle or triangle, or in the form of a linear unit such as M×1 or 1×N. On the other hand, the pixel groups obtained by partitioning may have the same size and form.

[0141] In another embodiment of the present invention, the pixel group may include only one pixel. In yet another embodiment, the pixel group may be a prediction mode block. That is, the pixel group may include all pixels of the prediction mode block.

[0142] The intra prediction apparatus 500 sets a plurality of reference positions according to pre-reconstructed blocks near the prediction mode block for each pixel group including one or more pixels in the prediction mode block (S1202).

[0143] The intra prediction apparatus 500 may determine the reference position using at least one of a dimension of the prediction mode block, a position predetermined according to an agreement between the encoding apparatus and the decoding apparatus, and a partition structure of a block near the prediction mode block.

[0144] On the other hand, alternatively, information about available reference positions may be transmitted from the encoding apparatus to the decoding apparatus. In this case, the intra prediction apparatus 500 determines the reference position using the received information.

[0145] The intra prediction apparatus 500 derives an intra prediction mode for each pixel group according to the intra prediction modes of the plurality of reference positions (S1204).

[0146] The intra prediction device 500 derives the intra prediction mode of each partition block based on the position of each partition block in the current block by using at least one of the reference positions. That is, the prediction mode of the corresponding partition block is bound to be affected by the reference position closer to the partition block. For example, the weight of each reference position can be determined according to the distance between each partition block and the reference position. The closer the distance, the greater the weight that can be assigned.

[0147] The intra prediction device 500 can derive the intra prediction direction of each partition block by weighted summing the prediction directions of the reference positions based on the weight of each reference position. Alternatively, the prediction mode closest to the weighted sum among all intra prediction modes can be derived as the prediction mode of the corresponding partition block.

[0148] On the other hand, when the prediction mode of the reference position is not useful, the intra-frame prediction device 500 can replace the reference position with a new position near the prediction mode block. In addition, when the prediction modes of all reference positions are not useful, the prediction mode of the current block can be determined as one of the prediction modes preset between the encoding device and the decoding device.

[0149] The setting of the adjacent reference positions and the derivation of the prediction mode may be performed by the encoding device and the decoding device in the same manner.

[0150] The intra prediction device 500 may derive the intra prediction mode of the current block to be the same as the intra prediction mode of its neighboring blocks. The intra prediction device 500 first selects multiple directions according to the neighboring blocks, and then selects a mode in one of the directions as the intra prediction mode of the current block, or may calculate the intra prediction mode of the current block according to the prediction modes of multiple neighboring blocks.

[0151] The intra prediction apparatus 500 performs intra prediction on pixels in each pixel group using the intra prediction mode of the corresponding pixel group ( S1206 ).

[0152] The intra prediction apparatus 500 may generate predicted samples according to sample values ​​of pre-reconstructed reference samples near a prediction mode block by using an intra prediction mode derived in units of pixel groups.

[0153] In the case of an implementation scheme in which an intra prediction mode is derived for each partition block obtained by partitioning the prediction mode block, the predicted sample generation unit 506 determines a reference sample of a target pixel to be predicted in the corresponding partition block according to the intra prediction mode derived for the partition block. In addition, the target pixel is predicted using the sample value of the determined reference sample.

[0154] In order to use the pre-reconstructed partition blocks in the prediction mode block as reference samples, it is necessary to sequentially reconstruct the partition blocks in the prediction mode block. That is, the first partition block in the prediction mode block is predicted in a predefined order (e.g., a raster scan order), and then the first partition block is reconstructed by adding a corresponding residual signal to the predicted partition block. The samples in the reconstructed partition block can be used as reference samples for predicting subsequent partition blocks adjacent to the reconstructed partition block.

[0155] As described above, according to this embodiment, by providing such an intra-frame prediction device and method, the compression performance of the image encoding and decoding device can be improved, and the intra-frame prediction device and method are used to derive the intra-frame prediction mode of the current block with reference to the intra-frame prediction mode of the previously reconstructed adjacent block, perform intra-frame prediction based on the derived intra-frame prediction mode, and generate predicted samples of the current block.

[0156] Generally, when natural images are partitioned into blocks for intra prediction, a block and its neighboring blocks have similar image characteristics. Therefore, intra prediction modes can be similar. Considering such characteristics, there is an intra prediction method using a Most Probable Mode (MPM) list, which is generated based on the prediction modes of the neighboring blocks to the left and above the current block.

[0157] First, the encoding device transmits an MPM flag indicating whether the prediction mode of the current block is generated from the MPM list. When the prediction mode of the current block is included in the MPM list, the encoding device transmits an MPM index to the decoding device, which indicates the intra-frame prediction mode of the current block in the intra-frame prediction mode of the MPM list. The decoding device can select a prediction mode from the MPM list using the received index, and can perform intra-frame prediction on the current block. On the other hand, when the prediction mode of the current block is not included in the MPM list, the encoding device can transmit residual mode information to the decoding device, which residual mode information indicates the prediction mode of the current block in the residual prediction mode other than the prediction mode included in the MPM list.

[0158] In another embodiment of the present invention, a method for determining the intra prediction mode of a prediction mode block using MPM is disclosed. The intra predictor 442 creates an MPM list based on the prediction mode block. That is, the intra predictor 442 generates the MPM list using the intra prediction modes of blocks near the prediction mode block (left neighboring blocks and upper neighboring blocks).

[0159] On the other hand, the intra predictor 442 partitions the prediction mode block into a plurality of sub-blocks. The partitioning method may be the same as the partitioning method of the prediction derivation mode described above. In addition, the MPM list created based on the prediction mode block is shared with all sub-blocks in the prediction mode block. That is, the same MPM list is used for multiple sub-blocks.

[0160] As an example, the intra-frame prediction mode of each sub-block in the prediction mode block can be determined from the MPM list. In this case, the MPM index of each sub-block can be notified by signal from the encoding device to the decoding device. The intra-frame predictor 442 of the decoding device can determine the intra-frame prediction mode of the corresponding sub-block from the shared MPM list through the received MPM index. The intra-frame prediction mode determined for the previously predicted sub-block in the prediction mode block may not be used as the intra-frame prediction mode of the subsequent sub-block. To this end, the intra-frame prediction mode for the previously predicted sub-block can be deleted from the MPM list. In this way, the total number of bits required to signal the MPM index of all sub-blocks in the prediction mode block can be reduced.

[0161] As another example, information about the intra-frame prediction mode of a sub-block in a prediction mode block (an MPM flag and an MPM index or residual mode information corresponding to the MPM flag) can be signaled from the encoding device to the decoding device. The intra-frame predictor 442 of the decoding device determines the intra-frame prediction mode of the sub-block using the received information. In this case, the intra-frame prediction mode used to determine the sub-block previously predicted in the prediction mode block will not be used as the intra-frame prediction mode of the subsequent sub-block. To this end, the intra-frame prediction mode used to determine the previously predicted sub-block can be deleted from the MPM list or can be deleted from the residual prediction mode list. Thereby, the total number of bits required to signal the MPM index and residual mode information of all sub-blocks in the prediction mode block can be reduced.

[0162] Although it has been described that each process is sequentially performed in each flowchart according to the embodiment, the present invention is not limited thereto. In other words, the process of the flowchart can be changed, or one or more processes can be performed in parallel, and the flowchart is not limited to the time series order.

[0163] On the other hand, the various methods or functions described in the present invention can be implemented as instructions stored in a non-volatile recording medium, which can be read and executed by one or more processors. For example, a non-volatile recording medium includes any type of recording device that stores data in a form that can be read by a computer system. For example, a non-volatile recording medium includes storage media such as an erasable programmable read-only memory (EPROM), a flash drive, an optical drive, a magnetic hard drive, and a solid-state drive (SSD).

[0164] Although exemplary embodiments of the present invention have been described for illustrative purposes, it will be appreciated by those skilled in the art that various modifications and changes are possible without departing from the spirit and scope of the present invention. For the sake of brevity and clarity, exemplary embodiments have been described. Accordingly, it will be appreciated by those of ordinary skill that the scope of the embodiments is not limited by the embodiments explicitly described above, but is included in the claims and their equivalents.

[0165] Reference numerals

[0166] 120, 440: predictor 130: subtractor

[0167] 170, 450: adder 180, 460: filter unit

[0168] 442: Intra-frame predictor

[0169] 500: Inter-frame prediction device 502: Reference position setting unit

[0170] 504: Prediction model derivation unit

[0171] 506: predicted sample generation unit.

[0172] CROSS-REFERENCE TO RELATED APPLICATIONS

[0173] This application claims priority under 35 U.S.C. §119(a) to Patent Application No. 10-2019-0031727 filed in Korea on March 20, 2019, and Patent Application No. 10-2019-0034277 filed in Korea on March 20, 2020, the entire contents of which are incorporated herein by reference. In addition, for the same reasons as above, this patent application claims priority in countries other than the United States, and the entire contents of which are incorporated herein by reference.

Claims

1. An intra-frame prediction method used by a video decoding device, the method include: decoding, from a bitstream, mode information indicating use of a prediction derivation mode for a prediction mode block, wherein the prediction derivation mode indicates that an intra prediction mode is derived and used for the prediction mode block; For each pixel group including one or more pixels in the prediction mode block, deriving an intra prediction mode for each pixel group according to intra prediction modes of pre-reconstructed reference pixels at a plurality of locations near the prediction mode block; and The pixels in each pixel group are intra-predicted using the intra-prediction mode of each pixel group.

2. The method according to claim 1, further comprising: include: The position of the reference pixel of each pixel group is set according to a pre-reconstructed block near the prediction mode block.

3. The method according to claim 2, in, The position of the reference pixel is determined based on some or all of the following methods: a method of determining the position using the dimension of the prediction mode block, a method of setting the determined position according to a predetermined convention, and a method of determining the position using the partition structure of blocks near the prediction mode block.

4. The method according to claim 1, in, The mode information is a flag indicating whether the prediction derivation mode is used, or an index indicating a prediction derivation mode among a plurality of intra prediction modes including the prediction derivation mode.

5. The method according to claim 1, in, The intra prediction mode of each pixel group is derived from the intra prediction modes of one or more reference pixels based on the corresponding position of each pixel group in the prediction mode block.

6. The method according to claim 5, in, The intra prediction mode of each pixel group is derived by assigning weights to the intra prediction modes of the reference pixels of each pixel group according to the distance from the reference pixels and performing weighted summation on the intra prediction modes of the reference pixels.

7. The method according to claim 1, in, Each pixel group includes one pixel.

8. The method according to claim 1, in, Each pixel group is obtained by partitioning the prediction mode block in at least one of a horizontal direction or a vertical direction, and is one of sub-blocks including a plurality of pixels.

9. The method according to claim 8, in, The sub-blocks are partitioned into the same form and size as each other.

10. The method according to claim 8, in, The prediction mode block is partitioned into sub-blocks based on at least one of a dimension of the prediction mode block, a predefined scheme according to a predetermined convention, and a partition form of blocks near the prediction mode block.

11. The method according to claim 1, further comprising: include: Information on the partition structure of the prediction mode block is decoded from the bitstream, and each pixel group is generated using the information on the partition structure.

12. The method according to claim 1, in, The intra prediction includes generating prediction samples of pixels of each pixel group using pre-constructed pixels of neighboring prediction mode blocks.

13. The method according to claim 1, in, The intra prediction includes sequentially reconstructing each pixel group included in the prediction mode block, and The pre-reconstructed pixels in the pre-reconstructed pixel group of the prediction mode block are used to perform intra-frame prediction on a pixel group adjacent to the pre-reconstructed pixel group.

14. The method according to claim 1, in, The intra prediction includes sequentially performing intra prediction on each pixel group included in the prediction mode block, and The predicted pixels in the pre-predicted pixel group of the prediction mode block are used to perform intra-frame prediction on a pixel group adjacent to the pre-reconstructed pixel group.

15. An intra-frame prediction method used by a video encoding device, the method include: obtaining mode information indicating use of a prediction derivation mode for a prediction mode block, wherein the prediction derivation mode indicates that an intra prediction mode is derived and used for the prediction mode block; For each pixel group including one or more pixels in the prediction mode block, deriving an intra prediction mode for each pixel group based on intra prediction modes of pre-reconstructed reference pixels at a plurality of locations near the prediction mode block; Using the intra prediction mode of each pixel group, performing intra prediction on pixels in each pixel group; and Encodes mode information.

16. The method according to claim 15, further comprising: include: The position of the reference pixel of each pixel group is set according to a pre-reconstructed block near the prediction mode block.

17. The method according to claim 15, in, A partition structure for partitioning the prediction mode block into each pixel group is determined based on at least one of a dimension of the prediction mode block, a predefined scheme according to a predetermined convention, and a partition structure of blocks adjacent to the prediction mode block.

18. A method for providing video data to a video decoding device, the method include: Encoding video data into a bitstream; as well as Sending a bitstream to a video decoding device, The encoding of the video data includes: obtaining mode information indicating use of a prediction derivation mode for a prediction mode block, wherein the prediction derivation mode indicates that an intra prediction mode is derived and used for the prediction mode block; For each pixel group including one or more pixels in the prediction mode block, deriving an intra prediction mode for each pixel group based on intra prediction modes of pre-reconstructed reference pixels at a plurality of locations near the prediction mode block; Using the intra prediction mode of each pixel group, performing intra prediction on pixels in each pixel group; and Encodes mode information.

Citation Information

Patent Citations

  • Apparatus for stacking paper money

    KR1020190031727A

  • Vapor etching device and vapor etching equipment

    KR1020190034277A

  • Audio-video-coding-standard (AVS)-based intra-frame prediction method

    CN102186086A

  • Image decoding apparatus

    CN103931180A

  • Intra-frame prediction method for inter-frame prediction frame

    CN108259913A