Image decoding method

The inter prediction method optimizes reference unit selection and use in video encoding/decoding, addressing inefficiencies in high-definition and ultra-high-definition video processing to enhance encoding/decoding efficiency and compression performance.

JP2024159991AActive Publication Date: 2024-11-08ELECTRONICS & TELECOMM RES INST
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024150866
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2011-12-13
Filing Date
2024-09-02
Publication Date
2024-11-08
Estimated Expiration
2031-12-13

AI Technical Summary

Technical Problem

Existing video encoding and decoding technologies face inefficiencies in handling high-definition and ultra-high-definition video content, particularly in inter prediction and reference unit determination, which affect the overall encoding/decoding efficiency.

Method used

An inter prediction method that selects candidate units from reconstructed adjacent units, determines a reference unit based on specific criteria such as size, depth, and coding parameters, and uses these units for efficient inter prediction and motion compensation.

Benefits of technology

Improves the efficiency of video encoding and decoding by optimizing the selection and use of reference units, leading to enhanced compression performance and reduced bit transmission.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024159991000001_ABST
    Figure 2024159991000001_ABST
Patent Text Reader

Abstract

To provide an inter prediction method and device.SOLUTION: An inter prediction method comprises: a step of selecting candidate units from among reconstructed neighbor units; a step of creating a candidate unit set with respect to units to be decoded, by using the selected candidate units; a step of determining a reference unit from among the candidate units which constitute the created candidate unit set; and a step of performing inter prediction on the units to be decoded, by using the determined reference unit. According to the present invention, efficiency of video encoding / decoding can be improved.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to video processing, and more particularly to an inter-prediction method and apparatus. [Background technology]

[0002] Recently, as broadcasting services with HD (High Definition) resolution are expanding not only domestically but also globally, many users are becoming accustomed to high-resolution, high-quality images, and as a result, many organizations are spurring the development of next-generation imaging devices. In addition, interest in UHD (Ultra High Definition), which has a resolution four times that of HDTV, is growing along with HDTV, and compression techniques for higher resolution, higher quality images are being demanded.

[0003] For video compression, techniques such as inter prediction, which predicts pixel values ​​contained in a current picture from previous and / or subsequent pictures, intra prediction, which predicts pixel values ​​contained in a current picture using pixel information within the current picture, and entropy coding, which assigns short codes to symbols that occur frequently and long codes to symbols that occur less frequently, can be used. Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to provide a video encoding method and apparatus capable of improving the efficiency of video encoding / decoding.

[0005] Another technical object of the present invention is to provide a video decoding method and apparatus capable of improving the efficiency of video encoding / decoding.

[0006] Another technical object of the present invention is to provide an inter prediction method and apparatus capable of improving efficiency of video encoding / decoding.

[0007] Another technical object of the present invention is to provide a method and apparatus for determining a reference unit capable of improving the efficiency of video encoding / decoding. [Means for solving the problem]

[0008] An embodiment of the present invention is an inter prediction method, comprising the steps of: selecting a candidate unit from among reconstructed neighboring units; generating a candidate unit set for a unit to be decoded using the selected candidate unit; determining a reference unit from among the candidate units constituting the generated candidate unit set; and performing inter prediction for the unit to be decoded using the determined reference unit, wherein the reconstructed neighboring units include an upper neighboring unit adjacent to the upper side of the unit to be decoded, a left neighboring unit adjacent to the left side of the unit to be decoded, a right upper corner unit located at the right upper corner of the unit to be decoded, a left upper corner unit located at the left upper corner of the unit to be decoded, and a left lower corner unit located at the left lower corner of the unit to be decoded.

[0009] In the candidate unit selection step, the upper adjacent unit, the left adjacent unit, the upper right corner unit, the upper left corner unit, and the lower left corner unit are selected as the candidate units.

[0010] In the candidate unit selection step, the upper adjacent unit and the left adjacent unit are selected as the candidate units.

[0011] In the candidate unit selection step, a unit adjacent to the current unit to be decoded, the length of whose boundary is equal to or longer than a predetermined threshold, is selected as the candidate unit from among the reconstructed adjacent units.

[0012] In the candidate unit selection step, a unit having a size equal to or larger than a predetermined threshold is selected as the candidate unit from among the restored adjacent units.

[0013] In the candidate unit selection step, a unit having a depth value equal to or less than a predetermined threshold is selected as the candidate unit from among the reconstructed adjacent units.

[0014] In the candidate unit selection step, the candidate unit is selected based on the relative length between the boundaries where the reconstructed adjacent units are adjacent to the unit to be decoded, the relative size between the reconstructed adjacent units, or the relative depth value between the reconstructed adjacent units.

[0015] In the candidate unit selection step, the candidate unit is selected using at least one of the encoding parameters of the unit to be decoded and the encoding parameters of the reconstructed neighboring unit, and the encoding parameters of the unit to be decoded and the encoding parameters of the reconstructed neighboring unit each include at least one of a motion vector, a reference picture list, a reference picture index, a prediction direction, and a motion vector predictor.

[0016] The first encoding parameters of the unit to be decoded include a first reference picture list and a first reference picture index, and the candidate unit selection step further includes a step of selecting a unit having second encoding parameters as the candidate unit, and the second encoding parameters include at least one of a second reference picture list that is identical to the first reference picture list and a second reference picture index that is identical to the first reference picture index.

[0017] In the candidate unit selection step, a unit having the same reference picture as the reference picture of the current unit to be decoded is selected as the candidate unit.

[0018] In the candidate unit selection step, only units coded by inter prediction are selected as the candidate units.

[0019] In the candidate unit set generation step, the selected candidate unit and a collocated unit are used together to generate the candidate unit set, and the collocated unit is a unit that is at the same spatial position as the unit to be decoded among units in a reference picture for the unit to be decoded.

[0020] In the candidate unit selection step, a predetermined fixed number of units are selected as the candidate units.

[0021] The predetermined fixed number of units is selected based on similarity between the encoding parameters of the unit to be decoded and the encoding parameters of the reconstructed neighboring units, and the encoding parameters of the unit to be decoded and the encoding parameters of the reconstructed neighboring units each include at least one of a motion vector, a reference picture list, a reference picture index, a prediction direction, and a motion vector predictor.

[0022] The predetermined fixed number of units is selected based on identity between the reference pictures of the current unit and the reference pictures of the reconstructed neighboring units.

[0023] The candidate unit selection step includes a step of receiving an encoding parameter identifier, a step of decoding the received encoding parameter identifier, and a step of selecting the candidate unit based on an encoding parameter value assigned to the decoded encoding parameter identifier, the encoding parameter value assigned to the encoding parameter identifier being at least one of a length of a boundary where the reconstructed adjacent unit adjoins the unit to be encoded, a size of the reconstructed adjacent unit, and a depth value of the reconstructed adjacent unit.

[0024] The reference unit determination step includes a step of receiving a reference unit identifier, a step of decoding the received reference unit identifier, and a step of determining the reference unit using the decoded reference unit identifier, wherein the reference unit identifier is an identifier indicating a unit to be determined as a reference unit from among the candidate units that constitute the candidate unit set.

[0025] The codeword length assigned to the reference unit identifier is shorter as the probability that the unit indicated by the reference unit identifier is determined as the reference unit is higher.

[0026] The candidate unit set generation step further includes a step of sorting the candidate units in order of the probability of being determined as the reference unit, and in the reference unit determination step, the first unit from the sorted candidate units is determined as the reference unit.

[0027] In the candidate unit set generation step, only one unit among the candidate units that has the highest probability of being determined as the reference unit is included in the candidate unit set, and in the reference unit determination step, the one unit included in the candidate unit set is determined as the reference unit. Effect of the Invention

[0028] According to the video encoding method of the present invention, the efficiency of video encoding / decoding can be improved.

[0029] According to the video decoding method according to the present invention, the efficiency of video encoding / decoding can be improved.

[0030] According to the inter prediction method according to the present invention, it is possible to improve the efficiency of video encoding / decoding.

[0031] According to the reference unit determination method according to the present invention, the efficiency of video encoding / decoding can be improved. [Brief description of the drawings]

[0032] [Figure 1] 1 is a block diagram showing a configuration of an embodiment of a video encoding device to which the present invention is applied; [Diagram 2] 1 is a block diagram showing a configuration of an embodiment of a video decoding device to which the present invention is applied; [Diagram 3] FIG. 1 is a conceptual diagram illustrating an embodiment in which one unit is divided into multiple sub-units; [Figure 4] 1 is a flow chart illustrating an example of a method for determining a reference unit in an encoder; [Diagram 5] FIG. 2 is a conceptual diagram illustrating an example of a method for generating a candidate unit set. [Figure 6] FIG. 13 is a conceptual diagram illustrating another embodiment of a method for generating a candidate unit set. [Figure 7] FIG. 13 is a conceptual diagram illustrating another embodiment of a method for generating a candidate unit set. [Figure 8] FIG. 13 is a conceptual diagram illustrating another embodiment of a method for generating a candidate unit set. [Figure 9] FIG. 13 is a conceptual diagram illustrating another embodiment of a method for generating a candidate unit set. [Figure 10] FIG. 2 is a conceptual diagram illustrating an example of a method for determining the order in which candidate units are included in a candidate unit set; [Figure 11]1 is a conceptual diagram illustrating a method for determining a reference unit in an encoder according to an embodiment of the present invention. [Figure 12] 11 is a conceptual diagram illustrating a method for determining a reference unit in an encoder according to another embodiment of the present invention. [Figure 13] 11 is a conceptual diagram illustrating a method for determining a reference unit in an encoder according to another embodiment of the present invention. [Figure 14] 1 is a flow chart illustrating an example of a reference unit determination method in a decoder; [Figure 15] 1 is a conceptual diagram illustrating a method for determining a reference unit in a decoder according to an embodiment of the present invention. [Figure 16] 11 is a conceptual diagram illustrating a method for determining a reference unit in a decoder according to another embodiment of the present invention. [Figure 17] 11 is a conceptual diagram illustrating a method for determining a reference unit in a decoder according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0033] Hereinafter, the embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the embodiments of the present invention, if a detailed description of related known configurations or functions is determined to obscure the gist of the present specification, the detailed description will be omitted.

[0034] When a component is described as being "connected" or "coupled" to another component, it should be understood that the component may be directly connected or coupled to the other component, but there may be other components in between. In addition, in the present invention, the content of a description that "includes" a specific component does not exclude components other than the component, but means that additional components may be included in the implementation of the present invention or within the scope of the technical idea of ​​the present invention.

[0035] Terms such as "first" and "second" may be used to describe various components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another. For example, a first component may be named a second component, and similarly, a second component may be named a first component, without departing from the scope of the present invention.

[0036] In addition, components shown in the embodiments of the present invention are illustrated independently to show different characteristic functions, and do not mean that each component is composed of separate hardware or a single software unit. That is, each component is included as a list of components for convenience of explanation, and at least two components among the components may be integrated into one component, or one component may be divided into multiple components to perform a function, and such integrated and separated embodiments of each component are included in the scope of the present invention as long as they do not deviate from the essence of the present invention.

[0037] In addition, some components are not essential components for performing essential functions in the present invention, but are optional components merely for improving performance. The present invention may be embodied including only components essential for embodying the essence of the present invention, excluding components merely used for improving performance, and a structure including only essential components, excluding optional components merely used for improving performance, is also included in the scope of the present invention.

[0038] FIG. 1 is a block diagram showing the configuration of an embodiment of a video encoding device to which the present invention is applied.

[0039] Referring to FIG. 1, the video encoding device 100 includes a motion prediction unit 111, a motion compensation unit 112, an intra prediction unit 120, a switch 115, a subtractor 125, a transform unit 130, a quantization unit 140, an entropy encoding unit 150, an inverse quantization unit 160, an inverse transform unit 170, an adder 175, a filter unit 180, and a reference picture buffer 190.

[0040] The video encoding device 100 may perform encoding in an intra mode or an inter mode on an input image and output a bitstream. Intra prediction means prediction within a frame, and inter prediction means prediction between frames. In the case of an intra mode, the switch 115 may be switched to intra, and in the case of an inter mode, the switch 115 may be switched to inter. The video encoding device 100 may generate a prediction block for an input block of an input image, and then encode a residual between the input block and the prediction block.

[0041] In the case of the intra mode, the intra prediction unit 120 may generate a prediction block by performing spatial prediction using pixel values ​​of already-encoded blocks surrounding the current block.

[0042] In the case of an inter mode, the motion prediction unit 111 may obtain a motion vector by searching for an area that best matches an input block in a reference image stored in the reference picture buffer 190 during the motion prediction process. The motion compensation unit 112 may generate a prediction block by performing motion compensation using the motion vector. Here, the motion vector is a two-dimensional vector used in inter prediction and may indicate an offset between a current image to be encoded / decoded and a reference image.

[0043] The subtractor 125 may generate a residual block based on the residual between the input block and the generated prediction block. The transform unit 130 may output a transform coefficient by performing a transform on the residual block. The quantization unit 140 may output a quantized coefficient by quantizing the input transform coefficient based on a quantization parameter.

[0044] The entropy coding unit 150 can output a bit stream by performing entropy coding based on the value calculated by the quantization unit 140 or the coding parameter value calculated during the coding process.

[0045] When entropy coding is applied, a smaller number of bits are assigned to symbols having a higher occurrence probability, and a larger number of bits are assigned to symbols having a lower occurrence probability to represent the symbols, thereby reducing the size of the bit string for the symbol to be coded. Therefore, the compression performance of the video coding can be improved through the entropy coding. The entropy coding unit 150 can use coding methods such as exponential golomb, CAVLC (Context-Adaptive Variable Length Coding), and CABAC (Context-Adaptive Binary Arithmetic Coding) for the entropy coding.

[0046] Since the video encoding apparatus according to the embodiment of Fig. 1 performs inter-prediction encoding, i.e., inter-frame predictive encoding, a currently encoded image needs to be decoded and stored in order to be used as a reference image. Therefore, the quantized coefficients are inverse quantized by the inverse quantization unit 160 and inverse transformed by the inverse transform unit 170. The inverse quantized and inverse transformed coefficients are added to the predicted block via the adder 175 to generate a reconstructed block.

[0047] The reconstructed block passes through a filter unit 180, which may apply at least one of a deblocking filter, a sample adaptive offset (SAO), and an adaptive loop filter (ALF) to the reconstructed block or the reconstructed picture. The filter unit 180 may also be called an adaptive in-loop filter. The deblocking filter may remove block distortion that occurs at the boundary between blocks. The SAO may add an appropriate offset value to pixel values ​​to compensate for coding errors. The ALF may perform filtering based on a value obtained by comparing a reconstructed image with an original image. The reconstructed block that has passed through the filter unit 180 may be stored in a reference picture buffer 190.

[0048] FIG. 2 is a block diagram showing the configuration of an embodiment of a video decoding device to which the present invention is applied.

[0049] Referring to FIG. 2, the video decoding apparatus 200 includes an entropy decoding unit 210, an inverse quantization unit 220, an inverse transform unit 230, an intra prediction unit 240, a motion compensation unit 250, an adder 255, a filter unit 260, and a reference picture buffer 270.

[0050] The video decoding apparatus 200 may receive a bitstream output from an encoder and perform decoding in an intra mode or an inter mode to output a reconstructed image, i.e., a restored image. In the intra mode, a switch may be converted to intra, and in the inter mode, a switch may be converted to inter. The video decoding apparatus 200 may obtain a residual block from the input bitstream to generate a prediction block, and then generate a reconstructed block, i.e., a restored block, by adding the residual block and the prediction block.

[0051] The entropy decoding unit 210 may entropy decode the input bit stream according to a probability distribution to generate symbols including symbols in the form of quantized coefficients. The entropy decoding method is the same as the entropy coding method described above.

[0052] When the entropy decoding method is applied, a smaller number of bits are assigned to symbols having a higher occurrence probability, and a larger number of bits are assigned to symbols having a lower occurrence probability to represent the symbols, thereby reducing the size of the bit string for each symbol. Therefore, the compression performance of the image decoding can be improved through the entropy decoding method.

[0053] The quantized coefficients are inverse quantized in the inverse quantization unit 220 and inverse transformed in the inverse transform unit 230, and a residual block may be generated as a result of the inverse quantization / inverse transformation of the quantized coefficients.

[0054] In the case of the intra mode, the intra prediction unit 240 may generate a prediction block by performing spatial prediction using pixel values ​​of already-encoded blocks surrounding the current block. In the case of the inter mode, the motion compensation unit 250 may generate a prediction block by performing motion compensation using a motion vector and a reference image stored in the reference picture buffer 270.

[0055] The residual block and the prediction block are added via an adder 255, and the added block may pass through a filter unit 260. The filter unit 260 may apply at least one of a deblocking filter, SAO, and ALF to the reconstructed block or the reconstructed picture. The filter unit 260 may output a reconstructed image, i.e., a reconstructed image. The reconstructed image may be stored in a reference picture buffer 270 and used for inter prediction.

[0056] Hereinafter, a unit refers to a unit of video encoding and decoding. A coding or decoding unit in video encoding and decoding refers to a divided unit when dividing an image and encoding or decoding the divided unit, and may be called a block, coding unit (CU), coding block, prediction unit (PU), prediction block, transform unit (TU), transform block, etc. Also, one unit may be divided into smaller sub-units.

[0057] Here, the prediction unit means a basic unit that is a unit of prediction and / or motion compensation. The prediction unit may be divided into a plurality of partitions, and each partition may be referred to as a prediction unit partition. When the prediction unit is divided into a plurality of partitions, each of the plurality of partitions is a basic unit that is a unit of prediction and / or motion compensation. Hereinafter, in the embodiment of the present invention, each partition into which the prediction unit is divided may also be referred to as a prediction unit.

[0058] Meanwhile, as described above, in the inter mode, the encoder and decoder may perform prediction and / or motion compensation on the target unit for encoding / decoding. Here, the target unit for encoding / decoding refers to a prediction unit and / or a prediction unit partition. In this case, the encoder and decoder may improve the efficiency of encoding / decoding by using a motion vector of a reconstructed neighboring unit. Here, the reconstructed neighboring unit is a unit that has already been encoded or decoded and restored, and may include a unit adjacent to the target unit for encoding / decoding, a unit located at the upper right corner of the target unit for encoding / decoding, a unit located at the upper left corner of the target unit for encoding / decoding, and / or a unit located at the lower left corner of the target unit for encoding / decoding.

[0059] For example, the encoder and decoder can use the motion vector of the reconstructed neighboring unit as the motion vector of the target unit for encoding / decoding. At this time, since the motion vector of the reconstructed neighboring unit is used in the target unit for encoding / decoding, the encoder does not code the motion vector for the target unit for encoding / decoding. Therefore, the amount of bits transmitted to the decoder can be reduced, and the coding efficiency can be improved. Such inter prediction modes include skip mode and / or direct mode.

[0060] In this case, the encoder may use an identifier and / or index indicating which of the reconstructed neighboring units a motion vector of which is to be used. The inter-prediction mode in which the identifier and / or index is used may be called a merge mode.

[0061] As another example, the encoder may perform prediction and / or compensation using the motion vector of the current unit, and then generate a motion vector difference between the motion vector of the current unit and the motion vector of the restored adjacent unit when encoding the motion vector of the current unit. The encoder may encode the generated motion vector difference and transmit it to the decoder. At this time, the decoder may decode the motion vector difference and derive the motion vector of the current unit through the sum of the decoded motion vector difference and the motion vector of the restored adjacent unit. Such an inter prediction method is also called MVP (Motion Vector Prediction). By using MVP, the amount of information transmitted from the encoder to the decoder can be reduced, and encoding efficiency can be improved.

[0062] In this case, the encoder may use an identifier and / or index indicating which of the reconstructed neighboring units the motion vector of which is to be used. MVP in which the identifier and / or index are additionally used is also called Advanced Motion Vector Prediction (AMVP).

[0063] In the above-mentioned skip mode, direct mode, merge mode, MVP, AMVP, etc., a reference unit is determined from among reconstructed neighboring units, and a motion vector of the determined reference unit can be used for prediction and / or motion compensation of a current target unit for encoding / decoding. Hereinafter, a reference unit refers to a unit used for prediction and / or motion compensation of a current target unit for encoding / decoding. When performing inter prediction and / or motion compensation for a current target unit for encoding / decoding, an encoder and a decoder can use coding parameters of the reference unit.

[0064] The coding parameters may include not only information that is coded by an encoder and transmitted to a decoder, such as a syntax element, but also information that can be inferred during coding or decoding, and refer to information required when coding or decoding an image. The coding parameters may include values ​​and / or statistics of, for example, an inter-prediction mode, motion information, a coded block pattern (CBP), a block size, block division information, etc.

[0065] Here, the motion information refers to parameters necessary for inter prediction and motion compensation. The motion information may include at least one of a reference picture list, a reference picture index, a motion vector, a prediction direction, and a motion vector predictor. Here, the reference picture list is a list consisting of a plurality of reference pictures used for inter prediction, and the reference picture index is an index indicating a reference picture used for inter prediction of a target unit to be encoded / decoded among reference pictures included in the reference picture list.

[0066] Two reference picture lists may be used in inter prediction, one of which may be called reference picture list 0 and the other may be called reference picture list 1. A prediction direction included in the motion information is information indicating which reference picture list is used in inter prediction. That is, the prediction direction may indicate whether reference picture list 0 is used, reference picture list 1 is used, or both reference picture list 0 and reference picture list 1 are used. A motion vector predictor refers to a unit that is a prediction candidate and / or a motion vector of a unit that is a prediction candidate when an encoder and a decoder predict a motion vector.

[0067] The block division information may include information regarding the depth of the unit. The depth information may indicate the number of times and / or the degree to which the unit is divided.

[0068] FIG. 3 is a conceptual diagram illustrating an embodiment in which one unit is divided into a number of sub-units.

[0069] A unit may be hierarchically divided with depth information under a tree structure. Each divided subunit may have depth information. The depth information may include information on the size of the subunit to indicate the number and / or degree to which the unit is divided.

[0070] Referring to 310 in Figure 3, the most upper node may be called a root node and may have the smallest depth value, in which case the most upper node may have a depth of level 0 and may indicate the first unit that is not divided.

[0071] A lower node having a depth of level 1 may indicate a unit in which the original unit is divided once, and a lower node having a depth of level 2 may indicate a unit in which the original unit is divided twice. For example, in 320 of FIG. 3, unit a corresponding to node a is a unit in which the original unit is divided once, and may have a depth of level 1.

[0072] A leaf node at level 3 may indicate a unit that is a result of dividing the first unit three times. For example, in 320 of FIG. 3, unit d corresponding to node d is a unit that is a result of dividing the first unit three times, and may have a depth of level 3. Therefore, the leaf node at level 3, which is the lowest node, may have the deepest depth.

[0073] As described above, when performing inter prediction and / or motion compensation using skip mode, direct mode, merge mode, MVP, AMVP, etc., the encoder and decoder may determine a reference unit from among reconstructed neighboring units and use a motion vector of the determined reference unit. Reconstructed neighboring units adjacent to a target unit to be encoded / decoded may have different characteristics, and for example, the characteristics may be indicated by respective coding parameters of the reconstructed neighboring units. Therefore, when determining a reference unit and encoding / decoding it, the encoder and decoder need to efficiently use coding parameters of a video. In addition, one picture may include units of various sizes and units of various depths. Therefore, in order to improve the performance of encoding / decoding, a method of determining a reference unit in consideration of the diversity of unit sizes and / or depths may be provided.

[0074] FIG. 4 is a flow chart that illustrates an example of a method for determining a reference unit in an encoder.

[0075] Referring to FIG 4, an encoder may generate a candidate unit set using reconstructed neighboring units (S410). Here, the candidate unit set refers to a set of reference unit candidates. A reference unit used for prediction and / or motion compensation of a currently encoded unit may be determined from the reference unit candidates. Hereinafter, the term "candidate unit" may have the same meaning as the term "reference unit candidate."

[0076] The encoder may select a candidate unit from among the reconstructed neighboring units according to a predetermined criterion and / or method. In this case, the encoder may use coding parameters of the encoding target unit and / or coding parameters of the reconstructed neighboring units to reflect video characteristics. The encoder may include and / or insert the selected candidate unit into a candidate unit set to generate a candidate unit set. A specific example of a method for generating a candidate unit set will be described later.

[0077] Also, referring to FIG. 4, the encoder may determine a reference unit to be used for prediction and / or motion compensation of the currently encoded unit from among the candidate units included in the generated set of candidate units (S420).

[0078] When the reference unit is determined, the encoder may perform inter prediction for the encoding target unit using the determined reference unit. In this case, the encoder may use a method such as skip mode, direct mode, merge mode, MVP, or AMVP when performing inter prediction and / or motion compensation. A specific example of a reference unit determination method will be described later.

[0079] When the reference unit is determined, the encoder can encode the reference unit identification information and transmit it to the decoder (S430). The reference unit identification information includes an encoding parameter identifier, a reference unit identifier, etc., and a specific embodiment of a method for encoding the reference unit identification information will be described later.

[0080] FIG. 5 is a conceptual diagram illustrating an example of a method for generating a candidate unit set.

[0081] The encoder may select units adjacent to the encoding target unit and units located at the corners of the encoding target unit from among the reconstructed neighboring units as candidate units to be included in the candidate unit set. The encoding target unit on which inter prediction and / or motion compensation is performed is a prediction unit.

[0082] Hereinafter, the unit adjacent to the top of the unit to be coded is called the top adjacent unit, and the unit adjacent to the left of the unit to be coded is called the left adjacent unit. Also, the unit located in the top right corner of the unit to be coded is called the top right corner unit, the unit located in the top left corner of the unit to be coded is called the top left corner unit, and the unit located in the bottom left corner of the unit to be coded is called the bottom left corner unit.

[0083] Referring to 510 of Figure 5, the encoder can select the left adjacent unit (A), the upper adjacent unit (B), the right upper corner unit (C), the left upper corner unit (D), and the left lower corner unit (E) as candidate units included in the candidate unit set. In this case, as an embodiment, the generated candidate unit set can be configured as {A, B, C, D, E}.

[0084] Referring to 520 of FIG. 5, the encoder may select the left adjacent unit (A, B, C), the upper adjacent unit (D, E, F), the upper right corner unit (G), the upper left corner unit (H), and the lower left corner unit (M) as candidate units included in the candidate unit set. In this case, as an embodiment, the generated candidate unit set may be configured as {H, D, E, F, G, A, B, C, M}.

[0085] In the above embodiment, the encoder may select only a specific unit among the left adjacent units as a candidate unit. For example, the encoder may select only the unit located at the bottom of the left adjacent units as a candidate unit. The encoder may also select only a specific unit among the upper adjacent units as a candidate unit. For example, the encoder may select only the unit located at the rightmost position of the upper adjacent units as a candidate unit. In this case, the candidate unit set generated in 520 of FIG. 5 is {H, F, G, C, M}.

[0086] FIG. 6 is a conceptual diagram showing an outline of another embodiment of the method for generating a set of candidate units.

[0087] The encoder can select, from among the reconstructed adjacent units, a unit adjacent to the left of the unit to be coded and a unit adjacent to the upper side of the unit to be coded as candidate units and include them in a candidate unit set.

[0088] Referring to 610 in Figure 6, the encoder can select the left adjacent unit (A) and the upper adjacent unit (B) as candidate units included in the candidate unit set. In this case, in one embodiment, the generated candidate unit set can be configured as {A, B}.

[0089] Referring to 620 in Figure 6, the encoder may select the left adjacent unit (A, B, C) and the upper adjacent unit (D, E, F) as candidate units included in the candidate unit set. In this case, in one embodiment, the generated candidate unit set may be composed of {D, E, F, A, B, C}.

[0090] Fig. 7 is a conceptual diagram showing another embodiment of a candidate unit set generation method. In the embodiment of Fig. 7, the size of the encoding target unit (X) is assumed to be 16x16, the size of the C, D, H, and M units is assumed to be 8x8, and the size of the remaining units is assumed to be 4x4.

[0091] As described above in FIG. 6, the encoder may select, from among the restored adjacent units, the unit adjacent to the left of the unit to be coded and the unit adjacent to the upper side of the unit to be coded as candidate units. In this case, the encoder may select, from among the left adjacent units and the upper adjacent units, only units whose boundary length adjacent to the unit to be coded is equal to or longer than a predetermined length as candidate units and include them in the candidate unit set. Hereinafter, the boundary where the unit to be coded and the restored adjacent units are adjacent is referred to as an adjacent boundary.

[0092] Referring to FIG. 7, the encoder can select only units whose boundary length adjacent to the encoding target unit is 8 or more as candidate units. The C and D units have a size of 8×8 and a boundary length between the encoding target unit and the C and D units is 8, so they can be selected as candidate units to be included in the candidate unit set. Meanwhile, the A, B, E, and F units have a size of 4×4 and a boundary length between the encoding target unit and the A, B, E, and F units is 4, so they are not selected as candidate units to be included in the candidate unit set. In this case, as an example, the generated candidate unit set is {C, D}.

[0093] As another example, the encoder may select a candidate unit to be included in the candidate unit set based on the relative lengths of the neighboring boundaries of the left neighboring unit and the upper neighboring unit, i.e., the encoder may select a candidate unit by comparing the neighboring boundary lengths of units adjacent to the encoding target unit.

[0094] For example, if there are two adjacent units among the restored adjacent units, one with an adjacent boundary length of 4 and the other with an adjacent boundary length of 8, the encoder may include only the latter unit with the relatively longer adjacent boundary length in the candidate unit set. As another example, if there are two adjacent units among the restored adjacent units, one with an adjacent boundary length of 16 and the other with an adjacent boundary length of 4, the encoder may include only the latter unit with the relatively shorter adjacent boundary length in the candidate unit set.

[0095] Fig. 8 is a conceptual diagram showing another embodiment of a candidate unit set generation method. In the embodiment of Fig. 8, the size of the encoding target unit (X) is assumed to be 16x16, the size of the C, D, H, and M units is assumed to be 8x8, and the size of the remaining units is assumed to be 4x4.

[0096] As described above in FIG. 5, the encoder may select, from among the restored adjacent units, units adjacent to the encoding target unit and units located at the corners of the encoding target unit as candidate units. In this case, the encoder may select only units having a predetermined size or more from among the units adjacent to the encoding target unit and units located at the corners of the encoding target unit as candidate units and include them in the candidate unit set. Here, the predetermined size is m*n (m is a positive integer, n is a positive integer).

[0097] Referring to FIG. 8, the encoder can select only units having a size of 8×8 or more as candidate units. Since the C, D, H, and M units have a size of 8×8, they can be selected as candidate units to be included in the candidate unit set. Meanwhile, since the A, B, E, F, and G units have a size of 4×4, they cannot be selected as candidate units to be included in the candidate unit set. In this case, as an embodiment, the generated candidate unit set can be configured as {C, D, H, M}.

[0098] As another example, the encoder may select a candidate unit to be included in the candidate unit set based on the relative size of the reconstructed neighboring units. That is, the encoder may select a candidate unit by comparing the sizes of the reconstructed neighboring units. For example, if there are reconstructed neighboring units with a size of 8×8 and reconstructed neighboring units with a size of 16×16, the encoder may include only the latter unit with a relatively larger size in the candidate unit set.

[0099] 9 is a conceptual diagram showing another embodiment of a candidate unit set generation method. In the embodiment of FIG. 9, the depth value of the encoding target unit (X) is assumed to be 0, the depth values ​​of the C, D, H, and M units are assumed to be 1, and the depth values ​​of the remaining units are assumed to be 2.

[0100] As described above in FIG. 5, the encoder may select, from among the restored neighboring units, units adjacent to the encoding target unit and units located at the corners of the encoding target unit as candidate units. In this case, the encoder may select only units that are equal to or less than a predetermined depth from among the units adjacent to the encoding target unit and units located at the corners of the encoding target unit as candidate units and include them in the candidate unit set. Here, the predetermined depth is n (n is a positive integer).

[0101] Referring to Figure 9, the encoder can select only units having a depth of 1 or less as candidate units. C, D, H, and M units can be selected as candidate units to be included in the candidate unit set because they have a depth of 1. Meanwhile, A, B, E, F, and G units cannot be selected as candidate units to be included in the candidate unit set because they have a depth of 2. In this case, as an example, the generated candidate unit set can be configured as {H, D, C, M}.

[0102] As another example, the encoder may select a candidate unit to be included in the candidate unit set based on the relative depth of the reconstructed neighboring units. That is, the encoder may select a candidate unit by comparing the depths of the reconstructed neighboring units with each other. For example, if there are a reconstructed neighboring unit with a depth of 0 and a reconstructed neighboring unit with a depth of 2, the encoder may include only the former unit with a relatively smaller depth value in the candidate unit set.

[0103] In another embodiment, the encoder may select a candidate unit included in the candidate unit set using the encoding parameters of the current unit and / or the encoding parameters of the reconstructed neighboring units. In this case, the encoder may select a candidate unit using the encoding parameter correlation between the current unit and the reconstructed neighboring units, or may select a candidate unit using only the encoding parameters of the reconstructed neighboring units.

[0104] For example, the encoder may determine whether the motion information of the reconstructed neighboring units is the same as the motion information of the unit to be coded, and then select only units having the same motion information as the unit to be coded from among the reconstructed neighboring units as candidate units and include them in a candidate unit set. For example, the motion information may be at least one of a motion vector, a reference picture list, a reference picture index, a prediction direction, and a motion vector predictor.

[0105] As another example, the encoder may determine whether the motion information of the reconstructed neighboring units is similar to the motion information of the unit to be encoded, and then select only units having similar motion information to the unit to be encoded from among the reconstructed neighboring units as candidate units and include them in a candidate unit set. For example, the motion information may be at least one of a motion vector, a reference picture list, a reference picture index, a prediction direction, and a motion vector predictor. If the motion information of the reconstructed neighboring units and the motion information of the unit to be encoded are not completely the same but satisfy a certain criterion, they may be determined to be similar to each other.

[0106] An example of a case where the motion information of the reconstructed adjacent unit and the motion information of the target unit to be coded are similar is as follows. For example, if a component-specific magnitude difference between the motion vector of the reconstructed adjacent unit and the motion vector of the target unit to be coded is less than a predetermined magnitude in integer pixel units, it may be determined that the motion information of the reconstructed adjacent unit and the motion information of the target unit to be coded are similar. Here, the predetermined magnitude is any natural number and / or positive real number, for example, 1. As another example, if the reconstructed adjacent unit and the target unit to be coded have different reference picture lists but use the same reference picture, it may be determined that the motion information of the reconstructed adjacent unit and the motion information of the target unit to be coded are similar. As another example, if the reconstructed adjacent unit and the target unit to be coded have different reference picture indexes but use the same reference picture, it may be determined that the motion information of the reconstructed adjacent unit and the motion information of the target unit to be coded are similar.

[0107] Also, for example, the encoder does not select a unit coded by intra prediction from among the reconstructed adjacent units as a candidate unit. At this time, the encoder does not include the unit coded by intra prediction in the candidate unit set. As an example, the encoder may select only the unit coded by inter prediction from among the reconstructed adjacent units as a candidate unit and include it in the candidate unit set.

[0108] The encoder may determine whether or not there is a residual signal for the restored neighboring units, and may select units that do not have a residual signal from among the restored neighboring units as candidate units and include them in a candidate unit set. Here, the presence or absence of the residual signal may be determined through values ​​of CBP (Coded Block Pattern) and / or CBF (Coded Block Flag), which are syntax elements for the presence or absence of a residual signal.

[0109] In the embodiment of the above-mentioned candidate unit set generating method, the number of candidate units included in the candidate unit set may be limited to a predetermined number (e.g., N), where N may represent a positive integer greater than 0.

[0110] When the number of candidate units included in the candidate unit set is limited to N, the encoder may select only N units as candidate units from among the reconstructed neighboring units using a predetermined criterion. Here, the predetermined criterion may include the degree of adjacency with the encoding target unit, the degree of adjacency with the boundary of the encoding target unit, the relative and / or absolute length of the boundary adjacent to the encoding target unit, the relative and / or absolute size of the reconstructed neighboring unit, the relative and / or absolute depth value of the reconstructed neighboring unit, the encoding / decoding order of the reconstructed neighboring unit, and / or the identity / similarity between the encoding parameters of the encoding target unit and the encoding parameters of the reconstructed neighboring unit. An embodiment in which the encoding parameters of the reconstructed neighboring unit and the encoding target unit are similar has been described above. For example, when the encoding parameters of the reconstructed neighboring unit and the encoding target unit use the same reference picture, it may be determined that the encoding parameters of the reconstructed neighboring unit and the encoding parameters of the encoding target unit are similar.

[0111] For example, the number of candidate units included in the candidate unit set is 2. In this case, as an example, the encoder may select two units from the restored adjacent units in order of the length of the boundary adjacent to the encoding target unit as candidate units and include them in the candidate unit set.

[0112] As another example, the number of candidate units included in the candidate unit set is 3. As another example, the reconstructed adjacent units may have the same motion information. In this case, the encoder may select three units reconstructed later in the encoding / decoding order from the reconstructed adjacent units having the same motion information as candidate units and include them in the candidate unit set.

[0113] Meanwhile, in the embodiment of the above-mentioned candidate unit set generating method, the candidate units included in the candidate unit set may be arranged in descending order of the probability of being determined as a reference unit for the encoding target unit. That is, the encoder may preferentially include and / or insert units having a high probability of being determined as a reference unit for the encoding target unit into the candidate unit set. In this case, the encoder may assign a reference unit identifier having a shorter codeword to a candidate unit having a high probability of being determined as a reference unit, thereby improving encoding efficiency.

[0114] Fig. 10 is a conceptual diagram showing an example of a method for determining the order in which candidate units are included in a candidate unit set. In Fig. 10, it is assumed that the order in which reconstructed adjacent units are encoded / decoded is H→D→K→L→E→F→N→O→G→P→I→A→J→B→C→M.

[0115] For example, the encoder may select a unit adjacent to the left side of the encoding target unit and a unit adjacent to the upper side of the encoding target unit from among the reconstructed adjacent units as candidate units and include them in the candidate unit set. In this case, the encoder may include the selected candidate units in the candidate unit set according to the encoding / decoding order.

[0116] Referring to Fig. 10, the encoder can include the earlier candidate unit in the encoding / decoding order in the candidate unit set with priority. The units adjacent to the current encoding target unit (X) can be encoded / decoded in the order of D→E→F→A→B→C, so the generated candidate unit set can be configured as {D,E,F,A,B,C}.

[0117] As another embodiment, the encoder can arrange the candidate units included in the candidate unit set in the order of the length of the boundary adjacent to the encoding target unit, i.e., the encoder can preferentially include and / or insert into the candidate unit set candidate units that have a long boundary adjacent to the encoding target unit.

[0118] As another example, the encoder may arrange the candidate units included in the candidate unit set in ascending order of depth value, i.e., the encoder may prioritize the inclusion and / or insertion of candidate units with smaller depth values ​​into the candidate unit set.

[0119] In the embodiment of the above-mentioned candidate unit set generation method, the encoder can select candidate units included in the candidate unit set from among the reconstructed neighboring blocks. In this case, the candidate units selected from among the reconstructed neighboring blocks are also called spatial candidate units.

[0120] In addition to the spatial candidate units, the encoder may select units in the reference picture that are at the same spatial position as the unit to be coded as candidate units and include them in the candidate unit set. Hereinafter, for convenience of explanation, units in the reference picture that are at the same spatial position as the unit to be coded are referred to as collocated units and / or collocated blocks. At this time, the candidate units selected from the units in the reference picture may be referred to as temporal candidate units.

[0121] In the above-mentioned candidate unit set generation process, the encoder can use the coding parameter identifier for the restored neighboring unit. At this time, the candidate units included in the candidate unit set can be selected using the coding parameter identifier. Here, the coding parameters using the coding parameter identifier include, for example, the length of the boundary between the encoding target unit and the restored neighboring unit, the size of the restored neighboring unit, the depth value of the restored neighboring unit, etc.

[0122] A predetermined value may be assigned to the coding parameter identifier. In this case, as an example, the encoder may select, from among the restored neighboring units, a unit having a coding parameter with the same value as the value assigned to the coding parameter identifier as a candidate unit. As another example, the encoder may select, from among the restored neighboring units, a unit having a coding parameter with a value greater than the value assigned to the coding parameter identifier as a candidate unit. As another example, the encoder may select, as a candidate unit, a unit having a coding parameter with a value smaller than the value assigned to the coding parameter identifier.

[0123] For example, it is assumed that an encoding parameter identifier is used for the length of a boundary between the encoding target unit and a reconstructed adjacent unit. Here, the encoding parameter identifier is represented by log2_unit_boundary_length. As described above, the encoder may select only units having a boundary length between the encoding target unit and a reconstructed adjacent unit that is greater than a predetermined length as candidate units and include them in a candidate unit set. Here, assuming that the predetermined length is 8, the encoding parameter identifier log2_unit_boundary_length may be assigned a value of 3. In this case, the encoder may select only units having an adjacent boundary length greater than the value assigned to the encoding parameter identifier as candidate units and include them in a candidate unit set. Also, the encoder may encode the encoding parameter identifier assigned a value of 3 and transmit it to a decoder.

[0124] Once a set of candidate units is generated, the encoder can determine a reference unit to be used for prediction and / or motion compensation of the currently encoded unit from among the candidate units included in the generated set of candidate units.

[0125] FIG. 11 is a conceptual diagram for explaining a method for determining a reference unit in an encoder according to an embodiment of the present invention.

[0126] The encoder may determine, as a reference unit, a candidate unit that exhibits optimal coding efficiency in terms of rate-distortion from among the candidate units included in the candidate unit set. Also, as described above, the encoder may use coding parameters (e.g., motion information, etc.) of the candidate units included in the candidate unit set for inter prediction and motion compensation. In this case, the encoder can determine, as a reference unit, a candidate unit that exhibits optimal coding efficiency in terms of rate-distortion using the coding parameters. Here, a method of selecting an optimal coding scheme in terms of rate and distortion is sometimes called rate-distortion optimization (RDO).

[0127] When the reference unit is determined by the rate-distortion optimization method, the encoder may encode a reference unit identifier indicating which of the candidate units included in the candidate unit set is determined as the reference unit, and transmit the encoded reference unit identifier to the decoder. As an example, the reference unit identifier may indicate an order and / or a position of the candidate unit determined as the reference unit in the candidate unit set. As another example, the reference unit identifier may indicate a coding order difference from the current unit to be coded to the reference unit. As another example, each of the candidate units in the candidate unit set may be assigned a reference unit index, and the reference unit index may be used as the reference unit identifier.

[0128] 11, the candidate unit set can be configured as {A, B, C, D, E, F} as an example. At this time, each candidate unit can be assigned a reference unit index, for example, A can be assigned 0, B can be assigned 1, C can be assigned 2, D can be assigned 3, E can be assigned 4, and F can be assigned 5.

[0129] The encoder can encode the reference unit index and transmit it to the decoder, and the decoder can receive and decode the encoded reference unit index. If the encoder determines B as a reference unit, the value of the reference unit index transmitted to the decoder is 1. In this case, the decoder can determine unit B as a reference unit using the value of the reference unit index.

[0130] 12 is a conceptual diagram for explaining a method for determining a reference unit in an encoder according to another embodiment of the present invention. In FIG. 12, it is assumed that the order in which the reconstructed adjacent units are encoded / decoded is H→D→K→L→E→F→N→O→G→P→I→A→J→B→C→M.

[0131] As described above, in the process of generating a candidate unit set, the encoder can sort the candidate units included in the candidate unit set in descending order of the probability of being determined as a reference unit. At this time, the encoder can determine the first candidate unit as a reference unit from among the candidate units included in the candidate unit set.

[0132] Referring to FIG. 12, the encoder may select units adjacent to the encoding target unit as candidate units. In this case, the selected candidate units are A, B, C, D, E, and F. The encoder may arrange the selected candidate units according to the encoding / decoding order. For example, the encoder may preferentially include a unit encoded later in the encoding order in the candidate unit set. In this case, the candidate unit set may be configured as {C, B, A, F, E, D}. The encoder may determine the first candidate unit C in the candidate unit set as the reference unit. In this case, the candidate unit having the smallest encoding order difference with the encoding target unit may be determined as the reference unit.

[0133] When the first candidate unit in the candidate unit set is determined as the reference unit, the encoder and the decoder can determine the reference unit without a separate reference unit identifier, so the encoder does not encode the reference unit identifier and does not transmit the reference unit identifier to the decoder.

[0134] FIG. 13 is a conceptual diagram for explaining a method of determining a reference unit in an encoder according to another embodiment of the present invention.

[0135] 13, the encoder can select units adjacent to the encoding target unit as candidate units. In this case, the selected candidate units are A, D, E, and F.

[0136] Meanwhile, the number of candidate units included in the candidate unit set may be limited to a predetermined number, and the predetermined number may be 1. In this case, the encoder may generate the candidate unit set by selecting only one unit that has the highest probability of being selected as a reference unit from among the restored adjacent units as a candidate unit. For example, the encoder may compare the sizes of the restored adjacent units with each other and select only the relatively largest unit (e.g., unit A) as a candidate unit. In this case, the candidate unit set is configured as {A}, and the number of candidate units constituting the candidate unit set is 1.

[0137] When the number of candidate units constituting a candidate unit set is one, the encoder and decoder can determine the corresponding candidate unit as a reference unit. At this time, the encoder and decoder can determine the reference unit without a separate reference unit identifier. Therefore, the encoder does not encode the reference unit identifier and does not transmit the reference unit identifier to the decoder.

[0138] As described above in FIG 4, when the reference unit is determined, the encoder may encode the reference unit identification information and transmit the encoded reference unit identification information to the decoder. The reference unit identification information may include at least one of an encoding parameter identifier and a reference unit identifier.

[0139] The encoder can use the coding parameter identifiers for the reconstructed neighboring units, and in this case, the candidate units included in the candidate unit set can be selected using the coding parameter identifiers.

[0140] A predetermined value may be assigned to the coding parameter identifier. In this case, as an example, the encoder may select, from among the restored neighboring units, a unit having a coding parameter with the same value as the value assigned to the coding parameter identifier as a candidate unit. As another example, the encoder may select, from among the restored neighboring units, a unit having a coding parameter with a value greater than the value assigned to the coding parameter identifier as a candidate unit. As another example, the encoder may select, as a candidate unit, a unit having a coding parameter with a value smaller than the value assigned to the coding parameter identifier.

[0141] The encoder may encode the coding parameter identifier, and the encoded coding parameter identifier may then be transmitted to the decoder.

[0142] Also, as described above, the encoder may use the coding parameters of the candidate units included in the candidate unit set for inter prediction and motion compensation, and may determine, as a reference unit, a candidate unit that exhibits optimal coding efficiency in terms of rate-distortion using the coding parameters.

[0143] When the reference unit is determined by the rate-distortion optimization method, the encoder may encode a reference unit identifier indicating which of the candidate units included in the candidate unit set is determined as the reference unit, and transmit the encoded reference unit identifier to the decoder. As an example, the reference unit identifier may indicate an order and / or a position of the candidate unit determined as the reference unit in the candidate unit set. As another example, the reference unit identifier may indicate a coding order difference from the encoding target unit to the reference unit. As another example, each of the candidate units in the candidate unit set may be assigned a reference unit index, and the reference unit index may be used as the reference unit identifier.

[0144] The decoder may receive and decode the encoded reference unit identifier. The decoder may determine the reference unit using the decoded reference unit identifier.

[0145] When the first candidate unit in the candidate unit set is determined as the reference unit and the number of candidate units constituting the candidate unit set is one, the encoder and decoder can determine the reference unit without a separate reference unit identifier. In this case, the encoder can omit coding the reference unit identifier.

[0146] FIG. 14 is a flow chart that illustrates an outline of an embodiment of a method for determining a reference unit at a decoder.

[0147] 14, the decoder may receive and decode reference unit identification information from the encoder (S1410). The reference unit identification information transmitted from the encoder may include at least one of an encoding parameter identifier and a reference unit identifier.

[0148] The decoder may select a candidate unit included in the candidate unit set using the coding parameter identifier included in the reference unit identification information. A predetermined value may be assigned to the coding parameter identifier. In this case, as an example, the decoder may select a unit having a coding parameter with the same value as the value assigned to the coding parameter identifier from among the restored neighboring units as the candidate unit. As another example, the decoder may select a unit having a coding parameter with a value larger than the value assigned to the coding parameter identifier from among the restored neighboring units as the candidate unit. As another example, the decoder may select a unit having a coding parameter with a value smaller than the value assigned to the coding parameter identifier as the candidate unit. Here, the value assigned to the coding parameter identifier is the same value as the coding parameter and / or the coding parameter identifier used in the encoder.

[0149] The decoder can decode the reference unit identifier encoded by the encoder. As described above, the reference unit identifier may indicate which candidate unit among the candidate units included in the candidate unit set is determined as the reference unit. As an example, the reference unit identifier may indicate the order and / or position of the candidate unit determined as the reference unit in the candidate unit set. As another example, the reference unit identifier may indicate a decoding order difference from the unit to be decoded to the reference unit. As another example, each of the candidate units in the candidate unit set may be assigned a reference unit index, and the reference unit index may be used as the reference unit identifier. The decoder may use the decoded reference unit identifier to determine the reference unit in the candidate unit set.

[0150] When the first candidate unit in the candidate unit set is determined as the reference unit and the number of candidate units constituting the candidate unit set is 1, the encoder and the decoder can determine the reference unit without a separate reference unit identifier. In this case, the encoder does not transmit the reference unit identifier, and the decoder does not decode the reference unit identifier.

[0151] Also, referring to FIG. 14, the decoder may generate a set of candidate units using the reconstructed neighboring units (S1420).

[0152] The decoder may select a candidate unit from among the reconstructed neighboring units according to a predetermined criterion and / or method. In this case, the decoder may use coding parameters of the unit to be decoded and / or coding parameters of the reconstructed neighboring units to reflect the characteristics of the image. The decoder may generate a candidate unit set by including and / or inserting the selected candidate unit into the candidate unit set.

[0153] The decoder can generate a set of candidate units through the same process as the encoder. The process of generating a set of candidate units in the encoder has been described above, so a detailed description of the process of generating a set of candidate units in the decoder will be omitted.

[0154] Once the candidate unit set is generated, the decoder can determine a reference unit to be used for prediction and / or motion compensation of the currently-decoded unit from among the candidate units included in the generated candidate unit set (S1430).

[0155] The decoder may use the decoded reference unit identification information in the process of determining a reference unit. When a reference unit is determined, the decoder may perform inter prediction on the current unit to be coded using the determined reference unit. A specific example of a reference unit determination method will be described later.

[0156] FIG. 15 is a conceptual diagram for explaining a method for determining a reference unit in a decoder according to an embodiment of the present invention.

[0157] The decoder may determine a reference unit to be used for inter prediction and motion compensation of a current unit to be decoded from among candidate units included in a candidate unit set using the decoded reference unit identifier. As an example, the reference unit identifier may indicate an order and / or a position of a candidate unit determined as a reference unit in a candidate unit set. As another example, the reference unit identifier may indicate a decoding order difference from a current unit to be decoded to a reference unit. As another example, a reference unit index may be assigned to each of the candidate units in a candidate unit set, and the reference unit index may be used as a reference unit identifier.

[0158] 15, the candidate unit set may be configured as {A, B, C, D, E, F} as an example. At this time, each candidate unit may be assigned a reference unit index, for example, A may be assigned 0, B may be assigned 1, C may be assigned 2, D may be assigned 3, E may be assigned 4, and F may be assigned 5. If the decoded reference unit index value is 2, the decoder may determine unit C as the reference unit using the value of the reference unit index.

[0159] 16 is a conceptual diagram for explaining a method for determining a reference unit in a decoder according to another embodiment of the present invention. In FIG. 16, it is assumed that the order in which the restored adjacent units are decoded is H→D→K→L→E→F→N→O→G→P→I→A→J→B→C→M.

[0160] In the process of generating a candidate unit set, the decoder can sort the candidate units included in the candidate unit set in order of the probability of being determined as a reference unit. At this time, the decoder can determine the first candidate unit from among the candidate units included in the candidate unit set as the reference unit.

[0161] Referring to FIG. 16, the decoder may select units adjacent to the unit to be decoded as candidate units. In this case, the selected candidate units are A, B, C, D, E, and F. The decoder may arrange the selected candidate units according to the decoding order. For example, the decoder may preferentially include units decoded later in the decoding order in the candidate unit set. In this case, the candidate unit set may be configured as {C, B, A, F, E, D}. The decoder may determine the first candidate unit C in the candidate unit set as the reference unit. In this case, the candidate unit having the smallest decoding order difference with the unit to be decoded may be determined as the reference unit.

[0162] When the first candidate unit in the candidate unit set is determined as the reference unit, the encoder and decoder can determine the reference unit without a separate reference unit identifier. In this case, the encoder does not transmit the reference unit identifier to the decoder, and the decoder does not decode the reference unit identifier.

[0163] FIG. 17 is a conceptual diagram for explaining a method for determining a reference unit in a decoder according to another embodiment of the present invention.

[0164] 17, the decoder can select units adjacent to the current unit as candidate units, where the selected candidate units are A, D, E, and F.

[0165] Meanwhile, the number of candidate units included in the candidate unit set may be limited to a predetermined number, and the predetermined number is 1. In this case, the decoder may generate the candidate unit set by selecting only one unit that is most likely to be selected as a reference unit from among the restored adjacent units as a candidate unit. For example, the decoder may compare the sizes of the restored adjacent units and select only the relatively largest unit (e.g., unit A) as a candidate unit. In this case, the candidate unit set is configured as {A}, and the number of candidate units constituting the candidate unit set is 1.

[0166] When the number of candidate units constituting a candidate unit set is one, the encoder and decoder can determine the corresponding candidate unit as a reference unit. At this time, the encoder and decoder can determine the reference unit without a separate reference unit identifier. Therefore, the encoder does not transmit the reference unit identifier to the decoder, and the decoder does not decode the reference unit identifier.

[0167] In the above embodiments, the method is described based on a flow chart with a series of steps or blocks, but the present invention is not limited to the order of steps, and some steps may occur in a different order or simultaneously with other steps described above. Also, a person skilled in the art can understand that the steps shown in the flow chart are not exclusive, and other steps may be included, or one or more steps in the flow chart may be deleted without affecting the scope of the present invention.

[0168] The above-described embodiments include examples of various aspects. It is not possible to describe all possible combinations for illustrating various aspects, but a person having ordinary skill in the art can recognize that other combinations are possible. Therefore, the present invention includes all alterations, modifications, and variations that fall within the scope of the claims.

Claims

1. determining at least one spatial candidate unit for the unit to be decoded from among the reconstructed neighboring units of the unit to be decoded; Selecting a picture from a reference picture list of the unit to be decoded in which a temporal candidate unit of the unit to be decoded is located; determining the temporal candidate units for the unit to be decoded of the selected picture; generating a set of candidate units for inter prediction based on the spatial candidate units and the temporal candidate units; Performing inter prediction on the current unit to be decoded; The spatial candidate unit among the reconstructed neighboring units has a reference picture list different from a reference picture list of the current unit to be decoded and uses the same reference pictures as the current unit to be decoded; The video decoding method, wherein the spatial candidate unit is determined based on reconstructed neighboring units that are coded by inter prediction among the reconstructed neighboring units.

2. determining at least one spatial candidate unit for the current unit to be coded from among the reconstructed neighboring units of the current unit; determining a temporal candidate unit for the unit to be coded; generating a set of candidate units for inter prediction of the current unit based on the spatial candidate units and the temporal candidate units; performing inter prediction on the current unit to be coded based on the generated set of candidate units; the temporal candidate unit is in one of a plurality of reference pictures belonging to a reference picture list of the current unit to be coded, and the spatial candidate unit among the reconstructed neighboring units has a reference picture list different from the reference picture list of the current unit to be coded and uses the same reference picture as the current unit to be coded; A video coding method, wherein the spatial candidate units are determined based on reconstructed neighboring units that are coded by inter prediction among the reconstructed neighboring units.

3. 1. A method for transmitting a bitstream generated by a method for encoding a video signal by an apparatus, comprising: The encoding method comprises: determining at least one spatial candidate unit for the current unit to be coded from among the reconstructed neighboring units of the current unit; determining a temporal candidate unit for the unit to be coded; generating a set of candidate units for inter prediction of the current unit based on the spatial candidate units and the temporal candidate units; performing inter prediction on the current unit to be coded based on the generated set of candidate units; the temporal candidate unit is in one of a plurality of reference pictures belonging to a reference picture list of the current unit to be coded, and the spatial candidate unit among the reconstructed neighboring units has a reference picture list different from the reference picture list of the current unit to be coded and uses the same reference picture as the current unit to be coded; A method, wherein the spatial candidate units are determined based on reconstructed neighboring units among the reconstructed neighboring units that are coded using inter prediction.

Citation Information

Patent Citations

  • Motion vector coding method and motion vector decoding method

    JP2004096705A

  • Moving image encoding device, method and program, and moving image decoding device, method and program

    JP2008283490A

  • Combined motion vector and reference index prediction for video coding

    US20090304084A1

  • MOTION VECTOR PREDICTORS (MVPs) FOR BI-PREDICTIVE INTER MODE IN VIDEO CODING

    WO2012121808A1