Method and device for encoding or decoding coding units of picture outlines
By dividing coding units based on their position and shape relative to the picture outline, the method optimizes video compression and decoding for high-resolution content, addressing inefficiencies in existing methods and improving resource utilization.
Patent Information
- Application Number
- JP2023040705
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-03-15
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2036-10-10
AI Technical Summary
Existing video encoding and decoding methods struggle to efficiently handle coding units that fall outside the picture outline, leading to inefficiencies in video compression and decoding processes, particularly for high-resolution or high-quality video content.
A method and apparatus for encoding and decoding a coding unit of a picture outline by comparing its position with the picture dimensions, and recursively dividing it into multiple units based on its shape and the picture outline, ensuring only units within the outline are processed and encoded/decoded, thereby optimizing video compression.
This approach enhances video compression efficiency by reducing unnecessary processing of units outside the picture outline, minimizing data loss, and optimizing resource utilization in encoding and decoding high-resolution video content.
Smart Images

Figure 0007593712000002 
Figure 0007593712000003 
Figure 0007593712000004
Abstract
Description
[Technical field]
[0001] The present invention relates to a video encoding method, a video decoding method, and an apparatus therefor, and more particularly to a method and an apparatus therefor for encoding or decoding a coding unit of a picture outline. [Background technology]
[0002] The video data is encoded by a codec according to a predetermined data compression standard, for example, the Moving Picture Experts Group (MPEG) standard, and then stored in a recording medium or transmitted through a communication channel in the form of a bit stream.
[0003] Due to the development and widespread use of hardware capable of playing and storing high-resolution or high-quality video content, there is an increasing need for a codec that effectively encodes or decodes high-resolution or high-quality video content. The encoded video content is played back by being decoded. Recently, a method for effectively compressing such high-resolution or high-quality video content has been implemented. For example, an efficient video compression method has been implemented through a process of processing a video to be encoded in a random manner.
[0004] In order to compress an image, various data units are used, and there is an inclusion relationship between such data units. In order to determine the size of the data units used for such image compression, the data units are divided by various methods, and an optimized data unit is determined according to the characteristics of the image, thereby encoding or decoding the image. Summary of the Invention [Problem to be solved by the invention]
[0005] SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to provide a method and apparatus for encoding or decoding a coding unit of a picture outline. [Means for solving the problem]
[0006] According to one embodiment of a video decoding method for solving the technical problem, the video decoding method includes: comparing a position of a current coding unit in a picture with at least one of a width and a height of the picture to determine whether the current coding unit falls outside the picture outline; if the current coding unit falls outside the picture outline, dividing the current coding unit in at least one direction based on a shape of the current coding unit into a plurality of coding units; if the current coding unit does not fall outside the picture outline, acquiring block shape information and partition shape information related to the current coding unit from a bitstream, and dividing the current coding unit into a plurality of coding units based on the block shape information and the partition shape information; and decoding a coding unit that is not further divided among the plurality of coding units.
[0007] In addition, in a video decoding method according to one embodiment, when the current coding unit deviates from the picture outline, the shape of the current coding unit is square, and the picture outline is a vertical outline, the current coding unit is bi-split vertically and also divided into two non-square coding units.
[0008] In addition, in a video decoding method according to one embodiment, when the current coding unit deviates from the picture outline, the shape of the current coding unit is a square, and the picture outline is a horizontal outline, the current coding unit is bisected horizontally and also divided into two non-square coding units.
[0009] In addition, in a video decoding method according to one embodiment, when the current coding unit deviates from the picture outline, the shape of the current coding unit is a square, and the picture outline is a corner outline, the current coding unit is divided vertically and horizontally, and is also divided into four square-shaped coding units.
[0010] In addition, in a video decoding method according to one embodiment, when the current coding unit deviates from the picture outline, the shape of the current coding unit is square, and the picture outline is a corner outline, the current coding unit is bisected in the vertical or horizontal direction, whichever has higher priority, and is also divided into two non-square coding units.
[0011] In an embodiment of the video decoding method, when the current coding unit is outside the picture outline, the current coding unit has a square shape and the picture outline is a corner outline, if a horizontal length of the corner outline overlapping with the current coding unit is longer than a vertical length, the current coding unit is bisected horizontally and divided into two non-square coding units, if a horizontal length of the corner outline overlapping with the current coding unit is shorter than a vertical length, the current coding unit is bisected vertically and divided into two non-square coding units, if a horizontal length of the corner outline overlapping with the current coding unit is shorter than a vertical length, the current coding unit is bisected vertically and divided into two non-square coding units, if a horizontal length and a vertical length of the corner outline overlapping with the current coding unit are equal, the current coding unit is bisected vertically and horizontally into four square coding units, or bisected in the vertical or horizontal direction, whichever has a higher priority, and divided into two coding units.
[0012] In addition, in an embodiment of a video decoding method, when the current coding unit is outside the picture outline and has a non-square shape, the current coding unit is also divided into two square-shaped coding units.
[0013] In addition, in a video decoding method according to one embodiment, when the current coding unit deviates from the picture outline and has a non-square shape, if at least one of the boundaries of one square coding unit and two non-square coding units that are divided into three in the same direction from the current coding unit coincides with the picture outline, the current coding unit is divided into three in the same direction, and is also divided into the one square coding unit and the two non-square coding units.
[0014] In addition, in an image decoding method according to one embodiment, a step of recursively dividing the current coding unit in at least one direction into a plurality of coding units based on a shape of the current coding unit may be performed until at least one coding unit among the plurality of coding units does not deviate from the picture outline.
[0015] Also, in a video decoding method according to one embodiment, the width of the picture is a multiple of the width of a coding unit having a smallest width in the picture, and the height of the picture is also a multiple of the height of a coding unit having a smallest height in the picture.
[0016] In addition, in a video decoding method according to one embodiment, if the width of the picture is not a multiple of the width of a coding unit having a smallest width in the picture, or the height of the picture is not a multiple of the height of a coding unit having a smallest height in the picture, an area outside the picture outline may be padded with a predetermined value, and at least one of the width and height of the picture may be extended.
[0017] In addition, in a video decoding method according to one embodiment, if the width of the picture is not a multiple of the width of a coding unit having a smallest width in the picture, or the height of the picture is not a multiple of the height of a coding unit having a smallest height in the picture, an internal area of the picture adjacent to the picture outline is cropped, and at least one of the width and height of the picture is reduced.
[0018] In addition, in the video decoding method according to an embodiment, when the current coding unit is outside the picture boundary, the block shape information and the partition shape information related to the current coding unit are not acquired from the bitstream.
[0019] According to one embodiment, a video decoding apparatus includes a coding unit determination unit that compares a position of a current coding unit in a picture with at least one of a width and a height of the picture to determine whether the current coding unit falls outside the picture outline, and if the current coding unit falls outside the picture outline, divides the current coding unit in at least one direction into a plurality of coding units based on a shape of the current coding unit, and if the current coding unit does not fall outside the picture outline, obtains block shape information and partition shape information related to the current coding unit from a bitstream and divides the current coding unit into a plurality of coding units based on the block shape information and the partition shape information; and a decoding unit that decodes a coding unit that is not further divided among the plurality of coding units.
[0020] According to one embodiment, a video encoding method includes: comparing a position of a current coding unit in a picture with at least one of a width and a height of the picture to determine whether the current coding unit falls outside the picture outline; if the current coding unit falls outside the picture outline, dividing the current coding unit in at least one direction based on a shape of the current coding unit into a plurality of coding units; if the current coding unit does not fall outside the picture outline, encoding block shape information and division shape information of the current coding unit; and encoding a coding unit that is not further divided among the plurality of coding units. [Brief description of the drawings]
[0021] [Figure 1] 1 illustrates a schematic block diagram of a video encoding device according to an embodiment; [Diagram 2] 2 shows a schematic block diagram of a video decoding device 200 according to an embodiment. [Diagram 3] 1 illustrates a process for determining whether a block falls outside the picture boundary, according to one embodiment. [Figure 4] 1 illustrates a picture outline block and its division method according to one embodiment. [Figure 5A] 1 illustrates a square block of a picture outline and how it is divided, according to one embodiment. [Figure 5B] 1 illustrates a square block of a picture outline and how it is divided, according to one embodiment. [Figure 5C] 1 illustrates a square block of a picture outline and how it is divided, according to one embodiment. [Figure 5D] 1 illustrates a square block of a picture outline and how it is divided, according to one embodiment. [Figure 6A] 1 illustrates non-square blocks of picture outlines and a method for dividing the same according to another embodiment; [Figure 6B] 1 illustrates non-square blocks of picture outlines and a method for dividing the same according to another embodiment; [Figure 7A] 1 illustrates a process in which blocks of a picture boundary are recursively divided according to one embodiment. [Figure 7B] 1 illustrates a process in which blocks of a picture boundary are recursively divided according to one embodiment. [Figure 7C] 1 illustrates a process in which blocks of a picture boundary are recursively divided according to one embodiment. [Figure 7D] 1 illustrates a process in which blocks of a picture boundary are recursively divided according to one embodiment. [Figure 8] 1 is a flowchart illustrating a video encoding method according to an embodiment. [Figure 9] 1 is a flowchart illustrating a video decoding method according to an embodiment. [Figure 10] 1 illustrates a process in which a current coding unit is divided to determine at least one coding unit, according to one embodiment. [Figure 11] 1 illustrates a process in which a coding unit having a non-square shape is divided to determine at least one coding unit, according to one embodiment. [Figure 12]1 illustrates a process of dividing a coding unit based on at least one of block configuration information and division configuration information, according to an embodiment. [Figure 13] 1 illustrates a method for determining a given coding unit among an odd number of coding units, according to one embodiment. [Figure 14] 1 illustrates an order in which a plurality of coding units are processed when a current coding unit is divided to determine multiple coding units, according to one embodiment. [Figure 15] 1 illustrates a process in which, when coding units are not processed in a predetermined order, a current coding unit is determined by dividing the current coding unit into an odd number of coding units, according to an embodiment. [Figure 16] 1 illustrates a process in which a first coding unit is divided to determine at least one coding unit, according to one embodiment. [Figure 17] 1 illustrates an embodiment in which, when a non-square second coding unit determined by dividing a first coding unit satisfies a predetermined condition, the manner in which the second coding unit is divided is restricted. [Figure 18] 1 illustrates a process of dividing a square coding unit when the division form information does not indicate division into four square coding units, according to an embodiment. [Figure 19] 1 illustrates that the processing order of a plurality of coding units may vary depending on the division process of the coding units, according to an embodiment. [Figure 20] 1 illustrates a process of determining the depth of a coding unit according to changes in the shape and size of the coding unit when a coding unit is recursively divided to determine a plurality of coding units, according to an embodiment. [Figure 21] 1 illustrates an index (PID) for depth partitions and coding unit partitions that are also determined by the type and size of the coding unit, according to one embodiment. [Figure 22] 1 illustrates a plurality of coding units determined from a plurality of predetermined data units included in a picture, according to one embodiment. [Figure 23]1 illustrates processing blocks that are referenced to determine a determination order of reference coding units included in a picture, according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0022] The advantages, features, and methods of achieving the disclosed embodiments will become clear with reference to the embodiments described below in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, and may be embodied in various different forms, but the embodiments are provided only to complete the disclosure of the present invention and to fully inform those skilled in the art of the scope of the invention.
[0023] The terms used in this specification will be briefly explained, and the disclosed embodiments will be specifically explained.
[0024] The terms used in this specification are currently common terms that are selected as much as possible while taking into consideration the functions of the present invention, but they may vary depending on the intentions of those skilled in the art in the relevant field, precedents, or the emergence of new technology. In addition, in certain cases, the applicant may arbitrarily select terms, and in such cases, the meanings of the terms will be described in detail in the description of the invention. Therefore, the terms used in this specification must be defined based on the meanings of the terms and the overall content of the present invention, rather than simply the names of the terms.
[0025] In this specification, the singular expression includes the plural expression unless the context clearly specifies otherwise.
[0026] Throughout the specification, when a part "includes" a certain component, it does not mean excluding other components, but may further include other components, unless otherwise specified to the contrary. In addition, the term "module" used in the specification means a software or hardware component such as an FPGA or ASIC, and a "module" performs a certain role. However, the meaning of "module" is not limited to software or hardware. A "module" may also be configured to be in an addressable recording medium and to execute one or more processors. Thus, by way of example, a "module" includes components such as software components, object-oriented software components, class components, and task components, processes, functions, attributes, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided in the components and "modules" may be combined into fewer components and "modules" or further separated into additional components and "modules".
[0027] Hereinafter, "image" can refer to a static image, such as a still image from a video, or to a moving image, ie, a moving image, such as the video itself.
[0028] Hereinafter, a "sample" refers to data assigned to a sampling position of an image and to be processed. For example, in a spatial domain image, a pixel value and a transform coefficient in a transform domain are also samples. A unit including at least one such sample can be defined as a block.
[0029] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. In the drawings, portions that are not relevant to the description will be omitted in order to clearly explain the present invention.
[0030] Hereinafter, a video encoding device, a video decoding device, a video encoding method, and a video decoding method according to an embodiment will be described in detail with reference to Figures 1 to 23. A method and an apparatus for encoding or decoding a coding unit of a picture outline according to an embodiment will be described with reference to Figures 1 to 9, and a method for determining a data unit of a video according to an embodiment will be described with reference to Figures 10 to 23.
[0031] Hereinafter, a method and apparatus for encoding or decoding a coding unit of a picture outline according to an embodiment of the present invention will be described in detail with reference to FIGS.
[0032] FIG. 1 illustrates a schematic block diagram of a video encoding device 100 according to an embodiment.
[0033] The video encoding device 100 according to an embodiment of the present invention includes a coding unit determining unit 110, an encoding unit 120, and a transmitting unit .
[0034] According to an embodiment, the coding unit determination unit 110 may divide the image data of the current picture into maximum coding units according to the maximum size of the coding units. Each maximum coding unit may include coding units divided according to a block type and a division type. According to an embodiment, the maximum coding units are hierarchically classified according to a block type and a division type of image data of a spatial domain included in the maximum coding unit. The block type of the coding unit may be a square or a rectangle, or any other geometrical type, and is not limited to a data unit of a certain size.
[0035] As the size of a picture to be coded increases, coding the image in a larger unit allows the image to be coded at a higher image compression rate. However, if the coding unit is enlarged and the size is fixed, it is not possible to code the image efficiently while reflecting the ever-changing characteristics of the image.
[0036] For example, when encoding flat areas related to the sea or sky, the larger the coding unit, the better the compression ratio, but when encoding complex areas related to people or buildings, the smaller the coding unit, the better the compression ratio.
[0037] To this end, the coding unit determination unit 110 according to an embodiment sets a maximum coding unit of a different size for each picture or slice, and sets a block type and a division type of one or more coding units divided from the maximum coding unit. The size of the coding units included in the maximum coding unit can be variably set according to the block type and the division type.
[0038] The block type and the partition type of one or more coding units are also determined based on a rate-distortion cost (RD) calculation. The block type and the partition type may be determined differently for each picture or slice, or may be determined differently for each maximum coding unit. The determined block type and partition type are output to the encoder 120 together with the video data for each coding unit.
[0039] According to an embodiment, the coding units divided from the maximum coding unit are characterized by a block type and a division type. A detailed method for determining the coding units in the block type and the division type will be described in more detail below with reference to Figures 10 to 23.
[0040] According to an embodiment, the coding units included in the largest coding unit are predicted or transformed (e.g., pixel domain values are transformed into frequency domain values) based on processing units of different sizes. In other words, the video coding apparatus 100 may perform a plurality of processing steps for video coding based on processing units of various sizes and shapes. In order to code video data, processing steps such as prediction, transformation, and entropy coding are performed, and a processing unit of the same size may be used throughout all steps, or a processing unit of different sizes may be used for each step.
[0041] According to an embodiment, the prediction mode of the coding unit may be at least one of an intra mode, an inter mode, and a skip mode, and a particular prediction mode may be performed only for a coding unit of a particular size or shape. According to an embodiment, prediction is performed for each coding unit, and a prediction mode that has the smallest coding error is selected.
[0042] In addition, the video encoding device 100 can convert video data based on a processing unit having a size different from the coding unit. For the coding unit conversion, conversion can be performed based on a data unit having a size equal to or smaller than the coding unit. Hereinafter, the processing unit on which conversion is performed is referred to as a "conversion unit."
[0043] The information used for encoding includes not only information related to the block type and partition type, but also prediction-related information and transform-related information. Therefore, the encoder 120 may determine the block type, partition type, prediction mode for each coding unit, and transform unit size for transform that generate the minimum coding error.
[0044] According to an embodiment, the encoder 120 may measure the coding error of the coding unit using a Lagrangian multiplier-based rate-distortion optimization technique.
[0045] According to one embodiment, the transmitting unit 130 outputs the image data of the coding unit coded based on at least one coding unit determined by the coding unit 120 and information related to the coding mode for each coding unit in the form of a bitstream and transmits it to a decoding device.
[0046] The encoded video data is also the result of encoding video residual data.
[0047] The information related to the coding mode for each coding unit may include a block type, a division type, prediction mode information for each coding unit, and information on the size of a transform unit.
[0048] 2 is a schematic block diagram of a video decoding device 200 according to an embodiment of the present invention. Referring to FIG. 2, the video decoding device 200 according to an embodiment of the present invention includes a receiving unit 210, a coding unit determining unit 220, and a decoding unit 230.
[0049] According to an embodiment, the receiving unit 210 parses a bitstream received by the video decoding device 200, acquires video data for each coding unit, and outputs the acquired video data to the coding unit determining unit 220 and the decoding unit 230. The receiving unit 210 may extract information related to a current picture or a current slice from a parameter set RBSP (raw byte sequence payload) related to the current picture or the current slice.
[0050] According to an embodiment, the coding unit determination unit 220 parses a bitstream received by the video decoding apparatus 200 and extracts information related to the size of the maximum coding unit, the block type and division type of coding units divided from the maximum coding unit, and the coding mode of the coding units. The information related to the block type, division type, and coding mode is output to the decoding unit 230. The information related to the coding mode may include the block type, division type, prediction mode information for each coding unit, size information of a transform unit, etc.
[0051] According to an embodiment, the decoder 230 decodes video data of each coding unit based on the coding unit determined by the coding unit determiner 220 to reconstruct a current picture.
[0052] The decoder 230 may decode coding units included in the largest coding unit based on information regarding the block type and division type of the coding units divided from the largest coding unit. The decoding process may include a motion prediction process including inverse quantization, inverse transform, intra prediction, and motion compensation.
[0053] According to an embodiment, the decoder 230 may perform inverse quantization and inverse transform for each coding unit based on information related to a transform unit of the coding unit, and generate residual data. The decoder 230 may perform intra prediction or inter prediction based on information related to a prediction mode of the coding unit. The decoder 230 may perform prediction for the coding unit, and then generate restored data using prediction data and residual data of the coding unit.
[0054] 3 illustrates a process for determining whether a block is outside the picture boundary according to an embodiment. Referring to FIG. 3, when a current picture 310 is divided into maximum coding units of a predetermined size and coded, the width (W pic " and height "H pic " is not a multiple of the width and / or height of the largest coding unit, then the largest coding unit falls outside at least one of the right and bottom boundaries of the current picture 310.
[0055] According to an embodiment, the largest coding unit may be outside the boundary of the current picture, but when decoding (or encoding) an image, only the area that does not fall outside the boundary of the current picture is decoded (or encoded). Therefore, it is necessary to determine whether the current block falls outside the boundary of the picture. Here, the current block may be the largest coding unit or one of one or more coding units divided from the largest coding unit.
[0056] According to one embodiment, to determine whether the current block 320 is outside the boundary of the picture 310, the position of the current block 320 in the picture 310 is determined based on the width "W pic " and height "H pic For example, the distance between the left pixel of the picture 310 and the right pixel of the current block 320 is compared with at least one of the width "W pic ", and the distance between the top pixel of the picture 310 and the bottom pixel of the current block 320 is compared with the height "Hpic " is compared to
[0057] According to an embodiment, the position of the current block 320 in the picture 310 is also defined by coordinates (x, y). For example, a position indicating the top left pixel of the current block 320 is also set as the position of the current block 320. In addition, if the coordinates of the position indicating the top left pixel of the picture 310 are the origin (0, 0) of the picture, the position of the current block 320 in the picture 310 may be located at coordinates (x, y) based on the origin (0, 0).
[0058] To determine whether the current block 320 falls outside the boundary of the picture 310, the following formula is used:
[0059]
number
[0060] According to one embodiment, if equation (1) is satisfied, it is determined that the current block 320 is outside the boundary of the picture 310; if equation (2) is satisfied, it is determined that the current block 320 is outside the right boundary of the picture 310; and if equation (3) is satisfied, it is determined that the current block 320 is outside the bottom boundary of the picture 310.
[0061] In the above embodiment, the term "a block outside the picture boundary" is also interpreted as meaning that the block straddles the picture boundary.
[0062] FIG. 4 illustrates a picture outline block and its division method according to one embodiment.
[0063] According to an embodiment, if it is determined that the current block 410 falls outside the picture outline, the current block 410 is divided into various types based on the block type of the current block 410 and the type of the picture outline overlapping with the current block 410. When dividing the current block 410 that falls outside the picture outline, the encoding device 100 does not separately signal division information related to the current block 410 to the decoding device 200. That is, the encoding device 100 does not transmit division information for blocks that fall outside the picture outline, and the decoding device 200 does not parse division information for blocks that fall outside the picture outline. Meanwhile, even if the encoding device 100 determines that the first block falls outside the picture outline and does not transmit division information for the first block, if it is further determined that the second block divided from the first block exists in the internal area of the picture, it may transmit division information for the second block. In addition, even if the decoding device 200 determines that a first block falls outside the picture outline and does not acquire partition information for the first block, if it further determines that a second block divided from the first block exists in the internal area of the picture, the decoding device 200 can acquire partition information for the second block.
[0064] According to one embodiment, if the current block 410 falls outside the picture boundary, the current block 410 is divided vertically and horizontally into four square blocks 420. Also, according to one embodiment, the division process is repeated until the divided blocks 420 do not fall outside the picture boundary.
[0065] According to another embodiment, if the current block 410 falls outside the picture boundary, the current block 410 is bisected vertically or horizontally into two non-square blocks 430. According to another embodiment, the division process is repeated until the divided block 430 does not fall outside the picture boundary.
[0066] In the above embodiment, the current block refers to a current coding unit, and the shape of the current block and blocks divided from the current block may or may not be square.
[0067] Meanwhile, the amount of information to be coded may vary depending on whether the divided blocks are square or not.
[0068] 4, in an embodiment in which the current block 410 is divided vertically and horizontally into four square blocks 420, the number of blocks to be encoded or decoded is two. Meanwhile, in an embodiment in which the current block 410 is divided vertically or horizontally into two non-square blocks 430, the number of blocks to be encoded or decoded is one. Comparing with the above embodiment, the amount of information required to encode or decode one non-square block 430 (e.g., intra prediction information, motion information, block mode information, skip flag, etc.) is less than the amount of information required to encode or decode two square blocks 420.
[0069] In the above embodiment, when the current block 410 falls outside the picture boundary, signaling of partition information related to the current block 410 is omitted. In this case, the current block 410 is recursively partitioned according to a predetermined rule until it does not fall outside the picture boundary. The predetermined rule may be various partition rules based on the shape of the current block 410, the shapes of the blocks 420 and 430 partitioned from the current block 410, the shape of the picture boundary overlapping with the current block 410, etc. Therefore, various embodiments in which blocks of the picture boundary are partitioned will be described in detail with reference to Figures 5A to 7D.
[0070] 5A-5D illustrate square blocks of a picture outline and a method for dividing the blocks according to one embodiment.
[0071] 5A to 5D, a square-shaped current block 500 deviates from the current picture's outline 510, 520, 530, 540, 550, 560, 570, and 580 in various ways. In FIG 5A, the current picture's outline is a horizontal outline 510, 520, in FIG 5B, the current picture's outline is a vertical outline 530, 540, and in FIG 5C and 5D, the current picture's outline is a corner outline 550, 560, 570, and 580.
[0072] 5A, a square-shaped current block 500 is outside the horizontal boundary lines 510, 520 of the picture. When the current block 500 is outside the horizontal boundary line 510 of the picture, the top region of the current block 500 is the interior region 516 of the picture, and the bottom region of the current block 500 is the exterior region 518 of the picture. When the current block 500 is outside the horizontal boundary line 520 of the picture, the top region of the current block 500 is the interior region 526 of the picture, and the bottom region of the current block 500 is the exterior region 528 of the picture.
[0073] According to one embodiment, if the square-shaped current block 500 falls outside the horizontal boundary lines 510, 520 of the picture, the current block 500 is bi-split horizontally into two non-square-shaped blocks 512, 514, 522, and 524. In this case, no additional split information is required to split the current block 500.
[0074] According to one embodiment, one block 512 of the two non-square blocks 512, 514 divided horizontally still falls outside the horizontal boundary line 510 of the picture. The non-square block 512 that falls outside the horizontal boundary line 510 of the picture is recursively divided according to a predetermined rule without using the division information until the non-square block 512 does not fall outside the horizontal boundary line 510 of the picture. However, the block 514 that exists outside the horizontal boundary line 510 of the picture corresponds to the external area 518 of the picture, and therefore is not decoded (or coded).
[0075] According to one embodiment, the boundary between the two horizontally bisected non-square blocks 522, 524 also coincides with the horizontal boundary 520 of the picture. In this case, the block 522 inside the horizontal boundary 520 of the picture is decoded (or coded) without being further divided, and is then divided into multiple blocks using division information parsed from the bitstream, as described with reference to Figures 10 to 23. However, the block 524 outside the horizontal boundary 520 of the picture falls within the outer region 528 of the picture, and is therefore not decoded (or coded).
[0076] 5B, a square-shaped current block 500 is outside the picture's vertical boundary lines 530, 540. When the current block 500 is outside the picture's vertical boundary line 530, the left region of the current block 500 is the picture's interior region 536 and the right region of the current block 500 is the picture's exterior region 538. When the current block 500 is outside the picture's vertical boundary line 540, the left region of the current block 500 is the picture's interior region 546 and the right region of the current block 500 is the picture's exterior region 548.
[0077] According to one embodiment, if the square-shaped current block 500 falls outside the vertical boundary 530, 540 of the picture, the current block 500 is bisected vertically into two non-square-shaped blocks 532, 534, 542, and 544. In this case, no additional partition information is required to partition the current block 500.
[0078] According to one embodiment, one block 532 of the two vertically divided non-square blocks 532, 534 is still outside the vertical boundary line 530 of the picture. The non-square block 532 that is outside the vertical boundary line 530 of the picture is recursively divided according to a predetermined rule without using the division information until the non-square block 532 does not fall outside the vertical boundary line 530 of the picture. However, the block 534 that exists outside the vertical boundary line 530 of the picture corresponds to an outer region 538 of the picture, and therefore is not decoded (or coded).
[0079] According to one embodiment, the boundary between two vertically bisected non-square blocks 542, 544 also coincides with the vertical boundary 540 of the picture. In this case, the block 542 inside the vertical boundary 540 of the picture is decoded (or coded) without being further divided, and is then divided into multiple blocks using division information parsed from the bitstream, as described with reference to Figures 10 to 23, and decoded (or coded). However, the block 544 outside the vertical boundary 540 of the picture falls within the outer region 548 of the picture, and therefore is not decoded (or coded).
[0080] 5C, a square-shaped current block 500 is outside the corner boundaries 550 and 560 of the picture. When the current block 500 is outside the corner boundary 550 of the picture, the upper left region of the current block 500 is the interior region 556 of the picture, and the remaining region of the current block 500 is the exterior region 557 of the picture. When the current block 500 is outside the corner boundary 560 of the picture, the upper left region of the current block 500 is the interior region 566 of the picture, and the remaining region of the current block 500 is the exterior region 567 of the picture.
[0081] According to one embodiment, if the square-shaped current block 500 falls outside the corner boundaries 550, 560 of the picture, the current block 500 is divided horizontally and vertically into four square-shaped blocks 551, 552, 553, 554, 561, 562, 563, and 564. In this case, no separate division information is required to divide the current block 500.
[0082] According to one embodiment, one block 551 of the four square blocks 551, 552, 553, and 554 divided in the horizontal and vertical directions is still outside the corner boundary 550 of the picture. The square block 551 that is outside the corner boundary 550 of the picture is recursively divided according to a predetermined rule without using the division information until it does not fall outside the corner boundary 550 of the picture. However, since the blocks 552, 553, and 554 that exist outside the corner boundary 550 of the picture correspond to the outer area 557 of the picture, the blocks 552, 553, and 554 are not decoded (or coded).
[0083] According to an embodiment, at least one of the boundaries of the four square blocks 561, 562, 563, and 564 divided in the horizontal and vertical directions also coincides with the corner boundary 560 of the picture. In this case, the block 561 existing inside the corner boundary 560 of the picture is decoded (or coded) without being further divided, and is divided into a plurality of blocks using division information parsed from the bitstream, as described with reference to Figures 10 to 23, and is decoded (or coded). However, the blocks 562, 563, and 564 existing outside the corner boundary 560 of the picture correspond to the outer region 567 of the picture, and therefore the blocks 562, 563, and 564 are not decoded (or coded).
[0084] 5D, a square-shaped current block 500 is outside the picture's corner boundaries 570, 580. When the current block 500 is outside the picture's corner boundary 570, the left and top region of the current block 500 is the picture's interior region 576, and the remaining region of the current block 500 is the picture's exterior region 578. When the current block 500 is outside the picture's corner boundary 580, the left and top region of the current block 500 is the picture's interior region 586, and the remaining region of the current block 500 is the picture's exterior region 588.
[0085] According to an embodiment, if the square-shaped current block 500 falls outside the corner boundary 570, 580 of the picture, the current block 500 is divided horizontally or vertically according to the higher priority, and is divided into two non-square blocks. That is, if the priority of the horizontal direction is higher than that of the vertical direction, the current block 500 is divided horizontally and is divided into two non-square blocks 572, 574. Also, if the priority of the vertical direction is higher than that of the horizontal direction, the current block 500 is divided vertically and is divided into two non-square blocks 582, 584. According to an embodiment, the priority is information obtained by parsing from the bitstream. According to another embodiment, the priority is determined based on the length, shape, etc. of the picture boundary. According to yet another embodiment, the priority is determined by comparing the horizontal and vertical lengths of blocks included in the internal area of the picture.
[0086] According to one embodiment, the priority is also determined by the horizontal and vertical lengths of the corner outline of the picture overlapping the current block. According to one embodiment, if the horizontal length of the corner outline 570 of the picture overlapping the current block 500 is longer than the vertical length, the current block 500 is also bisected horizontally into two non-square blocks 572, 574. According to one embodiment, if the horizontal length of the corner outline 580 of the picture overlapping the current block 500 is shorter than the vertical length, the current block 500 is also bisected vertically into two non-square blocks 582, 584. According to one embodiment, if the horizontal length of the corner outline (not shown) of the picture overlapping the current block 500 is the same as the vertical length, the current block 500 is either bisected horizontally and vertically into four square blocks, or bisected horizontally or vertically into one of the directions (or whichever has the higher priority) into two non-square blocks.
[0087] According to one embodiment, one block 572 of the two horizontally bisected non-square blocks 572, 574 is still outside the corner boundary 570 of the picture. The non-square block 572 that is outside the corner boundary 570 of the picture is recursively divided according to a predetermined rule without using the division information until the non-square block 572 does not fall outside the corner boundary 570 of the picture. However, the block 574 that exists outside the corner boundary 570 of the picture corresponds to the external area 578 of the picture, and therefore is not decoded (or coded).
[0088] According to one embodiment, one block 582 of the two vertically bisected non-square blocks 582, 584 is still outside the corner boundary 580 of the picture. The non-square block 582 that is outside the corner boundary 580 of the picture is recursively divided according to a predetermined rule without using the division information until it does not fall outside the corner boundary 570 of the picture. However, since the block 584 that exists outside the corner boundary 580 of the picture corresponds to the external area 588 of the picture, the block 584 is not decoded (or coded).
[0089] 6A and 6B illustrate non-square blocks of picture outlines and methods for dividing them according to other embodiments.
[0090] 6A and 6B, non-square current blocks 610, 620, 630, 640, and 650 deviate from the outline 615, 625, 635, 645, and 655 of the current picture in various ways. In FIG. 6A, a non-square block 610, 620 that is long in the vertical direction and a non-square block 630 that is long in the horizontal direction are illustrated deviating from the outline 615, 625, and 635 of the picture. In FIG. 6A, for convenience of explanation, the outline 615, 625, and 635 of the picture is illustrated as a horizontal outline, but the outline 615, 625, and 635 of the picture may be any one of a horizontal outline, a vertical outline, and a corner outline. 6B shows a case where the picture outline 645, 655 coincides with at least one of the boundaries of blocks divided in the same direction from the non-square blocks 640, 650. For convenience of explanation, the non-square blocks 630, 640 are illustrated as being elongated in the vertical direction in FIG. 6B, but the non-square blocks 630, 640 may be elongated in either the horizontal direction or the vertical direction. Also, the picture outline 646, 655 shown in FIG. 6B may be any one of a horizontal outline, a vertical outline, or a corner outline.
[0091] 6A, non-square blocks 610, 620, 630 are outside the picture boundary 615, 625, 635. When the vertically long non-square blocks 610, 620 are outside the picture boundary 615, 625, the upper regions of the vertically long non-square blocks 610, 620 are inside the picture boundary 616, 626, and the lower regions of the vertically long non-square blocks 610, 620 are outside the picture boundary 618, 628. When the horizontally long non-square block 630 is outside the picture boundary 635, the upper region of the horizontally long non-square block 630 is inside the picture boundary 636, and the lower region of the horizontally long non-square block 630 is outside the picture boundary 638.
[0092] According to one embodiment, when the non-square blocks 610, 620, 630 are outside the picture boundary 615, 625, 635, the non-square blocks 610, 620, 630 are also bisected into two square blocks 612, 614, 622, 624, 632, 634. That is, when the non-square blocks 610, 620 that are vertically long are outside the picture boundary 615, 625, the non-square blocks 610, 620 that are vertically long are also bisected into two square blocks 612, 614, 622, 624. Also, when the non-square blocks 630 that are horizontally long are outside the picture boundary 635, the non-square blocks 630 that are horizontally long are also bisected into two square blocks 632, 634. In the above case, the division of the non-square blocks 610, 620, 630 does not require separate division information.
[0093] According to one embodiment, one block 612 of the two square blocks 612, 614 divided from the non-square block 610 is still outside the picture boundary 615. The square block 612 that is outside the picture boundary 615 is recursively divided according to a predetermined rule without using division information until it does not fall outside the picture boundary 615. However, the block 614 that exists outside the picture boundary 615 corresponds to the outer area 618 of the picture, and therefore is not decoded (or coded).
[0094] According to one embodiment, the boundary between two square blocks 622, 624 bisected from the non-square block 620 also coincides with the picture boundary 625. In this case, the block 622 existing inside the picture boundary 625 is decoded (or coded) without being further divided, and is divided into multiple blocks using division information parsed from the bitstream, as described through Figures 10 to 23, and is decoded (or coded). However, the block 624 existing outside the picture boundary 625 corresponds to the outer region 628 of the picture, so that the block 624 is not decoded (or coded).
[0095] According to one embodiment, the two square blocks 632, 634 bisected from the non-square block 630 are both outside the picture boundary 635. The square blocks 632, 634 that are outside the picture boundary 635 are recursively divided according to a predetermined rule without using division information until they no longer fall outside the picture boundary 635.
[0096] 6A, the picture outlines 615, 625, and 635 are illustrated as horizontal outlines for convenience of explanation, but the picture outlines 615, 625, and 635 may be any one of horizontal outlines, vertical outlines, and angular outlines. In other words, when a non-square block deviates from the picture outline, the non-square block is also divided into two square blocks, regardless of whether the picture outline is a horizontal outline, vertical outline, or angular outline.
[0097] 6B, the non-square blocks 640, 650 fall outside the picture boundaries 645, 655. The upper regions of the non-square blocks 640, 650 are the picture's interior regions 648, 658 and the lower regions of the non-square blocks 640, 650 are the picture's exterior regions 649, 659.
[0098] According to one embodiment, the picture outline 645, 655 coincides with at least one of the boundaries of blocks divided into three in the same direction from the non-square blocks 640, 650. In this case, the non-square blocks 640, 650 are divided into three in the same direction, into one square block 644, 654 and two non-square blocks 642, 646, 652, 656. In this case, no separate division information is required for the division of the non-square blocks 640, 650.
[0099] According to one embodiment, the boundary between the non-square block 642 and the square block 644 among the blocks 642, 644, and 646 divided in the same direction from the non-square block 640 also coincides with the outline 645 of the picture. In this case, the non-square block 642 existing inside the outline 645 of the picture is decoded (or coded) without being further divided, and is then divided into a plurality of blocks using division information parsed from the bitstream, as described with reference to Figures 10 to 23. However, the square block 644 and the non-square block 646 existing outside the outline 645 of the picture correspond to the outer region 649 of the picture, and therefore the square block 644 and the non-square block 646 are not decoded (or coded).
[0100] According to one embodiment, among the blocks 652, 654, and 656 that are divided from the non-square block 650 in the same direction, the boundary between the square block 654 and the non-square block 656 also coincides with the outline 655 of the picture. In this case, the non-square block 652 and the square block 654 that exist within the outline 655 of the picture are decoded (or coded) without being further divided, and are then divided into a plurality of blocks using division information parsed from the bitstream, as will be described with reference to Figures 10 to 23. However, the non-square block 656 that exists outside the outline 655 of the picture corresponds to the outer region 659 of the picture, and therefore the non-square block 656 is not decoded (or coded).
[0101] 7A through 7D illustrate a process in which blocks of a picture boundary are recursively divided according to one embodiment.
[0102] 7A, a first block 710 is outside the picture boundary 711. When the first block 710 is outside the picture boundary 711, an upper region of the first block 710 is an inner region 721 of the picture, and a lower region of the first block 710 is an outer region 722 of the picture.
[0103] According to an embodiment, when the first block 710 falls outside the picture outline 711, the first block 710 is also divided into two second blocks 712 and 719 in the same manner as the block 500 that falls outside the picture outline 510 as shown in FIG 5A. However, the second block 712 of the divided second blocks 712 and 719 still falls outside the picture outline 711. Therefore, the second block 712 is further divided into two third blocks 713 and 714 in the same manner as the block 630 that falls outside the picture outline 635 as shown in FIG 6A. However, since the divided third blocks 713 and 714 still fall outside the picture outline 711, the third blocks 713 and 714 are further divided once each into fourth blocks 715, 716, 717, and 718 in the same manner as the division of block 500 that falls outside picture outline 520 as shown in FIG. 5A. The above division process, i.e., the process of dividing first block 710 into fourth blocks 715, 716, 717, and 718, does not require separate division information. Therefore, information that first block 710 is divided into fourth blocks 715, 716, 717, and 718 does not need to be signaled from video encoding device 100 to video decoding device 200.
[0104] Of the fourth blocks 715, 716, 717, and 718, the fourth blocks 715 and 716 that exist inside the picture outline 711 are included in the internal area 721 of the picture, and are therefore not further divided and are decoded (or coded), and are then divided into a plurality of blocks and decoded (or coded) using division information parsed from the bitstream, as will be described with reference to Figures 10 to 23. However, the blocks 717, 718, and 719 that exist outside the picture outline 711 correspond to the external area 722 of the picture, and therefore the blocks 717, 718, and 719 are not decoded (or coded).
[0105] 7B, a first block 730 is outside the picture boundary 731. When the first block 730 is outside the picture boundary 731, an upper region of the first block 730 is an inner region 741 of the picture, and a lower region of the first block 730 is an outer region 742 of the picture.
[0106] According to an embodiment, when the first block 730 falls outside the picture outline 731, the first block 730 is also divided into two second blocks 732 and 733 in the same manner as the block 500 that falls outside the picture outline 510 shown in FIG. 5A. However, the second block 733 of the divided second blocks 732 and 733 still falls outside the picture outline 731. Therefore, the second block 733 is further divided into two third blocks 734 and 735 in the same manner as the block 630 that falls outside the picture outline 635 shown in FIG. 6A. However, since the divided third blocks 734 and 735 still fall outside the picture outline 731, the third blocks 734 and 735 are further divided once each into fourth blocks 736, 737, 738, and 739 in the same manner as the division of block 500 that falls outside picture outline 520 as shown in FIG. 5A. In the above division process, i.e., the process of dividing first block 730 into fourth blocks 736, 737, 738, and 739, no separate division information is required. Therefore, information that first block 730 is divided into fourth blocks 736, 737, 738, and 739 does not need to be signaled from video encoding device 100 to video decoding device 200.
[0107] Blocks 732, 736, and 737 existing inside the picture outline 731 are included in an internal area 741 of the picture, and therefore are not further divided, but are decoded (or coded), and are then divided into a plurality of blocks using division information parsed from the bitstream, and are decoded (or coded), as will be described with reference to Figures 10 to 23. However, blocks 738 and 739 existing outside the picture outline 731 fall within an external area 742 of the picture, and therefore blocks 738 and 739 are not decoded (or coded).
[0108] 7C, a first block 750 is outside the picture boundary 751. When the first block 750 is outside the picture boundary 751, the upper left region of the first block 750 is an inner region 761 of the picture, and the remaining region of the first block 750 is an outer region 762 of the picture.
[0109] According to one embodiment, when the first block 750 falls outside the picture boundary 751, the first block 750 is also divided into two second blocks 752 and 757 in a manner similar to the division of the block 500 outside the picture boundary 570 shown in FIG. 5D. However, the second block 752 of the divided second blocks 752 and 757 still falls outside the picture boundary 751. Therefore, the second block 752 is further divided into two third blocks 753 and 756 in the same manner as the division of the block 630 outside the picture boundary 635 shown in FIG. 6A. However, since the divided third block 753 still falls outside the picture outline 751, the third block 753 is further divided once more into fourth blocks 754 and 755 in the same manner as the division of block 500 that falls outside the picture outline 520 shown in FIG. 5A. The above division process, i.e., the process of dividing the first block 750 into the fourth blocks 754 and 755, does not require separate division information. Therefore, information that the first block 750 is divided into the fourth blocks 754 and 755 does not need to be signaled from the video encoding device 100 to the video decoding device 200.
[0110] Block 754 existing inside picture outline 751 is included in an internal area 761 of the picture, so it is not divided any further and is decoded (or coded), and is divided into a plurality of blocks using division information parsed from the bitstream, as will be described with reference to Figures 10 to 23, and is then decoded (or coded). However, blocks 755, 756, and 757 existing outside picture outline 751 fall within an external area 762 of the picture, so blocks 755, 756, and 757 are not decoded (or coded).
[0111] 7D, a first block 770 is outside the picture boundary 771. When the first block 770 is outside the picture boundary 771, the upper left region of the first block 770 is an inner region 781 of the picture, and the remaining region of the first block 770 is an outer region 782 of the picture.
[0112] According to one embodiment, if the first block 770 falls outside the picture boundary 771, the first block 770 is also divided into two second blocks 772 and 777 in a manner similar to the division of the block 500 outside the picture boundary 580 shown in FIG. 5D. However, the second block 772 of the divided second blocks 772 and 777 still falls outside the picture boundary 771. Therefore, the second block 772 is further divided into two third blocks 773 and 776 in a manner similar to the division of the block 610 outside the picture boundary 615 shown in FIG. 6A. However, since the divided third block 773 still falls outside the picture outline 771, the third block 773 is further divided once more into fourth blocks 774 and 775 in the same manner as the division of block 500 that falls outside the picture outline 520 shown in FIG. 5A. The above division process, i.e., the process of dividing first block 770 into fourth blocks 774 and 775, does not require separate division information. Therefore, information that first block 770 is divided into fourth blocks 774 and 775 does not need to be signaled from video encoding device 100 to video decoding device 200.
[0113] Blocks 773 and 774 existing inside the picture outline 771 are included in an internal area 781 of the picture, and are therefore not divided any further, but are decoded (or coded), and are then divided into a plurality of blocks using division information parsed from the bitstream, and are then decoded (or coded), as will be described with reference to Figures 10 to 23. However, blocks 775 and 777 existing outside the picture outline 771 fall within an external area 782 of the picture, and so are not decoded (or coded).
[0114] The video encoding apparatus 100 according to an embodiment may predict, transform (e.g., discrete cosine transform) and quantize a block in an internal region of a picture that does not deviate from the picture outline without dividing the block, or may predict, transform and quantize the block after dividing the block into a plurality of blocks as described with reference to Figures 10 to 23. However, if the block deviates from the picture outline, only pixel values of the region that does not deviate from the picture outline are encoded according to the division results according to the various embodiments described above.
[0115] The video decoding apparatus 200 according to an embodiment may divide a block in an internal region of a picture that does not deviate from the picture outline using division information (e.g., block shape information and division shape information) parsed from a bitstream, or may perform inverse quantization, inverse transformation, and prediction without dividing the block. However, if the block deviates from the picture outline, only pixel values of the region that does not deviate from the picture outline are decoded according to the division results according to the various embodiments described above.
[0116] According to an embodiment, when the current block is outside the picture boundary, the current block is divided according to the various embodiments described above. Since division is necessary to decode (or encode) only pixel values in the area that does not fall outside the boundary, it is not necessary to decode (or encode) information related to division for the current block that falls outside the picture boundary. This is because the decoding side can know that the current block is divided, even if information related to division is not separately encoded.
[0117] According to one embodiment, in a block located on the picture outline, only pixel values that do not fall outside the outline are decoded (or encoded), so there is no need to generate decoded data (or encoded data) for unnecessary pixel values that fall outside the outline, thereby reducing the amount of calculation required for decoding (or encoding).
[0118] In the above embodiment, a method of dividing a block outside the picture boundary line is disclosed in order to decode (or encode) only pixel values of a region within a picture. However, if a constraint is added so that a block outside the picture boundary line is not generated from the beginning, it is not necessary to use the division method of the above embodiment.
[0119] According to another embodiment, the width and height of the picture are also multiples of the smallest block size, e.g., the width of the picture is also a multiple of the width of the coding unit with the smallest width, and the height of the picture is also a multiple of the height of the coding unit with the smallest height.
[0120] In yet another embodiment, if the width and height of a picture are not multiples of the minimum block size (or a specific block size), the area outside the picture boundary may be padded with a predetermined value to expand at least one of the width and height of the picture, in which case the actual width and height are signaled, and only the area corresponding to the actual width and height is displayed in a subsequent display process.
[0121] In yet another embodiment, if the width and height of the picture are not multiples of the minimum block size (or a specific block size), the area adjacent to the picture outline is cropped and at least one of the width and height of the picture is reduced.
[0122] FIG. 8 is a flowchart illustrating a video encoding method according to an embodiment.
[0123] In step S810, the position of the current coding unit in the picture is compared with at least one of the width and height of the picture to determine whether the current coding unit is outside the picture boundary.
[0124] In step S820, if the current coding unit is outside the picture boundary, the current coding unit is divided in at least one direction into a plurality of coding units based on the shape of the current coding unit, where the division manner may differ depending on whether the shape of the current coding unit is square or non-square.
[0125] In step S830, if the current coding unit does not deviate from the picture boundary, block shape information and partition shape information of the current coding unit are coded.
[0126] In step S840, coding units of the plurality of coding units that are not further divided are coded.
[0127] FIG. 9 is a flowchart illustrating a video decoding method according to an embodiment.
[0128] In step S910, the position of the current coding unit in the picture is compared with at least one of the width and height of the picture to determine whether the current coding unit is outside the picture boundary.
[0129] In step S920, if the current coding unit is outside the picture boundary, the current coding unit is divided in at least one direction into a plurality of coding units based on the shape of the current coding unit, where the division manner may differ depending on whether the shape of the current coding unit is square or non-square.
[0130] In step S930, if the current coding unit does not deviate from the picture boundary, block shape information and partition shape information related to the current coding unit are obtained from the bitstream, and the current coding unit is partitioned into a plurality of coding units based on the block shape information and the partition shape information.
[0131] In step S940, coding units of the plurality of coding units that are not further divided are decoded.
[0132] Hereinafter, a method for determining a data unit of an image according to an embodiment will be described in detail with reference to FIGS.
[0133] FIG. 10 illustrates a process in which the video decoding device 200 divides a current coding unit and determines at least one coding unit, according to an embodiment.
[0134] According to an embodiment, the video decoding device 200 may determine the type of the coding unit using the block type information, and may determine the type in which the coding unit is to be divided using the partition type information. That is, the partitioning method of the coding unit indicated by the partition type information is determined depending on the block type indicated by the block type information used by the video decoding device 200.
[0135] According to an embodiment, the video decoding apparatus 200 may use block shape information indicating that the current coding unit is square. For example, the video decoding apparatus 200 may determine whether to not divide the square coding unit, to divide it vertically, to divide it horizontally, or to divide it into four coding units, according to the division shape information. Referring to FIG. 10, when the block shape information of the current coding unit 1000 indicates a square shape, the decoder 1030 may not divide the coding unit 1010a having the same size as the current coding unit 1000 according to the division shape information indicating no division, or may determine the divided coding units 1010b, 1010c, and 1010d according to the division shape information indicating a predetermined division method.
[0136] 10, the video decoding apparatus 200 may determine two coding units 1010b obtained by dividing the current coding unit 1000 in the vertical direction based on the division type information indicating division in the vertical direction, according to an embodiment. The video decoding apparatus 200 may determine two coding units 1010c obtained by dividing the current coding unit 1000 in the horizontal direction based on the division type information indicating division in the horizontal direction. The video decoding apparatus 200 may determine four coding units 1010d obtained by dividing the current coding unit 1000 in the vertical and horizontal directions based on the division type information indicating division in the vertical and horizontal directions. However, the division type in which the square coding unit is divided is not limited to the above-mentioned type, and may include various types that can be indicated by the division type information. Predetermined division types in which the square coding unit is divided will be described in detail below through various embodiments.
[0137] FIG. 11 illustrates a process in which a video decoder 200 divides a non-square coding unit to determine at least one coding unit, according to one embodiment.
[0138] According to an embodiment, the video decoding apparatus 200 may use block shape information indicating that the current coding unit is non-square. The video decoding apparatus 200 may determine whether to not divide the non-square current coding unit or to divide it according to a predetermined method according to the division type information. Referring to FIG. 11, when the block shape information of the current coding unit 1100 or 1150 indicates a non-square shape, the video decoding apparatus 200 may not divide the coding unit 1110 or 1160 having the same size as the current coding unit 1100 or 1150 according to the division type information indicating no division, or may determine the divided coding units 1120a, 1120b, 1130a, 1130b, 1130c, 1170a, 1170b, 1180a, 1180b, and 1180c according to the division type information indicating a predetermined division method. The predetermined division method for dividing the non-square coding unit will be described in detail below through various embodiments.
[0139] According to an embodiment, the video decoding apparatus 200 may determine a manner in which a coding unit is divided using the division type information, and in this case, the division type information may indicate the number of at least one coding unit to be generated by dividing the coding unit. Referring to FIG 11, when the division type information indicates that the current coding unit 1100 or 1150 is divided into two coding units, the video decoding apparatus 200 may divide the current coding unit 1100 or 1150 based on the division type information and determine two coding units 1120a, 11420b or 1170a, 1170b included in the current coding unit.
[0140] According to an embodiment, when the video decoding apparatus 200 divides the non-square shaped current coding unit 1100 or 1150 based on the division shape information, the video decoding apparatus 200 may divide the current coding unit in consideration of a position of a long side of the non-square shaped current coding unit 1100 or 1150. For example, the video decoding apparatus 200 may determine a plurality of coding units by dividing the current coding unit 1100 or 1150 in a direction that divides the long side of the current coding unit 1100 or 1150 in consideration of the shape of the current coding unit 1100 or 1150.
[0141] According to an embodiment, when the partitioning format information indicates that the coding unit is to be partitioned into an odd number of blocks, the video decoding apparatus 200 may determine an odd number of coding units included in the current coding unit 1100 or 1150. For example, when the partitioning format information indicates that the current coding unit 1100 or 1150 is to be partitioned into three coding units, the video decoding apparatus 200 may partition the current coding unit 1100 or 1150 into three coding units 1130a, 1130b, 1130c, 1180a, 1180b, and 1180c. According to an embodiment, the video decoding apparatus 200 may determine an odd number of coding units included in the current coding unit 1100 or 1150, and the determined coding units may not all have the same size. For example, among the determined odd number of coding units 1130a, 1130b, 1130c, 1180a, 1180b, and 1180c, a certain coding unit 1130b or 1180b may have a size different from the other coding units 1130a, 1130c, 1180a, and 1180c. That is, the coding units determined by dividing the current coding unit 1100 or 1150 may have a variety of sizes, and in some cases, the odd number of coding units 1130a, 1130b, 1130c, 1180a, 1180b, and 1180c may have different sizes.
[0142] According to an embodiment, when the partitioning type information indicates that a coding unit is partitioned into an odd number of blocks, the video decoding apparatus 200 may determine an odd number of coding units included in the current coding unit 1100 or 1150, and may further impose a predetermined restriction on at least one coding unit among the odd number of coding units generated by partitioning. Referring to FIG 11, the video decoding apparatus 200 performs a decoding process for the coding units 1130b and 1180b located in the center among three coding units 1130a, 1130b, 1130c, 1180a, 1180b, and 1180c generated by partitioning the current coding unit 1100 or 1150, different from the other coding units 1130a, 1130c, 1180a, and 1180c. For example, the video decoding device 200 may limit the centrally located coding units 1130b, 1180b from being further divided, unlike the other coding units 1130a, 1130c, 1180a, 1180c, or may limit the number of divisions to a predetermined number.
[0143] FIG. 12 illustrates a process in which the video decoding apparatus 200 divides a coding unit based on at least one of block format information and partition format information, according to an embodiment.
[0144] According to an embodiment, the video decoding apparatus 200 may determine whether or not to divide the square-shaped first coding unit 1200 into coding units based on at least one of the block shape information and the division shape information. According to an embodiment, if the division shape information indicates that the first coding unit 1200 is to be divided in the horizontal direction, the video decoding apparatus 200 may divide the first coding unit 1200 in the horizontal direction to determine the second coding unit 1210. According to an embodiment, the first coding unit, the second coding unit, and the third coding unit used are terms used to understand the division context between the coding units. For example, if the first coding unit is divided, the second coding unit is determined, and if the second coding unit is divided, the third coding unit is determined. Hereinafter, it is also understood that the relationship between the first coding unit, the second coding unit, and the third coding unit used is due to the above-mentioned characteristics.
[0145] According to an embodiment, the video decoding apparatus 200 may determine whether to divide the determined second coding unit 1210 into coding units based on at least one of block shape information and partition shape information. Referring to FIG 12, the video decoding apparatus 200 may divide the non-square second coding unit 1210 determined by dividing the first coding unit 1200 into at least one third coding unit 1220a, 1220b, 1220c, 1220d based on at least one of block shape information and partition shape information, or may not divide the second coding unit 1210. The video decoding apparatus 200 may acquire at least one of block configuration information and partition configuration information, and may divide the first coding unit 1200 based on at least one of the acquired block configuration information and partition configuration information, for example, into a plurality of second coding units 1210 of various types, and the second coding units 1210 may also be divided according to the manner in which the first coding unit 1200 was divided, based on at least one of the block configuration information and partition configuration information related to the first coding unit 1200. According to an embodiment, when the first coding unit 1200 is divided into the second coding units 1210 based on at least one of the block configuration information and partition configuration information related to the first coding unit 1200, the second coding unit 1210 may also be divided into, for example, third coding units 1220a, 1220b, 1220c, and 1220d, based on at least one of the block configuration information and partition configuration information related to the second coding unit 1210. That is, the coding units are recursively divided based on at least one of the division form information and the block form information associated with each coding unit. Thus, in the non-square coding units, a square coding unit is determined, and the square coding unit is recursively divided to determine a non-square coding unit. Referring to FIG. 12, among the odd number of third coding units 1220b, 1220c, and 1220d determined by dividing the non-square second coding unit 1210, a predetermined coding unit (e.g., a coding unit located in the middle or a square coding unit) is recursively divided.According to one embodiment, one square-shaped third coding unit 1220c among the odd number of third coding units 1220b, 1220c, 1220d is divided horizontally into a plurality of fourth coding units. One non-square-shaped fourth coding unit 1240 among the plurality of fourth coding units is also divided into a plurality of coding units. For example, the non-square-shaped fourth coding unit 1240 is further divided into an odd number of coding units 1250a, 1250b, 1250c.
[0146] The method used for recursively splitting the coding units will be described in various embodiments.
[0147] According to an embodiment, the video decoding device 200 may determine whether to divide each of the third coding units 1220a, 1220b, 1220c, and 1220d into coding units or not to divide the second coding unit 1210 based on at least one of the block configuration information and the division configuration information. According to an embodiment, the video decoding device 200 may divide the non-square second coding unit 1210 into an odd number of third coding units 1220b, 1220c, and 1220d. The video decoding device 200 may set a predetermined restriction on a certain third coding unit among the odd number of third coding units 1220b, 1220c, and 1220d. For example, the video decoding device 200 may restrict the coding unit 1220c located in the middle of the odd number of third coding units 1220b, 1220c, and 1220d so that it is not further divided or that it must be divided a configurable number of times. 12, the video decoding apparatus 200 may restrict the coding unit 1220c located in the middle of the odd number of third coding units 1220b, 1220c, and 1220d included in the non-square second coding unit 1210 to not be further divided, to be divided into a predetermined division form (e.g., to be divided into only four coding units, or to be divided into a form corresponding to the division form of the second coding unit 1210), or to be divided a predetermined number of times (e.g., to be divided only n times, n>0). However, the above restriction on the coding unit 1220c located in the middle is merely a simple embodiment, and should not be construed as being limited to the above embodiment, but should be construed as including various restrictions in which the coding unit 1220c located in the middle is decoded differently from the other coding units 1220b and 1220d.
[0148] According to an embodiment, the video decoding apparatus 200 may obtain at least one of block configuration information and partition configuration information used to partition the current coding unit at a predetermined position within the current coding unit.
[0149] FIG 13 illustrates a method for the video decoding apparatus 200 to determine a predetermined coding unit among an odd number of coding units according to an embodiment. Referring to FIG 13, at least one of block shape information and partition shape information of a current coding unit 1300 is also obtained from a sample at a predetermined position (e.g., a sample 1340 located in the middle) among a plurality of samples included in the current coding unit 1300. However, the predetermined position in the current coding unit 1300 from which at least one of the block shape information and partition shape information is obtained should not be interpreted as being limited to the middle position illustrated in FIG 13, but should be interpreted as including various positions (e.g., top end, bottom end, left end, right end, left top end, left bottom end, right top end, right bottom end, etc.) included in the current coding unit 1300. The video decoding apparatus 200 may obtain at least one of the block shape information and partition shape information obtained from the predetermined position and determine whether to divide the current coding unit into coding units of various shapes and sizes or not to divide the current coding unit.
[0150] According to an embodiment, when a current coding unit is divided into a predetermined number of coding units, the video decoding apparatus 200 may select one of the coding units. There are various methods for selecting one of the multiple coding units, and such methods will be described through the following various embodiments.
[0151] According to an embodiment, the video decoding apparatus 200 may divide a current coding unit into a plurality of coding units and determine a coding unit at a predetermined position.
[0152] FIG. 13 illustrates a method for the video decoding device 200 to determine a coding unit at a predetermined position among an odd number of coding units according to one embodiment.
[0153] According to an embodiment, the video decoding apparatus 200 may use information indicating the positions of each of the odd-numbered coding units to determine a coding unit located in the middle among the odd-numbered coding units. Referring to FIG. 13, the video decoding apparatus 200 may divide a current coding unit 1300 to determine odd-numbered coding units 1320a, 1320b, and 1320c. The video decoding apparatus 200 may determine the middle coding unit 1320b using information related to the positions of the odd-numbered coding units 1320a, 1320b, and 1320c. For example, the video decoding apparatus 200 may determine the positions of the coding units 1320a, 1320b, and 1320c based on information indicating the positions of certain samples included in the coding units 1320a, 1320b, and 1320c to determine the coding unit 1320b located in the middle. Specifically, the video decoding device 200 can determine the positions of the coding units 1320a, 1320b, and 1320c based on information indicating the positions of the upper left samples 1330a, 1330b, and 1330c of the coding units 1320a, 1320b, and 1320c, thereby determining the coding unit 1320b located in the middle.
[0154] According to an embodiment, the information indicating the positions of the top left samples 1330a, 1330b, and 1330c included in the coding units 1320a, 1320b, and 1320c may include information related to the positions or coordinates of the coding units 1320a, 1320b, and 1320c in a picture. According to an embodiment, the information indicating the positions of the top left samples 1330a, 1330b, and 1330c included in the coding units 1320a, 1320b, and 1320c may include information indicating a width or height of the coding units 1320a, 1320b, and 1320c included in the current coding unit 1300, where such a width or height corresponds to information indicating a difference between the coordinates of the coding units 1320a, 1320b, and 1320c in a picture. That is, the video decoding device 200 can determine the coding unit 1320b located in the middle by directly using information related to the positions or coordinates of the coding units 1320a, 1320b, and 1320c within the picture, or by using information related to the width or height of the coding unit corresponding to the difference between the coordinates.
[0155] According to an embodiment, information indicating a position of the top left sample 1330a of the top coding unit 1320a may indicate (xa, ya) coordinates, information indicating a position of the top left sample 1330b of the middle coding unit 1320b may indicate (xb, yb) coordinates, and information indicating a position of the top left sample 1330c of the bottom coding unit 1320c may indicate (xc, yc) coordinates. The video decoding apparatus 200 may determine the middle coding unit 1320b using the coordinates of the top left samples 1330a, 1330b, and 1330c included in the coding units 1320a, 1320b, and 1320c, respectively. For example, when the coordinates of the upper left samples 1330a, 1330b, and 1330c are sorted in ascending or descending order, the coding unit 1320b including the coordinates (xb, yb) of the middle sample 1330b can be determined to be the middle coding unit among the coding units 1320a, 1320b, and 1320c determined by dividing the current coding unit 1300. However, the coordinates indicating the positions of the upper left samples 1330a, 1330b, and 1330c may indicate coordinates indicating absolute positions within a picture, and furthermore, (dxb, dyb) coordinates indicating the relative position of the upper left sample 1330b of the middle coding unit 1320b based on the position of the upper left sample 1330a of the upper coding unit 1320a, and (dxc, dyc) coordinates indicating the relative position of the upper left sample 1330c of the lower coding unit 1320c may be used. Furthermore, the method of determining a coding unit at a predetermined position by using the coordinates of a sample as information indicating the position of the sample included in the coding unit should not be interpreted as being limited to the above-mentioned method, but should be interpreted as various arithmetic methods that can use the coordinates of the sample.
[0156] According to an embodiment, the video decoding device 200 may divide the current coding unit 1300 into a plurality of coding units 1320a, 1320b, and 1320c, and may select a coding unit from among the coding units 1320a, 1320b, and 1320c according to a predetermined criterion. For example, the video decoding device 200 may select a coding unit 1320b having a different size from the coding units 1320a, 1320b, and 1320c.
[0157] According to an embodiment, the video decoding device 200 may determine the width or height of each of the coding units 1320a, 1320b, and 1320c using (xa, ya) coordinates indicating the position of the top left sample 1330a of the top coding unit 1320a, (xb, yb) coordinates indicating the position of the top left sample 1330b of the middle coding unit 1320b, and (xc, yc) coordinates indicating the position of the top left sample 1330c of the bottom coding unit 1320c. The video decoding device 200 may determine the size of each of the coding units 1320a, 1320b, and 1320c using (xa, ya), (xb, yb), and (xc, yc) coordinates indicating the positions of the coding units 1320a, 1320b, and 1320c.
[0158] According to an embodiment, the video decoding apparatus 200 may determine the width of the top coding unit 1320a as xb-xa and the height as yb-ya. According to an embodiment, the video decoding apparatus 200 may determine the width of the middle coding unit 1320b as xc-xb and the height as yc-yb. According to an embodiment, the video decoding apparatus 200 may determine the width or height of the bottom coding unit using the width or height of the current coding unit and the widths and heights of the top coding unit 1320a and the middle coding unit 1320b. The video decoding apparatus 200 may determine a coding unit having a size different from other coding units based on the determined widths and heights of the coding units 1320a, 1320b, and 1320c. 13, the video decoding apparatus 200 may determine a middle coding unit 1320b having a different size from the top coding unit 1320a and the bottom coding unit 1320c as a coding unit at a predetermined position. However, the above-described process of the video decoding apparatus 200 determining coding units having different coding units and different sizes is merely one embodiment of determining a coding unit at a predetermined position using the size of the coding unit determined based on sample coordinates, and therefore various processes of determining a coding unit at a predetermined position by comparing the size of the coding unit determined based on predetermined sample coordinates may be used.
[0159] However, the position of the sample considered to determine the position of the coding unit is not to be interpreted as being limited to the upper left end as mentioned above, but may also be interpreted as information related to the position of any sample included in the coding unit being used.
[0160] According to an embodiment, the video decoding apparatus 200 may select a coding unit at a predetermined position from among an odd number of coding units determined by dividing the current coding unit, taking into consideration the shape of the current coding unit. For example, if the current coding unit is a non-square shape in which the width is longer than the height, the video decoding apparatus 200 may determine a coding unit at a predetermined position along the horizontal direction. That is, the video decoding apparatus 200 may determine one of the coding units at different positions in the horizontal direction and set a restriction on the coding unit. If the current coding unit is a non-square shape in which the height is longer than the width, the video decoding apparatus 200 may determine a coding unit at a predetermined position along the vertical direction. That is, the video decoding apparatus 200 may determine one of the coding units at different positions in the vertical direction and set a restriction on the coding unit.
[0161] According to an embodiment, the video decoding apparatus 200 may use information indicating the positions of each of the even number of coding units to determine a coding unit at a predetermined position among the even number of coding units. The video decoding apparatus 200 may divide the current coding unit to determine the even number of coding units, and may determine a coding unit at a predetermined position using information regarding the positions of the even number of coding units. A detailed process related to this is omitted because it corresponds to the process of determining a coding unit at a predetermined position (e.g., a middle position) among the odd number of coding units described in FIG. 13.
[0162] According to an embodiment, when a non-square current coding unit is divided into a plurality of coding units, in order to determine a coding unit at a predetermined position among the plurality of coding units, the video decoding apparatus 200 may use predetermined information related to the coding unit at a predetermined position during the division process. For example, in order to determine a coding unit at a center among the plurality of coding units into which the current coding unit is divided, the video decoding apparatus 200 may use at least one of block shape information and partition shape information stored in a sample included in the center coding unit during the division process.
[0163] 13, the video decoding apparatus 200 may divide a current coding unit 1300 into a plurality of coding units 1320a, 1320b, and 1320c based on at least one of block configuration information and partition configuration information, and may determine a coding unit 1320b located in the middle of the plurality of coding units 1320a, 1320b, and 1320c. Furthermore, the video decoding apparatus 200 may determine the coding unit 1320b located in the middle by considering a position where at least one of block configuration information and partition configuration information is obtained. That is, at least one of the block shape information and the partition shape information of the current coding unit 1300 is also obtained from a sample 1340 located in the middle of the current coding unit 1300, and when the current coding unit 1300 is divided into a plurality of coding units 1320a, 1320b, and 1320c based on at least one of the block shape information and the partition shape information, the coding unit 1320b including the sample 1340 may be determined as the coding unit located in the middle. However, the information used to determine the coding unit located in the middle is not limited to at least one of the block shape information and the partition shape information, and various information may be used in the process of determining the coding unit located in the middle.
[0164] According to an embodiment, the predetermined information for identifying a coding unit at a predetermined position is also obtained from a predetermined sample included in the coding unit to be determined. Referring to FIG 13, the video decoding apparatus 200 may use at least one of block shape information and partition shape information obtained from a sample at a predetermined position in the current coding unit 1300 (e.g., a sample located at the center of the current coding unit 1300) to determine a coding unit at a predetermined position (e.g., a coding unit located at the center of the multiple coding units) among multiple coding units 1320a, 1320b, and 1320c determined by dividing the current coding unit 1300. That is, the video decoding apparatus 200 may determine the sample at the predetermined position by considering the block type of the current coding unit 1300, and may determine a coding unit 1320b including a sample from which predetermined information (e.g., at least one of block type information and division type information) can be acquired among a plurality of coding units 1320a, 1320b, and 1320c determined by dividing the current coding unit 1300, and may set a predetermined restriction. Referring to FIG. 13, according to an embodiment, the video decoding apparatus 200 may determine a sample 1340 located in the middle of the current coding unit 1300 as a sample from which predetermined information can be acquired, and may set a predetermined restriction in the decoding process of the coding unit 1320b including the sample 1340. However, the position of the sample from which the predetermined information is acquired is not limited to the above position, but may be interpreted as a sample at any position included in the coding unit 1320b determined to set the restriction.
[0165] According to an embodiment, the position of the sample from which the certain information is acquired is also determined according to the shape of the current coding unit 1300. According to an embodiment, the block shape information may determine whether the shape of the current coding unit is square or non-square, and may determine the position of the sample from which the certain information is acquired according to the shape. For example, the video decoding apparatus 200 may determine, as the sample from which the certain information is acquired, a sample located on a boundary that divides at least one of the width and height of the current coding unit in half, using at least one of information related to the width and height of the current coding unit. For another example, when the block shape information related to the current coding unit indicates that the current coding unit is non-square, the video decoding apparatus 200 may determine, as the sample from which the certain information is acquired, one of the samples adjacent to a boundary that divides the long side of the current coding unit in half.
[0166] According to an embodiment, when the video decoding apparatus 200 divides a current coding unit into a plurality of coding units, the video decoding apparatus 200 may use at least one of block shape information and partition shape information to determine a coding unit at a predetermined position among the plurality of coding units. According to an embodiment, the video decoding apparatus 200 may acquire at least one of block shape information and partition shape information from a sample at a predetermined position included in the coding unit, and may divide a plurality of coding units generated by dividing the current coding unit using at least one of partition shape information and block shape information acquired from a sample at a predetermined position included in each of the plurality of coding units. That is, the coding unit is recursively divided using at least one of block shape information and partition shape information acquired from a sample at a predetermined position included in each of the coding units. The recursive division process of the coding unit has been described with reference to FIG. 12, and therefore a detailed description thereof will be omitted.
[0167] In one embodiment, the video decoding device 200 can divide the current coding unit and determine at least one coding unit, and can determine the order in which such at least one coding unit is decoded by a predetermined block (e.g., the current coding unit).
[0168] FIG. 14 illustrates an order in which multiple coding units are processed when the video decoding apparatus 200 divides a current coding unit and determines multiple coding units, according to an embodiment.
[0169] According to one embodiment, the video decoding device 200 may, based on the block format information and the partition format information, vertically divide the first coding unit 1400 to determine the second coding units 1410a and 1410b, or horizontally divide the first coding unit 1400 to determine the second coding units 1430a and 1430b, or vertically and horizontally divide the first coding unit 1400 to determine the second coding units 1450a, 1450b, 1450c, and 1450d.
[0170] 14, the video decoding apparatus 200 may determine an order in which the second coding units 1410a and 1410b determined by dividing the first coding unit 1400 in the vertical direction are processed in the horizontal direction 1410c. The video decoding apparatus 200 may determine a processing order in which the second coding units 1430a and 1430b determined by dividing the first coding unit 1400 in the horizontal direction are processed in the vertical direction 1430c. The video decoding apparatus 200 may determine a processing order in which the second coding units 1450a, 1450b, 1450c, and 1450d determined by dividing the first coding unit 1400 in the vertical and horizontal directions are processed in a predetermined order (e.g., a raster scan order or a z scan order) 1450e in which the coding units located in one row are processed and then the coding units located in the next row are processed.
[0171] According to an embodiment, the video decoding apparatus 200 may recursively divide the coding units. Referring to FIG. 14, the video decoding apparatus 200 may divide the first coding unit 1400 to determine a plurality of coding units 1410a, 1410b, 1430a, 1430b, 1450a, 1450b, 1450c, and 1450d, and may recursively divide each of the determined coding units 1410a, 1410b, 1430a, 1430b, 1450a, 1450b, 1450c, and 1450d. A method of dividing the plurality of coding units 1410a, 1410b, 1430a, 1430b, 1450a, 1450b, 1450c, and 1450d corresponds to a method of dividing the first coding unit 1400. Thus, the plurality of coding units 1410a, 1410b, 1430a, 1430b, 1450a, 1450b, 1450c, and 1450d are also divided into a plurality of coding units independently. Referring to FIG 14, the video decoding apparatus 200 may divide the first coding unit 1400 in the vertical direction to determine the second coding units 1410a and 1410b, and may further determine whether or not to divide each of the second coding units 1410a and 1410b independently.
[0172] According to one embodiment, the video decoding device 200 may horizontally divide the second coding unit 1410a on the left side into third coding units 1420a and 1420b, and the second coding unit 1410b on the right side is not divided.
[0173] According to an embodiment, the processing order of the coding units is also determined based on the division process of the coding units. In other words, the processing order of the divided coding units is also determined based on the processing order of the coding units immediately before the division. The video decoding apparatus 200 may determine the processing order of the third coding units 1420a and 1420b determined by dividing the second coding unit 1410a on the left side, independently of the second coding unit 1410b on the right side. Since the second coding unit 1410a on the left side is divided in the horizontal direction and the third coding units 1420a and 1420b are determined, the third coding units 1420a and 1420b are also processed in the vertical direction 1420c. Also, since the order in which the second coding unit 1410a on the left side and the second coding unit 1410b on the right side are processed corresponds to the horizontal direction 1410c, the third coding units 1420a and 1420b included in the second coding unit 1410a on the left side are processed in the vertical direction 1420c, and then the right coding unit 1410b is processed. The above content is intended to explain a process in which the processing order of the coding units is determined based on the coding units before division, and should not be interpreted as being limited to the above embodiment, but should be interpreted as being used as various methods in which coding units determined by being divided into various forms are independently processed in a predetermined order.
[0174] FIG. 15 illustrates a process in which the video decoding apparatus 200 determines that a current coding unit is to be divided into an odd number of coding units when a coding unit of a predetermined order is not processed, according to an embodiment.
[0175] According to an embodiment, the video decoding apparatus 200 may determine that the current coding unit is divided into an odd number of coding units based on the acquired block configuration information and division configuration information. Referring to FIG. 15, a square-shaped first coding unit 1500 is also divided into non-square-shaped second coding units 1510a and 1510b, and the second coding units 1510a and 1510b are also independently divided into third coding units 1520a, 1520b, 1520c, 1520d, and 1520e. According to an embodiment, the video decoding apparatus 200 may divide the left coding unit 1510a in the second coding unit in the horizontal direction to determine a plurality of third coding units 1520a and 1520b, and may divide the right coding unit 1510b into an odd number of third coding units 1520c, 1520d, and 1520e.
[0176] According to an embodiment, the video decoding device 200 may determine whether the third coding units 1520a, 1520b, 1520c, 1520d, and 1520e are processed in a predetermined order, and may determine whether there is an odd number of coding units. Referring to FIG. 15, the video decoding device 200 may recursively divide the first coding unit 1500 to determine the third coding units 1520a, 1520b, 1520c, 1520d, and 1520e. The video decoding device 200 may determine whether the first coding unit 1500, the second coding unit 1510a, 1510b, or the third coding unit 1520a, 1520b, 1520c, 1520d, and 1520e are divided into an odd number of coding units in a division form based on at least one of block form information and division form information. For example, in the second coding units 1510a and 1510b, the coding units located on the right side are also divided into odd numbers of third coding units 1520c, 1520d, and 1520e. The order in which the multiple coding units included in the first coding unit 1500 are processed may be a predetermined order (e.g., z-scan order 1530), and the video decoding device 200 may determine whether the third coding units 1520c, 1520d, and 1520e determined by dividing the right second coding unit 1510b into an odd number of units satisfy a condition for being processed in the predetermined order.
[0177] According to one embodiment, the video decoding device 200 may determine whether the third coding units 1520a, 1520b, 1520c, 1520d, and 1520e included in the first coding unit 1500 satisfy a condition to be processed in a predetermined order, the condition relating to whether at least one of the width and height of the second coding units 1510a, 1510b is divided in half by the boundary of the third coding units 1520a, 1520b, 1520c, 1520d, and 1520e. For example, the third coding units 1520a, 1520b determined by dividing the height of the non-square left second coding unit 1510a in half satisfy the condition, but the boundaries of the third coding units 1520c, 1520d, 1520e determined by dividing the right second coding unit 1510b into three coding units do not allow the width or height of the right second coding unit 1510b to be divided in half, so it is determined that the third coding units 1520c, 1520d, 1520e do not satisfy the condition. If such a condition is not satisfied, the video decoding device 200 may determine that there is a disconnection in the scan order, and based on the determination result, may determine that the right second coding unit 1510b is to be divided into an odd number of coding units. According to one embodiment, when a coding unit is divided into an odd number of coding units, the video decoding device 200 may place a certain restriction on a coding unit at a certain position among the divided coding units. The content of such a restriction or the certain position, etc. have been described through various embodiments, so detailed description thereof will be omitted.
[0178] FIG. 16 illustrates a process in which the video decoding apparatus 200 divides the first coding unit 1600 and determines at least one coding unit according to an embodiment. According to an embodiment, the video decoding apparatus 200 may divide the first coding unit 1600 based on at least one of block shape information and division shape information acquired via the receiving unit 210. The square-shaped first coding unit 1600 may be divided into four square-shaped coding units or into a plurality of non-square-shaped coding units. For example, referring to FIG. 16, when the block shape information indicates that the first coding unit 1600 is a square and the division shape information indicates that the first coding unit 1600 is to be divided into non-square coding units, the video decoding apparatus 200 may divide the first coding unit 1600 into a plurality of non-square coding units. Specifically, when the division form information indicates that the first coding unit 1600 is to be divided horizontally or vertically to determine an odd number of coding units, the video decoding device 200 can divide the square-shaped first coding unit 1600 into second coding units 1610a, 1610b, and 1610c determined by dividing it vertically as an odd number of coding units, or into second coding units 1620a, 1620b, and 1620c determined by dividing it horizontally.
[0179] According to an embodiment, the video decoding apparatus 200 may determine whether the second coding units 1610a, 1610b, 1610c, 1620a, 1620b, and 1620c included in the first coding unit 1600 satisfy a condition to be processed in a predetermined order, the condition being related to whether at least one of the width and height of the first coding unit 1600 is divided in half by the boundaries of the second coding units 1610a, 1610b, 1610c, 1620a, 1620b, and 1620c. Referring to FIG 16, the boundaries of the second coding units 1610a, 1610b, and 1610c determined by dividing the square-shaped first coding unit 1600 in the vertical direction do not divide the width of the first coding unit 1600 in half, so it is also determined that the first coding unit 1600 does not satisfy the condition to be processed in a predetermined order. In addition, since the boundaries of the second coding units 1620a, 1620b, and 1620c determined by dividing the square first coding unit 1600 in the horizontal direction do not divide the width of the first coding unit 1600 in half, it is determined that the first coding unit 1600 does not satisfy the condition to be processed in a predetermined order. If such a condition is not satisfied, the video decoding device 200 may determine that there is a disconnection in the scanning order, and may determine that the first coding unit 1600 is divided into an odd number of coding units based on the determination result. According to an embodiment, when the coding unit is divided into an odd number of coding units, the video decoding device 200 may set a predetermined restriction on a coding unit at a predetermined position among the divided coding units, and the content of such a restriction or the predetermined position has been described through various embodiments, and detailed description thereof will be omitted.
[0180] According to an embodiment, the video decoding apparatus 200 may divide the first coding unit and determine various types of coding units.
[0181] 16, the video decoding apparatus 200 may divide a square-shaped first coding unit 1600, a non-square-shaped first coding unit 1630, or a non-square-shaped first coding unit 1650 into various types of coding units.
[0182] FIG. 17 illustrates that, according to one embodiment, when a non-square shaped second coding unit determined by dividing a first coding unit 1700 satisfies a certain condition, the video decoding device 200 restricts the manner in which the second coding unit is divided.
[0183] According to an embodiment, the video decoding device 200 may determine to divide the square-shaped first coding unit 1700 into non-square-shaped second coding units 1710a, 1710b, 1720a, and 1720b based on at least one of block shape information and partition shape information acquired via the receiving unit 210. The second coding units 1710a, 1710b, 1720a, and 1720b may be divided independently. Thus, the video decoding device 200 may determine whether or not to divide the first coding unit 1700 into a plurality of coding units based on at least one of block shape information and partition shape information related to each of the second coding units 1710a, 1710b, 1720a, and 1720b. According to an embodiment, the video decoding device 200 may determine the third coding units 1712a and 1712b by dividing the left second coding unit 1710a, which is determined by dividing the first coding unit 1700 in the vertical direction, in the horizontal direction. However, when the left second coding unit 1710a is divided in the horizontal direction, the video decoding device 200 may restrict the right second coding unit 1710b so that the right second coding unit 1710b is not divided in the horizontal direction in the same direction as the left second coding unit 1710a is divided. If the right second coding unit 1710b is divided in the same direction and the third coding units 1714a and 1714b are determined, the left second coding unit 1710a and the right second coding unit 1710b are divided in the horizontal direction independently, and the third coding units 1712a, 1712b, 1714a, and 1714b are determined. However, this is the same result as if the video decoding device 200 had divided the first coding unit 1700 into four square-shaped second coding units 1730a, 1730b, 1730c, and 1730d based on at least one of the block shape information and the partition shape information, which is also inefficient in terms of video decoding.
[0184] According to an embodiment, the video decoding device 200 may vertically divide the non-square second coding unit 1720a or 1720b, which is determined by dividing the first coding unit 11300 in the horizontal direction, to determine the third coding units 1722a, 1722b, 1724a, and 1724b. However, when the video decoding device 200 divides one of the second coding units (e.g., the top second coding unit 1720a) in the vertical direction, for the above-mentioned reasons, the video decoding device 200 may restrict the other second coding units (e.g., the bottom coding unit 1720b) to be divided vertically in the same direction as the top second coding unit 1720a is divided.
[0185] FIG. 18 illustrates a process in which the video decoding apparatus 200 divides a square-shaped coding unit when the division form information does not indicate division into four square-shaped coding units, according to one embodiment.
[0186] According to an embodiment, the video decoding apparatus 200 may determine second coding units 1810a, 1810b, 1820a, and 1820b by dividing the first coding unit 1800 based on at least one of the block shape information and the division shape information. The division shape information may include information related to various shapes in which the coding unit is divided, but the information related to the various shapes may not include information for dividing the coding unit into four square coding units. According to such division shape information, the video decoding apparatus 200 may not divide the square-shaped first coding unit 1800 into four square-shaped second coding units 1830a, 1830b, 1830c, and 1830d. Based on the division shape information, the video decoding apparatus 200 may determine non-square-shaped second coding units 1810a, 1810b, 1820a, and 1820b.
[0187] According to an embodiment, the video decoding apparatus 200 may independently divide the non-square second coding units 1810a, 1810b, 1820a, and 1820b, respectively, in a recursive manner, in which the second coding units 1810a, 1810b, 1820a, and 1820b are also divided in a predetermined order, which corresponds to the manner in which the first coding unit 1800 is divided based on at least one of the block shape information and the partition shape information.
[0188] For example, the video decoding device 200 may divide the left second coding unit 1810a in the horizontal direction to determine square third coding units 1812a and 1812b, and may divide the right second coding unit 1810b in the horizontal direction to determine square third coding units 1814a and 1814b. Furthermore, the video decoding device 200 may divide both the left second coding unit 1810a and the right second coding unit 1810b in the horizontal direction to determine square third coding units 1816a, 1816b, 1816c, and 1816d. In such a case, the coding units are determined in the same form as when the first coding unit 1800 is divided into four square second coding units 1830a, 1830b, 1830c, and 1830d.
[0189] As another example, the video decoding device 200 may vertically divide the top second coding unit 1820a to determine square third coding units 1822a and 1822b, and may vertically divide the bottom second coding unit 1820b to determine square third coding units 1824a and 1824b. Furthermore, the video decoding device 200 may vertically divide both the top second coding unit 1820a and the bottom second coding unit 1820b to determine square third coding units 1822a, 1822b, 1824a, and 1824b. In this case, the coding units are determined in the same form as when the first coding unit 1800 is divided into four square second coding units 1830a, 1830b, 1830c, and 1830d.
[0190] FIG. 19 illustrates that the processing order of a plurality of coding units may vary depending on the division process of the coding units, according to an embodiment.
[0191] According to an embodiment, the video decoding apparatus 200 may divide the first coding unit 1900 based on the block shape information and the division shape information. When the block shape information indicates a square shape and the division shape information indicates that the first coding unit 1900 is divided in at least one of the horizontal direction and the vertical direction, the video decoding apparatus 200 may divide the first coding unit 1900 to determine, for example, second coding units 1910a, 1910b, 1920a, 1920b, 1930a, 1930b, 1930c, and 1930d. Referring to FIG. 19, the non-square second coding units 1910a, 1910b, 1920a, and 1920b determined by dividing the first coding unit 1900 only in the horizontal direction or the vertical direction are also divided independently based on the block shape information and the division shape information associated therewith. For example, the video decoding apparatus 200 may determine third coding units 1916a, 1916b, 1916c, and 1916d by dividing second coding units 1910a and 1910b, which are generated by dividing the first coding unit 1900 in the vertical direction, in the horizontal direction, and may determine third coding units 1926a, 1926b, 1926c, and 1926d by dividing second coding units 1920a and 1920b, which are generated by dividing the first coding unit 1900 in the horizontal direction. The division process of the second coding units 1910a, 1910b, 1920a, and 1920b has been described with reference to FIG. 17, and detailed description thereof will be omitted.
[0192] According to an embodiment, the video decoding device 200 may process the coding units in a predetermined order. The characteristics related to the processing of the coding units in a predetermined order have been described with reference to FIG. 14, and therefore detailed description thereof will be omitted. Referring to FIG. 19, the video decoding device 200 may divide the square-shaped first coding unit 1900 to determine four square-shaped third coding units 1916a, 1916b, 1916c, 1916d, 1926a, 1926b, 1926c, and 1926d. According to an embodiment, the video decoding device 200 may determine a processing order of the third coding units 1916a, 1916b, 1916c, 1916d, 1926a, 1926b, 1926c, and 1926d according to the manner in which the first coding unit 1900 is divided.
[0193] According to one embodiment, the video decoding device 200 can horizontally divide the second coding units 1910a, 1910b, which are generated by dividing them vertically, to determine the third coding units 1916a, 1916b, 1916c, and 1916d. The video decoding device 200 can first vertically process the third coding units 1916a, 1916b included in the left second coding unit 1910a, and then process the third coding units 1916c, 1916d included in the right second coding unit 1910b in the vertical processing order (1917).
[0194] According to one embodiment, the video decoding device 200 can vertically divide the second coding units 1920a, 1920b generated by dividing them horizontally to determine the third coding units 1926a, 1926b, 1926c, and 1926d, and the video decoding device 200 can process the third coding units 1926a, 1926b, 1926c, and 1926d in an order (1927) of first horizontally processing the third coding units 1926a, 1926b included in the upper second coding unit 1920a, and then horizontally processing the third coding units 1926c, 1926d included in the lower second coding unit 1920b.
[0195] 19, the second coding units 1910a, 1910b, 1920a, and 1920b are divided, and square-shaped third coding units 1916a, 1916b, 1916c, 1916d, 1926a, 1926b, 1926c, and 1926d are determined. The second coding units 1910a and 1910b determined by dividing in the vertical direction and the second coding units 1920a and 1920b determined by dividing in the horizontal direction are divided in different shapes, but the third coding units 1916a, 1916b, 1916c, 1916d, 1926a, 1926b, 1926c, and 1926d determined later ultimately result in the first coding unit 1900 being divided into coding units of the same shape. As a result, the video decoding device 200 recursively divides the coding units through different processes based on at least one of the block type information and the division type information, and as a result, even if coding units of the same type are determined, the video decoding device 200 can process multiple coding units determined to be of the same type in different orders from each other.
[0196] FIG. 20 illustrates a process of determining the depth of a coding unit according to one embodiment, when a coding unit is recursively divided to determine multiple coding units, as the shape and size of the coding unit change.
[0197] According to an embodiment, the video decoding apparatus 200 may determine the depth of the coding unit according to a predetermined criterion. For example, the predetermined criterion may be the length of a long side of the coding unit. When the length of the long side of the current coding unit is divided to be 2n (n>0) times the length of the long side of the coding unit before the division, the video decoding apparatus 200 may determine that the depth of the current coding unit is increased by n from the depth of the coding unit before the division. Hereinafter, the coding unit with an increased depth is referred to as a coding unit of a lower depth.
[0198] 20, according to an embodiment, the video decoding apparatus 200 may divide the square-shaped first coding unit 2000 based on block shape information indicating a square shape (for example, the block shape information may indicate "0:SQUARE"), and determine a second coding unit 2002, a third coding unit 2004, etc., of a lower depth. If the size of the square-shaped first coding unit 2000 is 2Nx2N, the width and height of the first coding unit 2000 may be divided into 1 / 2. 1 The second coding unit 2002 determined by dividing the width and height of the second coding unit 2002 by 1 / 2 may have a size of NxN. Furthermore, the third coding unit 2004 determined by dividing the width and height of the second coding unit 2002 by 1 / 2 may have a size of N / 2xN / 2. In this case, the width and height of the third coding unit 2004 are 1 / 2 that of the first coding unit 2000. 2 If the depth of the first coding unit 2000 is D, then 1 / 2 the width and height of the first coding unit 2000 1 The depth of the second coding unit 2002 is also D+1, and is 1 / 2 the width and height of the first coding unit 2000. 2 The depth of the third coding unit 2004, which is double the depth, is also D+2.
[0199] According to one embodiment, based on block shape information indicating a non-square shape (for example, the block shape information may indicate "1:NS_VER" indicating a non-square shape in which the height is longer than the width, or "2:NS_HOR" indicating a non-square shape in which the width is longer than the height), the video decoding device 200 may divide the first coding unit 2010 or 2020, which is non-square, and determine a second coding unit 2012 or 2022 and a third coding unit 2014 or 2024 of a lower depth.
[0200] The video decoding device 200 may divide at least one of the width and height of a first coding unit 2010 having a size of Nx2N to determine, for example, second coding units 2002, 2012, and 2022. That is, the video decoding device 200 may divide the first coding unit 2010 in the horizontal direction to determine a second coding unit 2002 having a size of NxN or a second coding unit 2022 having a size of NxN / 2, or may divide the first coding unit 2010 in the horizontal and vertical directions to determine a second coding unit 2012 having a size of N / 2xN.
[0201] According to an embodiment, the video decoding device 200 may divide at least one of the width and height of the first coding unit 2020 having a size of 2NxN to determine, for example, the second coding units 2002, 2012, and 2022. That is, the video decoding device 200 may divide the first coding unit 2020 vertically to determine the second coding unit 2002 having a size of NxN or the second coding unit 2012 having a size of N / 2xN, or may divide the first coding unit 2020 horizontally and vertically to determine the second coding unit 2022 having a size of NxN / 2.
[0202] According to an embodiment, the video decoding device 200 may divide at least one of the width and height of the second coding unit 2002 having a size of NxN to determine, for example, the third coding units 2004, 2014, and 2024. That is, the video decoding device 200 may divide the second coding unit 2002 vertically and horizontally to determine the third coding unit 2004 having a size of N / 2xN / 2, or may divide the second coding unit 2002 vertically and horizontally to determine the third coding unit 2004 having a size of N / 2xN / 2. 2 Determine the third coding unit 2014 of size N / 2xN / 2, or 2 The size of the third coding unit 2024 can be determined.
[0203] According to an embodiment, the video decoding device 200 may divide at least one of the width and height of the second coding unit 2012 having a size of N / 2xN to determine, for example, the third coding units 2004, 2014, and 2024. That is, the video decoding device 200 may divide the second coding unit 2012 in the horizontal direction to determine the third coding unit 2004 having a size of N / 2xN / 2 or the third coding unit 2014 having a size of N / 2xN / 2. 2 Determine the third coding unit 2024 of size, or divide it vertically and horizontally and N / 2 2 A third coding unit 2014 of size xN / 2 may be determined.
[0204] According to an embodiment, the video decoding device 200 may divide at least one of the width and height of the second coding unit 2014 having a size of NxN / 2 to determine, for example, the third coding units 2004, 2014, and 2024. That is, the video decoding device 200 may divide the second coding unit 2012 vertically to determine the third coding unit 2004 having a size of N / 2xN / 2 or the third coding unit 2014 having a size of N / 2xN / 2. 2 2. Determine the third coding unit 2014 of size N / 2xN / 2, or divide it vertically and horizontally to N / 2xN / 2 2 The size of the third coding unit 2024 can be determined.
[0205] According to an embodiment, the video decoding apparatus 200 may divide, for example, square-shaped coding units 2000, 2002, and 2004 in the horizontal or vertical direction. For example, the first coding unit 2000 having a size of 2Nx2N may be divided vertically to determine a first coding unit 2010 having a size of Nx2N, or may be divided horizontally to determine a first coding unit 2020 having a size of 2NxN. According to an embodiment, when the depth is determined based on the length of the longest side of the coding unit, the depth of the coding unit determined by dividing the first coding unit 2000, 2002, or 2004 having a size of 2Nx2N in the horizontal or vertical direction may be the same as the depth of the first coding unit 2000, 2002, or 2004.
[0206] According to one embodiment, the width and height of the third coding unit 2014 or 2024 is half that of the first coding unit 2010 or 2020. 2 When the depth of the first coding unit 2010 or 2020 is D, the depth of the second coding unit 2012 or 2014, which is 1 / 2 the width and height of the first coding unit 2010 or 2020, is also D+1. 2 The depth of the third coding unit 2014 or 2024, which is double the depth, is also D+2.
[0207] FIG. 21 illustrates a depth partition and a part index (PID) for a coding unit partition, which are also determined according to the type and size of the coding unit, according to one embodiment.
[0208] According to an embodiment, the video decoding apparatus 200 may divide the square-shaped first coding unit 2100 to determine various types of second coding units. Referring to FIG. 21, the video decoding apparatus 200 may divide the first coding unit 2100 in at least one of the vertical direction and the horizontal direction according to the division type information to determine the second coding units 2102a, 2102b, 2104a, 2104b, 2106a, 2106b, 2106c, and 2106d. That is, the video decoding apparatus 200 may determine the second coding units 2102a, 2102b, 2104a, 2104b, 2106a, 2106b, 2106c, and 2106d based on the division type information for the first coding unit 2100.
[0209] According to an embodiment, the depths of the second coding units 2102a, 2102b, 2104a, 2104b, 2106a, 2106b, 2106c, and 2106d determined by the division form information for the square first coding unit 2100 are determined based on the length of the long side. For example, since the length of one side of the square first coding unit 2100 is the same as the length of the long side of the non-square second coding units 2102a, 2102b, 2104a, and 2104b, the depths of the first coding unit 2100 and the non-square second coding units 2102a, 2102b, 2104a, and 2104b are considered to be the same as D. In contrast, when the video decoding device 200 divides the first coding unit 2100 into four square-shaped second coding units 2106a, 2106b, 2106c, and 2106d based on the division form information, the length of one side of the square-shaped second coding units 2106a, 2106b, 2106c, and 2106d is half the length of one side of the first coding unit 2100, so the depth of the second coding units 2106a, 2106b, 2106c, and 2106d is also a depth of D+1, which is one depth lower than the depth D of the first coding unit 2100.
[0210] According to an embodiment, the video decoding apparatus 200 may divide a first coding unit 2110 having a height greater than its width in a horizontal direction according to the division format information, and divide the first coding unit 2110 into a plurality of second coding units 2112a, 2112b, 2114a, 2114b, and 2114c. According to an embodiment, the video decoding apparatus 200 may divide a first coding unit 2120 having a width greater than its height in a vertical direction according to the division format information, and divide the first coding unit 2120 into a plurality of second coding units 2122a, 2122b, 2124a, 2124b, and 2124c.
[0211] According to an embodiment, the depths of the second coding units 2112a, 2112b, 2114a, 2114b, 2116a, 2116b, 2116c, and 2116d determined by the division form information for the non-square first coding unit 2110 or 2120 are determined based on the length of the long side. For example, the length of one side of the square second coding units 2112a and 2112b is 1 / 2 times the length of one side of the non-square first coding unit 2110 whose height is longer than its width, so the depths of the square second coding units 2102a, 2102b, 2104a, and 2104b are D+1, which is one depth lower than the depth D of the non-square first coding unit 2110.
[0212] Furthermore, the video decoding device 200 can divide the non-square first coding unit 2110 into an odd number of second coding units 2114a, 2114b, and 2114c based on the division form information. The odd number of second coding units 2114a, 2114b, and 2114c may include the non-square second coding units 2114a and 2114c and the square second coding unit 2114b. In this case, the length of the long side of the non-square second coding units 2114a and 2114c and the length of one side of the square second coding unit 2114b are 1 / 2 times the length of one side of the first coding unit 2110, so the depths of the second coding units 2114a, 2114b, and 2114c are also a depth of D+1, which is one depth lower than D, which is the depth of the first coding unit 2110. The video decoding device 200 may determine the depth of a coding unit associated with a non-square first coding unit 2120 whose width is greater than its height in a manner corresponding to the above-mentioned manner for determining the depth of a coding unit associated with the first coding unit 2110.
[0213] According to an embodiment, the video decoding apparatus 200 may determine an index (PID) for partitioning the divided coding units based on a size ratio between the coding units when the coding units divided into an odd number of coding units are not the same size. Referring to FIG. 21, the coding unit 2114b located in the middle of the coding units 2114a, 2114b, and 2114c divided into an odd number of coding units has the same width as the other coding units 2114a and 2114c, but is twice as tall as the other coding units 2114a and 2114c. That is, in this case, the coding unit 2114b located in the middle may include the other coding units 2114a and 2114c. Therefore, if the index (PID) of the coding unit 2114b located in the middle according to the scanning order is 1, the index of the coding unit 2114c located next in the order is 3, which is increased by 2. That is, there is a discontinuity in the index value. According to one embodiment, the video decoding device 200 can determine whether coding units divided into an odd number of parts are not the same size as each other based on the presence or absence of discontinuity in the indexes for partitioning between such divided coding units.
[0214] According to an embodiment, the video decoding apparatus 200 may determine whether the current coding unit is divided into a specific division type based on the value of an index for distinguishing the plurality of coding units determined by dividing the current coding unit. Referring to FIG. 21, the video decoding apparatus 200 may divide a first coding unit 2110 having a rectangular shape with a height longer than its width to determine an even number of coding units 2112a, 2112b or an odd number of coding units 2114a, 2114b, 2114c. The video decoding apparatus 200 may use an index (PID) indicating each coding unit to distinguish each of the plurality of coding units. According to an embodiment, the PID may also be obtained from a sample at a predetermined position (e.g., the top left sample) of each coding unit.
[0215] According to an embodiment, the video decoding apparatus 200 may determine a coding unit at a predetermined position among the coding units determined by division using an index for coding unit division. According to an embodiment, when division type information related to a first coding unit 2110 having a rectangular shape with a height longer than a width indicates that the first coding unit 2110 is divided into three coding units, the video decoding apparatus 200 may divide the first coding unit 2110 into three coding units 2114a, 2114b, and 2114c. The video decoding apparatus 200 may assign an index related to each of the three coding units 2114a, 2114b, and 2114c. The video decoding apparatus 200 may compare the indexes related to each coding unit to determine a middle coding unit among the odd number of coding units. The video decoder 200 may determine a coding unit 2114b having an index corresponding to a median value as a middle coding unit among the coding units determined by dividing the first coding unit 2110 based on the index of the coding unit. According to an embodiment, when the coding units are not the same size, the video decoder 200 may determine the index based on a size ratio between the coding units in determining the index for the divided coding unit partition. Referring to FIG. 21, the coding unit 2114b generated by dividing the first coding unit 2110 has the same width as the other coding units 2114a and 2114c, but is twice as high as the coding units 2114a and 2114c, which have different heights. In this case, if the index (PID) of the coding unit 2114b located in the middle is 1, the index of the coding unit 2114c located next thereto is 3, which is increased by 2. In such a case, when the indexes increase uniformly but the increments vary, the video decoding device 200 may determine that the current coding unit has been divided into multiple coding units, including a coding unit having a different size from the other coding units. According to one embodiment, when the division form information indicates that the current coding unit is to be divided into an odd number of coding units, the video decoding device 200 may divide the current coding unit into a form in which a coding unit at a predetermined position among the odd number of coding units (e.g., a middle coding unit) has a different size from the other coding units.In this case, the video decoding apparatus 200 may determine middle coding units having different sizes using an index (PID) related to the coding units. However, the above indexes and the sizes or positions of the coding units at the determined predetermined positions are specific for describing one embodiment, and should not be construed as being limited thereto, and various indexes, positions and sizes of the coding units may be used.
[0216] According to an embodiment, the video decoding device 200 may use a predetermined data unit from which the recursive division of the coding unit begins.
[0217] FIG. 22 illustrates a number of coding units being determined according to a number of predefined data units included in a picture, according to one embodiment.
[0218] According to an embodiment, the predetermined data unit is also defined as a data unit into which the coding unit starts to be recursively divided using at least one of block configuration information and division configuration information. That is, the predetermined data unit corresponds to a coding unit of the highest depth used in a process of determining a plurality of coding units into which the current picture is divided. Hereinafter, for convenience of explanation, such a predetermined data unit is referred to as a reference data unit.
[0219] According to an embodiment, the reference data unit may have a predetermined size and shape. According to an embodiment, the reference coding unit may include MxN samples, where M and N may be the same as each other or may be integers expressed as a power of 2. That is, the reference data unit may have a square or non-square shape, and is subsequently divided into an integer number of coding units.
[0220] According to an embodiment, the video decoding apparatus 200 may divide the current picture into a plurality of reference data units. According to an embodiment, the video decoding apparatus 200 may divide the reference data units into which the current picture is divided, using partition information related to each of the reference data units. The partitioning process of the reference data units corresponds to a partitioning process using a quad-tree structure.
[0221] According to an embodiment, the video decoding apparatus 200 may determine in advance a minimum size that a reference data unit included in a current picture may have, and may determine reference data units of various sizes that are equal to or larger than the minimum size, and may determine at least one coding unit based on the determined reference data unit using block configuration information and partition configuration information.
[0222] 22, the video decoding apparatus 200 may use a square-shaped reference coding unit 2200 or a non-square-shaped reference coding unit 2202. According to an embodiment, the shape and size of the reference coding unit may be determined according to various data units (e.g., a sequence, a picture, a slice, a slice segment, a maximum coding unit, etc.) including at least one reference coding unit.
[0223] According to an embodiment, the receiving unit 210 of the video decoding apparatus 200 may obtain at least one of information regarding the type of the base coding unit and information regarding the size of the base coding unit from a bitstream for each of the various data units. The process of determining at least one coding unit included in the square-shaped base coding unit 2200 has been described through the process of dividing the current coding unit 300 in Fig. 10, and the process of determining at least one coding unit included in the non-square-shaped base coding unit 2200 has been described through the process of dividing the current coding unit 1100 or 1150 in Fig. 11, so detailed description thereof will be omitted.
[0224] According to an embodiment, the video decoding apparatus 200 may use an index for identifying the size and type of the reference coding unit in order to determine the size and type of the reference coding unit according to a certain data unit that is determined in advance based on a predetermined condition. That is, the receiving unit 210 may acquire only an index for identifying the size and type of the reference coding unit for each slice, slice segment, maximum coding unit, etc. as a data unit that satisfies a predetermined condition (e.g., a data unit having a size equal to or smaller than a slice) among the various data units (e.g., a sequence, a picture, a slice, a slice segment, a maximum coding unit, etc.) from the bitstream. The video decoding apparatus 200 may determine the size and type of the reference data unit for each data unit that satisfies the predetermined condition by using the index. If information related to the type of the reference coding unit and information related to the size of the reference coding unit are acquired from the bitstream for each data unit of a relatively small size and used, the bitstream may not be used efficiently. Therefore, instead of directly acquiring information related to the type of the reference coding unit and information related to the size of the reference coding unit, only the index may be acquired and used. In this case, at least one of the size and type of the reference coding unit corresponding to the index indicating the size and type of the reference coding unit is predefined. That is, the video decoding apparatus 200 may determine at least one of the size and type of the reference coding unit included in the data unit serving as a reference for index acquisition by selecting at least one of the size and type of the predefined reference coding unit according to the index.
[0225] According to an embodiment, the video decoding apparatus 200 may use at least one reference coding unit included in one maximum coding unit. That is, the maximum coding unit for dividing an image includes at least one reference coding unit, and coding units are determined through a recursive division process of each reference coding unit. According to an embodiment, at least one of the width and height of the maximum coding unit corresponds to an integer multiple of at least one of the width and height of the reference coding unit. According to an embodiment, the size of the reference coding unit is also a size obtained by dividing the maximum coding unit n times according to a quadtree structure. That is, the video decoding apparatus 200 may determine the reference coding unit by dividing the maximum coding unit n times according to a quadtree structure, and may divide the reference coding unit based on at least one of block shape information and division shape information according to various embodiments.
[0226] FIG. 23 illustrates processing blocks that are responsible for determining a determination order of reference coding units included in a picture 2300, according to one embodiment.
[0227] According to an embodiment, the video decoding apparatus 200 may determine at least one processing block for dividing a picture. The processing block is a data unit including at least one reference coding unit for dividing a picture, and the at least one reference coding unit included in the processing block is also determined in a specific order. That is, the determination order of the at least one reference coding unit determined in each processing block corresponds to one of various types of orders in which the reference coding unit is determined, and the determination order of the reference coding unit determined in each processing block is different for each processing block. The determination order of the reference coding unit determined for each processing block may be one of various orders such as a raster scan, a Z-scan, an N-scan, an up-right diagonal scan, a horizontal scan, and a vertical scan, but the determined order is not limited to the scan order.
[0228] According to an embodiment, the video decoder 200 may obtain information on the size of the processing block and determine the size of at least one processing block included in the image. The video decoder 200 may obtain information on the size of the processing block from a bitstream and determine the size of at least one processing block included in the image. The size of such a processing block is also a predetermined size of a data unit indicated by the information on the size of the processing block.
[0229] According to an embodiment, the receiving unit 210 of the video decoding device 200 may obtain information on the size of a processing block for each specific data unit from a bitstream. For example, the information on the size of a processing block may be obtained from the bitstream for each data unit such as an image, a sequence, a picture, a slice, a slice segment, etc. That is, the receiving unit 210 may obtain information on the size of a processing block from the bitstream for each of the many data units, and the video decoding device 200 may determine the size of at least one processing block for dividing a picture using the obtained information on the size of the processing block, and the size of such a processing block may be an integer multiple of a reference coding unit.
[0230] According to an embodiment, the video decoding apparatus 200 may determine the size of the processing blocks 2302 and 2312 included in the picture 2300. For example, the video decoding apparatus 200 may determine the size of the processing blocks based on information related to the size of the processing blocks acquired from a bitstream. Referring to FIG. 23, according to an embodiment, the video decoding apparatus 200 may determine the horizontal size of the processing blocks 2302 and 2312 to be four times the horizontal size of a reference coding unit and the vertical size of the processing blocks 2302 and 2312 to be four times the vertical size of the reference coding unit. The video decoding apparatus 200 may determine an order in which at least one reference coding unit is determined within at least one processing block.
[0231] According to an embodiment, the video decoding device 200 may determine each of the processing blocks 2302, 2312 included in the picture 2300 based on the size of the processing block, and may determine a determination order of at least one reference coding unit included in the processing blocks 2302, 2312. According to an embodiment, the determination of the reference coding unit may include determining the size of the reference coding unit.
[0232] According to an embodiment, the video decoding apparatus 200 may acquire information on a determination order of at least one reference coding unit included in at least one processing block from a bitstream, and may determine an order in which at least one reference coding unit is determined based on the acquired information on the determination order. The information on the determination order may also be defined as an order or direction in which the reference coding unit is determined within a processing block. That is, the order in which the reference coding unit is determined may be determined independently for each processing block.
[0233] According to an embodiment, the video decoding apparatus 200 may obtain information regarding a determination order of the reference coding units from a bitstream for each specific data unit. For example, the receiving unit 210 may obtain information regarding a determination order of the reference coding units from a bitstream for each data unit such as an image, a sequence, a picture, a slice, a slice segment, a processing block, etc. Since the information regarding the determination order of the reference coding units indicates a determination order of the reference coding units within a processing block, the information regarding the determination order is also obtained for each specific data unit including an integer number of processing blocks.
[0234] The video decoding device 200 may determine at least one reference coding unit based on the order determined according to an embodiment.
[0235] According to an embodiment, the receiving unit 210 may acquire information related to a base coding unit determination order as information related to the processing blocks 2302 and 2312 from a bitstream, and the video decoding apparatus 200 may determine an order for determining at least one base coding unit included in the processing blocks 2302 and 2312, and may determine at least one base coding unit included in the picture 2300 according to the determination order of the coding units. Referring to FIG. 23, the video decoding apparatus 200 may determine a determination order 2304 and 2314 of at least one base coding unit associated with each of the processing blocks 2302 and 2312. For example, when information related to a determination order of the base coding units is acquired for each processing block, the determination order of the base coding units associated with each of the processing blocks 2302 and 2312 may differ for each processing block. When the reference coding unit determination order 2304 associated with the processing block 2302 is a raster scan order, the reference coding units included in the processing block 2302 are also determined in the raster scan order. On the other hand, when the reference coding unit determination order 2314 associated with another processing block 2312 is a reverse raster scan order, the reference coding units included in the processing block 2312 are also determined in the reverse raster scan order.
[0236] The video decoder 200 may decode at least one reference coding unit determined according to an embodiment. The video decoder 200 may decode video based on the reference coding unit determined through the above-described embodiment. The method of decoding the reference coding unit may include various methods of decoding video.
[0237] According to an embodiment, the video decoding apparatus 200 may acquire and use block type information indicating a type of a current coding unit or partition type information indicating a method of dividing the current coding unit from a bitstream. The block type information or partition type information may be included in a bitstream associated with various data units. For example, the video decoding apparatus 200 may use block type information or partition type information included in a sequence parameter set, a picture parameter set, a video parameter set, a slice header, or a slice segment header. Furthermore, the video decoding apparatus 200 may acquire and use syntax corresponding to block type information or partition type information from the bitstream for each of a maximum coding unit, a reference coding unit, and a processing block.
[0238] The above description focuses on various embodiments. Those skilled in the art to which the present invention pertains can understand that the present invention can be embodied in modified forms without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from an explanatory perspective, not a limiting one. The scope of the present invention is defined in the claims, not the above description, and all differences within the scope of the equivalents thereto should be interpreted as being included in the present invention.
[0239] The above-described embodiments of the present invention can be created as a program executed by a computer, and can also be embodied in a general-purpose digital computer that runs the program using a computer-readable recording medium. The computer-readable recording medium includes recording media such as magnetic recording media (e.g., ROM (read-only memory), floppy disks, hard disks, etc.) and optically readable media (e.g., CD-ROM (compact disc read only memory), DVD (digital versatile disc), etc.).
Claims
1. 1. An image decoding method, comprising: obtaining a first block and a second block by dividing the current coding unit horizontally when the current coding unit has a square shape and includes an area outside a lower boundary of an image; vertically dividing the first block if the first block includes an area that is off the right boundary of the image; obtaining partitioning pattern information of the current coding unit from a bitstream when the current coding unit does not include either the region outside the bottom boundary of the image or the region outside the right boundary of the image, and partitioning the current coding unit into a plurality of coding units according to the partitioning pattern information; decoding a coding unit that is not further divided among the plurality of coding units; A method comprising:
2. 1. An image encoding method, comprising: obtaining a first block and a second block by dividing the current coding unit horizontally when the current coding unit has a square shape and includes an area outside a lower boundary of an image; vertically dividing the first block if the first block includes an area that is off the right boundary of the image; generating division form information of the current coding unit when the current coding unit does not include the area outside the lower boundary of the image and the area outside the right boundary of the image, and dividing the current coding unit into a plurality of coding units according to the division form information; encoding a coding unit that is not further divided among the plurality of coding units; A method comprising:
3. An apparatus for transmitting a bit stream, comprising: The bitstream is generated by the method of claim 2. Device.
Citation Information
Patent Citations
METHOD AND APPARATUS FOR ENCODING / DECORDING A CODING UNIT ACROSS A PICTURE BOUNDARY - Patent application
JP2013509788A
Binary tree block partitioning structure
WO2016090568A1
