Video coding method and device using selective multiple syntaxes
The selective use of multiple syntaxes in video coding based on predefined and optimizable information addresses the inefficiencies of single-syntax approaches, improving video coding efficiency and quality by optimizing bitstream configuration for specific images and conditions.
Patent Information
- Application Number
- PCT/KR2024/004242
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-01
- Filing Date
- 2024-04-02
- Publication Date
- 2024-11-21
AI Technical Summary
Existing video coding technologies face inefficiencies due to the use of a single syntax for all images and encoding conditions, leading to suboptimal compression and increased computational complexity, particularly as video data sizes and resolutions increase.
A method and apparatus for video coding that selectively uses multiple syntaxes based on predefined, optimizable, and input image information to configure the bitstream, reducing complexity and improving coding efficiency and quality.
This approach allows for optimal bitstream configuration tailored to individual images and encoding/decoding conditions, enhancing video coding efficiency and quality by eliminating unnecessary flags and branches, thereby reducing computational overhead and improving image restoration.
Smart Images

Figure KR2024004242_21112024_PF_FP_ABST
Abstract
Description
Method and device for video coding using optional multiple phrases
[0001] The present disclosure relates to a video coding method and apparatus using optional multiple phrases.
[0002] The content described below merely provides background information related to the present invention and does not constitute prior art.
[0003] Since video data has a large amount of data compared to voice data or still image data, it requires a lot of hardware resources, including memory, to store or transmit it without processing for compression.
[0004] Therefore, when storing or transmitting video data, an encoder is used to compress the video data and store or transmit it, and a decoder receives the compressed video data, decompresses it, and plays it back. Examples of such video compression technologies include H.264 / AVC, HEVC (High Efficiency Video Coding), and VVC (Versatile Video Coding), which improves encoding efficiency by about 30% compared to HEVC.
[0005] However, as the size, resolution, and frame rate of images are gradually increasing, and the amount of data that needs to be encoded is also increasing, a new compression technology that has better encoding efficiency and better image quality improvement than existing compression technologies is required.
[0006] To achieve optimal encoding efficiency, the encoder explores as many encoding cases as possible and then selects the optimal case among the explored cases. For example, the encoder selects the optimal method among various methods for performing block division structure, prediction, transformation, and quantization. Afterwards, the encoder generates a bitstream by expressing the selected optimal method using a predetermined syntax and transmits the generated bitstream to the decoder. The decoder parses the transmitted bitstream according to the predetermined syntax that constitutes the bitstream to restore the image, as illustrated in the example of Figure 6.
[0007] Meanwhile, various syntaxes exist for sending various types of information in bitstream format, as shown in the example in Figure 7. Therefore, to improve video encoding efficiency and enhance video quality, a method for effectively constructing a syntax for expressing bitstreams is necessary.
[0008] The present disclosure aims to provide a video coding method and device that selectively utilizes a syntax for constructing a bitstream by considering predefined coding information, optimizable coding information, and input image information.
[0009] According to an embodiment of the present disclosure, a method for restoring a current block, performed by a video decoding device, is provided, characterized by comprising: obtaining syntax selection information of the current block; selecting a bitstream parser using the syntax selection information; generating decoding information of the current block by parsing a bitstream using the bitstream parser, wherein the bitstream includes syntax of the current block corresponding to the syntax selection information; and restoring the current block using the decoding information.
[0010] According to another embodiment of the present disclosure, a method for encoding a current block, performed by a video encoding device, is provided, characterized in that the method comprises: encoding the current block to generate encoding information; obtaining syntax selection information of the current block; selecting a bitstream configurator using the syntax selection information; and configuring a bitstream using the bitstream configurator so that the bitstream includes syntax of the current block corresponding to the syntax selection information among encoding information of the current block.
[0011] According to another embodiment of the present disclosure, a computer-readable recording medium storing a bitstream generated by an image encoding method is provided, characterized in that the image encoding method comprises: a step of encoding a current block to generate encoding information; a step of obtaining syntax selection information of the current block; a step of selecting a bitstream configurator using the syntax selection information; and a step of configuring the bitstream using the bitstream configurator such that the bitstream includes syntax of the current block corresponding to the syntax selection information among encoding information of the current block.
[0012] As described above, according to the present embodiment, by providing a video coding method and device that selectively utilize syntax for constructing a bitstream by considering predefined coding information, optimizable coding information, and input image information, it is possible to reduce the complexity of syntax and construct an optimal bitstream according to individual images or encoding / decoding conditions.
[0013] In addition, according to the present embodiment, by providing a video coding method and device that selectively utilize syntax for configuring a bitstream by considering predefined coding information, optimizable coding information, and input image information, it is possible to improve video encoding efficiency and enhance video quality.
[0014] FIG. 1 is an exemplary block diagram of an image encoding device capable of implementing the techniques of the present disclosure.
[0015] Figure 2 is a drawing for explaining a method of dividing a block using the QTBTTT (QuadTree plus BinaryTree TernaryTree) structure.
[0016] FIGS. 3A and 3B are diagrams illustrating multiple intra prediction modes, including wide-angle intra prediction modes.
[0017] Figure 4 is an example diagram of the surrounding blocks of the current block.
[0018] FIG. 5 is an exemplary block diagram of an image decoding device capable of implementing the techniques of the present disclosure.
[0019] Figure 6 is an example diagram showing a video decoding device using a preset bitstream configuration.
[0020] Figure 7 is an example diagram showing syntax elements used in an existing video coding device.
[0021] FIG. 8 is an exemplary diagram illustrating an image decoding device using syntax selection information according to one embodiment of the present disclosure.
[0022] FIG. 9 is an exemplary diagram illustrating the operation of a syntax selector according to one embodiment of the present disclosure.
[0023] Figure 10 is an example diagram showing the existing syntax parsing structure.
[0024] FIG. 11 is an exemplary diagram showing a syntax parsing structure according to one embodiment of the present disclosure.
[0025] FIG. 12a and FIG. 12b are exemplary diagrams illustrating separation of syntax parsing according to one embodiment of the present disclosure.
[0026] FIG. 13 is an exemplary diagram illustrating parsing of syntax selection information according to one embodiment of the present disclosure.
[0027] FIG. 14 is an exemplary diagram illustrating parsing of syntax selection information according to another embodiment of the present disclosure.
[0028] FIG. 15 is a flowchart illustrating a method for an image encoding device to encode a current block according to one embodiment of the present disclosure.
[0029] FIG. 16 is a flowchart illustrating a method by which an image decoding device decodes a current block according to one embodiment of the present disclosure.
[0030] Hereinafter, embodiments of the present invention will be described in detail with reference to exemplary drawings. When designating components in each drawing, it should be noted that, where possible, identical components are given the same reference numerals, even if they appear in different drawings. Furthermore, in describing the present embodiments, detailed descriptions of related known structures or functions will be omitted if they are deemed to obscure the gist of the present embodiments.
[0031] FIG. 1 is an exemplary block diagram of an image encoding device capable of implementing the techniques of the present disclosure. Hereinafter, the image encoding device and its subcomponents will be described with reference to the illustration in FIG. 1.
[0032] The video encoding device may be configured to include a picture segmentation unit (110), a prediction unit (120), a subtractor (130), a transformation unit (140), a quantization unit (145), a reordering unit (150), an entropy encoding unit (155), an inverse quantization unit (160), an inverse transformation unit (165), an adder (170), a loop filter unit (180), and a memory (190).
[0033] Each component of the video encoding device may be implemented in hardware, software, or a combination of hardware and software. Furthermore, the functions of each component may be implemented in software, with a microprocessor executing the software functions corresponding to each component.
[0034] A single image (video) is composed of one or more sequences containing multiple pictures. Each picture is divided into multiple regions, and encoding is performed for each region. For example, a single picture is divided into one or more tiles and / or slices. Here, one or more tiles can be defined as a tile group. Each tile or slice is divided into one or more Coding Tree Units (CTUs). Each CTU is then divided into one or more Coding Units (CUs) by a tree structure. Information applied to each CU is encoded as the syntax of the CU, and information commonly applied to CUs included in a CTU is encoded as the syntax of the CTU. In addition, information commonly applied to all blocks within a single slice is encoded as the syntax of the slice header, and information applied to all blocks constituting one or more pictures is encoded in the Picture Parameter Set (PPS) or the picture header. Furthermore, information commonly referenced by multiple pictures is encoded in a Sequence Parameter Set (SPS). And, information commonly referenced by one or more SPS is encoded in a Video Parameter Set (VPS). In addition, information commonly applied to one tile or tile group may be encoded as syntax of a tile or tile group header. Syntaxes included in an SPS, PPS, slice header, tile or tile group header may be referred to as high level syntax.
[0035] The picture segmentation unit (110) determines the size of the CTU. Information about the size of the CTU (CTU size) is encoded as the syntax of SPS or PPS and transmitted to the image decoding device.
[0036] The picture segmentation unit (110) divides each picture constituting an image into a plurality of CTUs having a predetermined size, and then recursively divides the CTUs using a tree structure. A leaf node in the tree structure becomes a CU, which is a basic unit of encoding.
[0037] The tree structure may be a QuadTree (QT) in which an upper node (or parent node) is divided into four lower nodes (or child nodes) of the same size, a BinaryTree (BT) in which an upper node is divided into two lower nodes, or a TernaryTree (TT) in which an upper node is divided into three lower nodes in a 1:2:1 ratio, or a structure that mixes two or more of the QT structures, BT structures, and TT structures. For example, a QTBT (QuadTree plus BinaryTree) structure may be used, or a QTBTTT (QuadTree plus BinaryTree TernaryTree) structure may be used. Here, BTTT may be combined and referred to as a MTT (Multiple-Type Tree).
[0038] Figure 2 is a drawing for explaining a method of dividing a block using the QTBTTT structure.
[0039] As illustrated in FIG. 2, a CTU may first be split into a QT structure. The quadtree splitting may be repeated until the size of the splitting block reaches the minimum block size (MinQTSize) of the leaf node allowed in the QT. A first flag (QT_split_flag) indicating whether each node of the QT structure is split into four nodes of the lower layer is encoded by the entropy encoding unit (155) and signaled to the image decoding device. If the leaf node of the QT is not larger than the maximum block size (MaxBTSize) of the root node allowed in the BT, it may be further split into one or more of the BT structure or the TT structure. There may be multiple splitting directions in the BT structure and / or the TT structure. For example, there may be two directions in which the block of the corresponding node is split horizontally and two directions in which the block is split vertically. As illustrated in FIG. 2, when MTT splitting begins, a second flag (mtt_split_flag) indicating whether nodes have been split, and if splitting has occurred, a flag indicating the splitting direction (vertical or horizontal) and / or a flag indicating the splitting type (Binary or Ternary) are encoded by the entropy encoding unit (155) and signaled to the image decoding device.
[0040] Alternatively, before encoding the first flag (QT_split_flag) indicating whether each node is split into four nodes of a lower layer, a CU split flag (split_cu_flag) indicating whether the node is split may be encoded. If the CU split flag (split_cu_flag) value indicates that the node is not split, the block of the corresponding node becomes a leaf node in the split tree structure and becomes a CU (coding unit), which is a basic unit of encoding. If the CU split flag (split_cu_flag) value indicates that the node is split, the video encoding device starts encoding from the first flag in the above-described manner.
[0041] As another example of a tree structure, when QTBT is used, there may be two types: a type that horizontally splits the block of the corresponding node into two blocks of the same size (i.e., symmetric horizontal splitting) and a type that vertically splits it (i.e., symmetric vertical splitting). A split flag (split_flag) indicating whether each node of the BT structure is split into blocks of a lower layer and split type information indicating the type of split are encoded by the entropy encoding unit (155) and transmitted to the image decoding device. Meanwhile, there may additionally be a type that splits the block of the corresponding node into two blocks of an asymmetrical shape. The asymmetric shape may include a shape that splits the block of the corresponding node into two rectangular blocks with a size ratio of 1:3, or a shape that splits the block of the corresponding node in a diagonal direction.
[0042] A CU can have various sizes depending on the QTBT or QTBTTT partitioning from the CTU. Hereinafter, the block corresponding to the CU to be encoded or decoded (i.e., the leaf node of the QTBTTT) is referred to as the "current block." Depending on the QTBTTT partitioning employed, the current block may be rectangular as well as square.
[0043] The prediction unit (120) predicts the current block and generates a prediction block. The prediction unit (120) includes an intra prediction unit (122) and an inter prediction unit (124).
[0044] In general, each current block within a picture can be predictively coded. Prediction of the current block can typically be performed using either intra-prediction (using data from the picture containing the current block) or inter-prediction (using data from a picture coded before the picture containing the current block). Inter-prediction encompasses both unidirectional and bidirectional prediction.
[0045] The intra prediction unit (122) predicts pixels within the current block using pixels (reference pixels) located around the current block within the current picture including the current block. There are multiple intra prediction modes depending on the prediction direction. For example, as shown in Fig. 3a, the multiple intra prediction modes may include two non-directional modes including the Planar mode and the DC mode, and 65 directional modes. The surrounding pixels to be used and the calculation formula are defined differently depending on each prediction mode.
[0046] For efficient directional prediction for a rectangular current block, directional modes (intra prediction modes 67 to 80 and -1 to -14) indicated by dotted arrows in Fig. 3b may be additionally used. These may be referred to as "wide-angle intra-prediction modes." In Fig. 3b, the arrows point to corresponding reference samples used for prediction, and do not indicate the prediction direction. The prediction direction is opposite to the direction indicated by the arrows. Wide-angle intra-prediction modes are modes that perform prediction in the opposite direction of a specific directional mode without additional bit transmission when the current block is rectangular. At this time, among the wide-angle intra-prediction modes, some wide-angle intra-prediction modes available for the current block may be determined based on the ratio of the width and height of the rectangular current block. For example, wide-angle intra prediction modes (intra prediction modes 67 to 80) having an angle less than 45 degrees are available when the current block is a rectangular shape whose height is smaller than its width, and wide-angle intra prediction modes (intra prediction modes -1 to -14) having an angle greater than -135 degrees are available when the current block is a rectangular shape whose width is larger than its height.
[0047] The intra prediction unit (122) can determine an intra prediction mode to be used to encode the current block. In some examples, the intra prediction unit (122) can encode the current block using multiple intra prediction modes and select an appropriate intra prediction mode to be used from the tested modes. For example, the intra prediction unit (122) can calculate bit-rate distortion values using rate-distortion analysis for multiple tested intra prediction modes and select an intra prediction mode with the best bit-rate distortion characteristics among the tested modes.
[0048] The intra prediction unit (122) selects one intra prediction mode from among multiple intra prediction modes and predicts the current block using surrounding pixels (reference pixels) and an operation formula determined according to the selected intra prediction mode. Information about the selected intra prediction mode is encoded by the entropy encoding unit (155) and transmitted to the image decoding device.
[0049] The inter prediction unit (124) generates a prediction block for the current block using a motion compensation process. The inter prediction unit (124) searches for a block most similar to the current block within reference pictures that were encoded and decoded before the current picture, and generates a prediction block for the current block using the searched block. Then, a motion vector (MV) corresponding to the displacement between the current block within the current picture and the prediction block within the reference picture is generated. Generally, motion estimation is performed on the luma component, and the motion vector calculated based on the luma component is used for both the luma component and the chroma component. The motion information including information on the reference picture used to predict the current block and information on the motion vector is encoded by the entropy encoding unit (155) and transmitted to the image decoding device.
[0050] The inter prediction unit (124) may perform interpolation on a reference picture or a reference block to improve prediction accuracy. That is, subsamples between two consecutive integer samples are interpolated by applying filter coefficients to a plurality of consecutive integer samples including the two integer samples. When a process of searching for a block most similar to the current block is performed on the interpolated reference picture, the motion vector can be expressed up to a precision in decimal units rather than a precision in integer sample units. The precision or resolution of the motion vector can be set differently for each target region to be encoded, such as a slice, tile, CTU, CU, etc. When such adaptive motion vector resolution (AMVR) is applied, information on the motion vector resolution to be applied to each target region must be signaled for each target region. For example, when the target region is a CU, information on the motion vector resolution applied to each CU is signaled. Information on the motion vector resolution may be information indicating the precision of a differential motion vector, which will be described later.
[0051] Meanwhile, the inter prediction unit (124) can perform inter prediction using bi-prediction. In the case of bi-prediction, two reference pictures and two motion vectors indicating the block position most similar to the current block within each reference picture are used. The inter prediction unit (124) selects a first reference picture and a second reference picture from reference picture list 0 (RefPicList0) and reference picture list 1 (RefPicList1), respectively, and searches for a block similar to the current block within each reference picture to generate a first reference block and a second reference block. Then, the first reference block and the second reference block are averaged or weighted averaged to generate a prediction block for the current block. Then, motion information including information on two reference pictures used to predict the current block and information on two motion vectors is transmitted to the entropy encoding unit (155). Here, reference picture list 0 may be composed of pictures that are before the current picture in display order among the restored pictures, and reference picture list 1 may be composed of pictures that are after the current picture in display order among the restored pictures. However, this is not necessarily limited to this, and restored pictures that are after the current picture in display order may be additionally included in reference picture list 0, and conversely, restored pictures that are before the current picture may be additionally included in reference picture list 1.
[0052] Various methods can be used to minimize the number of bits required to encode motion information.
[0053] For example, if the reference picture and motion vector of the current block are identical to those of a neighboring block, the motion information of the current block can be transmitted to the image decoding device by encoding information that can identify the neighboring block. This method is called 'merge mode'.
[0054] In merge mode, the inter prediction unit (124) selects a predetermined number of merge candidate blocks (hereinafter referred to as 'merge candidates') from the surrounding blocks of the current block.
[0055] As the surrounding blocks for deriving merge candidates, all or part of the left block (A0), the lower left block (A1), the upper block (B0), the upper right block (B1), and the upper left block (B2) adjacent to the current block within the current picture may be used, as illustrated in FIG. 4. In addition, a block located within a reference picture (which may or may not be the same as the reference picture used to predict the current block) other than the current picture in which the current block is located may be used as a merge candidate. For example, a block co-located with the current block within the reference picture or blocks adjacent to the block at the co-located block may be additionally used as a merge candidate. If the number of merge candidates selected by the method described above is less than a preset number, a 0 vector is added to the merge candidates.
[0056] The inter prediction unit (124) uses these surrounding blocks to construct a merge list containing a predetermined number of merge candidates. Among the merge candidates included in the merge list, the merge candidate to be used as motion information of the current block is selected and merge index information for identifying the selected candidate is generated. The generated merge index information is encoded by the entropy encoding unit (155) and transmitted to the video decoding device.
[0057] Merge Skip mode is a special case of merge mode. After quantization, when all transform coefficients for entropy encoding are close to zero, only neighboring block selection information is transmitted without transmitting residual signals. By utilizing merge skip mode, relatively high encoding efficiency can be achieved for low-motion images, still images, and screen content images.
[0058] Hereinafter, merge mode and merge skip mode are collectively referred to as merge / skip mode.
[0059] Another method for encoding motion information is Advanced Motion Vector Prediction (AMVP) mode.
[0060] In AMVP mode, the inter prediction unit (124) derives predicted motion vector candidates for the motion vector of the current block using neighboring blocks of the current block. As neighboring blocks used to derive predicted motion vector candidates, all or some of the left block (A0), the lower left block (A1), the upper block (B0), the upper right block (B1), and the upper left block (B2) adjacent to the current block in the current picture as shown in FIG. 4 may be used. In addition, a block located in a reference picture (which may or may not be the same as the reference picture used to predict the current block) other than the current picture in which the current block is located may be used as the neighboring block used to derive predicted motion vector candidates. For example, a block co-located with the current block in the reference picture or blocks adjacent to the block in the co-located block may be used. If the number of motion vector candidates is less than a preset number by the method described above, a 0 vector is added to the motion vector candidates.
[0061] The inter prediction unit (124) derives predicted motion vector candidates using the motion vectors of these surrounding blocks, and determines a predicted motion vector for the motion vector of the current block using the predicted motion vector candidates. Then, the predicted motion vector is subtracted from the motion vector of the current block to produce a differential motion vector.
[0062] The predicted motion vector can be obtained by applying a predefined function (e.g., median, mean, etc.) to the predicted motion vector candidates. In this case, the image decoding device also knows the predefined function. In addition, since the surrounding blocks used to derive the predicted motion vector candidates are blocks that have already been encoded and decoded, the image decoding device also already knows the motion vectors of the surrounding blocks. Therefore, the image encoding device does not need to encode information to identify the predicted motion vector candidates. Therefore, in this case, information about the differential motion vector and information about the reference picture used to predict the current block are encoded.
[0063] Alternatively, the predicted motion vector can be determined by selecting one of the predicted motion vector candidates. In this case, information for identifying the selected predicted motion vector candidate is additionally encoded, along with information about the differential motion vector and the reference picture used to predict the current block.
[0064] The subtractor (130) subtracts the prediction block generated by the intra prediction unit (122) or inter prediction unit (124) from the current block to generate a residual block.
[0065] The transformation unit (140) transforms residual signals within a residual block having pixel values in a spatial domain into transform coefficients in a frequency domain. The transformation unit (140) may transform the residual signals within the residual block using the entire size of the residual block as a transformation unit, or may divide the residual block into a plurality of sub-blocks and use the sub-blocks as transformation units to perform the transformation. Alternatively, the residual signals may be transformed using only the transformation domain sub-block as a transformation unit by dividing the sub-blocks into two sub-blocks, that is, a transformation domain and a non-transform domain. Here, the transformation domain sub-block may be one of two rectangular blocks having a size ratio of 1:1 with respect to the horizontal axis (or vertical axis). In this case, a flag (cu_sbt_flag) indicating that only a sub-block has been converted, directionality (vertical / horizontal) information (cu_sbt_horizontal_flag), and / or position information (cu_sbt_pos_flag) are encoded by the entropy encoding unit (155) and signaled to the image decoding device. In addition, the size of the conversion area sub-block may have a size ratio of 1:3 with respect to the horizontal axis (or vertical axis), and in this case, a flag (cu_sbt_quad_flag) distinguishing the corresponding division is additionally encoded by the entropy encoding unit (155) and signaled to the image decoding device.
[0066] Meanwhile, the transformation unit (140) can individually perform transformations on the residual block in the horizontal and vertical directions. For the transformation, various types of transformation functions or transformation matrices can be used. For example, a pair of transformation functions for horizontal transformation and vertical transformation can be defined as a Multiple Transform Set (MTS). The transformation unit (140) can select one transformation function pair with the best transformation efficiency among the MTS and transform the residual block in the horizontal and vertical directions, respectively. Information (mts_idx) on the transformation function pair selected among the MTS is encoded by the entropy encoding unit (155) and signaled to the image decoding device.
[0067] The quantization unit (145) quantizes the transform coefficients output from the transform unit (140) using quantization parameters and outputs the quantized transform coefficients to the entropy encoding unit (155). The quantization unit (145) may directly quantize a related residual block without transformation for a certain block or frame. The quantization unit (145) may also apply different quantization coefficients (scaling values) according to the positions of the transform coefficients within the transform block. The quantization matrix applied to the quantized transform coefficients arranged in two dimensions may be encoded and signaled to an image decoding device.
[0068] The rearrangement unit (150) can perform rearrangement of coefficient values for quantized residual values.
[0069] The reordering unit (150) can change a two-dimensional coefficient array into a one-dimensional coefficient sequence by using coefficient scanning. For example, the reordering unit (150) can output a one-dimensional coefficient sequence by scanning from the DC coefficient to the coefficients of the high-frequency region by using a zig-zag scan or a diagonal scan. Depending on the size of the transformation unit and the intra prediction mode, a vertical scan that scans the two-dimensional coefficient array in the column direction or a horizontal scan that scans the two-dimensional block-shaped coefficients in the row direction may be used instead of the zig-zag scan. That is, depending on the size of the transformation unit and the intra prediction mode, the scanning method to be used may be determined among the zig-zag scan, the diagonal scan, the vertical scan, and the horizontal scan.
[0070] The entropy encoding unit (155) generates a bitstream by encoding a sequence of one-dimensional quantized transform coefficients output from the rearrangement unit (150) using various encoding methods such as CABAC (Context-based Adaptive Binary Arithmetic Code) and Exponential Golomb.
[0071] In addition, the entropy encoding unit (155) encodes information related to block division, such as CTU size, CU division flag, QT division flag, MTT division type, and MTT division direction, so that the image decoding device can divide the block in the same manner as the image encoding device. In addition, the entropy encoding unit (155) encodes information about a prediction type indicating whether the current block is encoded by intra prediction or inter prediction, and encodes intra prediction information (i.e., information about an intra prediction mode) or inter prediction information (information about an encoding mode of motion information (merge mode or AMVP mode), a merge index in the case of a merge mode, and a reference picture index and a differential motion vector in the case of an AMVP mode) according to the prediction type. In addition, the entropy encoding unit (155) encodes information related to quantization, that is, information about a quantization parameter and information about a quantization matrix.
[0072] The inverse quantization unit (160) inversely quantizes the quantized transform coefficients output from the quantization unit (145) to generate transform coefficients. The inverse transform unit (165) transforms the transform coefficients output from the inverse quantization unit (160) from the frequency domain to the spatial domain to restore the residual block.
[0073] An adder (170) adds the restored residual block and the predicted block generated by the prediction unit (120) to restore the current block. The pixels within the restored current block are used as reference pixels when intra-predicting the next block.
[0074] The loop filter unit (180) performs filtering on restored pixels to reduce blocking artifacts, ringing artifacts, blurring artifacts, etc. that occur due to block-based prediction and transformation / quantization. The loop filter unit (180) may include all or part of a deblocking filter (182), a sample adaptive offset (SAO) filter (184), and an adaptive loop filter (ALF, 186) as an in-loop filter.
[0075] The deblocking filter (182) filters the boundaries between restored blocks to remove blocking artifacts caused by block-based encoding / decoding, and the SAO filter (184) and the ALF (186) perform additional filtering on the deblocking-filtered image. The SAO filter (184) and the ALF (186) are filters used to compensate for the differences between restored pixels and original pixels caused by lossy coding. The SAO filter (184) improves not only subjective image quality but also encoding efficiency by applying an offset in units of CTUs. In contrast, the ALF (186) performs block-based filtering, and compensates for distortion by applying different filters by distinguishing the edges and degrees of variation of the corresponding block. Information on filter coefficients to be used in the ALF can be encoded and signaled to an image decoding device.
[0076] The restored blocks filtered through the deblocking filter (182), SAO filter (184), and ALF (186) are stored in the memory (190). When all blocks within a picture are restored, the restored picture can be used as a reference picture for inter-predicting blocks within a picture to be encoded later.
[0077] The video encoding device can store the bitstream of encoded video data on a non-transitory storage medium or transmit it to the video decoding device using a communication network.
[0078] FIG. 5 is an exemplary block diagram of an image decoding device capable of implementing the techniques of the present disclosure. Hereinafter, the image decoding device and its subcomponents will be described with reference to FIG. 5.
[0079] The video decoding device may be configured to include an entropy decoding unit (510), a rearrangement unit (515), an inverse quantization unit (520), an inverse transformation unit (530), a prediction unit (540), an adder (550), a loop filter unit (560), and a memory (570).
[0080] Similar to the video encoding device of FIG. 1, each component of the video decoding device may be implemented in hardware, software, or a combination of hardware and software. Furthermore, the functions of each component may be implemented in software, with a microprocessor executing the software functions corresponding to each component.
[0081] The entropy decoding unit (510) decodes the bitstream generated by the image encoding device to extract information related to block division, thereby determining the current block to be decoded, and extracts prediction information, information on residual signals, etc. required to restore the current block.
[0082] The entropy decoding unit (510) extracts information about the CTU size from the Sequence Parameter Set (SPS) or the Picture Parameter Set (PPS), determines the size of the CTU, and divides the picture into CTUs of the determined size. Then, the CTU is determined as the top layer of the tree structure, i.e., the root node, and the CTU is divided using the tree structure by extracting division information about the CTU.
[0083] For example, when splitting a CTU using the QTBTTT structure, first, the first flag (QT_split_flag) related to the splitting of QT is extracted, and each node is split into four nodes of the lower layer. Then, for the nodes corresponding to the leaf nodes of QT, the second flag (mtt_split_flag) related to the splitting of MTT and the split direction (vertical / horizontal) and / or split type (binary / ternary) information are extracted, and the corresponding leaf nodes are split into the MTT structure. Accordingly, each node below the leaf nodes of QT are split recursively into the BT or TT structure.
[0084] As another example, when splitting a CTU using the QTBTTT structure, the CU split flag (split_cu_flag) indicating whether the CU is split is first extracted, and if the block is split, the first flag (QT_split_flag) may be extracted. During the splitting process, each node may undergo zero or more repeated QT splits followed by zero or more repeated MTT splits. For example, a CTU may undergo an MTT split right away, or conversely, may undergo only multiple QT splits.
[0085] As another example, when splitting a CTU using the QTBT structure, the first flag (QT_split_flag) related to the splitting of QT is extracted, and each node is split into four nodes of the lower layer. Furthermore, for nodes corresponding to leaf nodes of QT, a split flag (split_flag) indicating whether to further split into BTs and splitting direction information are extracted.
[0086] Meanwhile, when the entropy decoding unit (510) determines the current block to be decoded by using the division of the tree structure, it extracts information on the prediction type indicating whether the current block is intra-predicted or inter-predicted. If the prediction type information indicates intra-prediction, the entropy decoding unit (510) extracts syntax elements for intra-prediction information (intra-prediction mode) of the current block. If the prediction type information indicates inter-prediction, the entropy decoding unit (510) extracts syntax elements for inter-prediction information, i.e., information indicating a motion vector and a reference picture referenced by the motion vector.
[0087] Additionally, the entropy decoding unit (510) extracts information about the quantized transform coefficients of the current block as information related to quantization and information about residual signals.
[0088] The rearrangement unit (515) can change the sequence of one-dimensional quantized transform coefficients entropy-decoded in the entropy decoding unit (510) back into a two-dimensional coefficient array (i.e., block) in the reverse order of the coefficient scanning performed by the image encoding device.
[0089] The inverse quantization unit (520) inversely quantizes the quantized transform coefficients and inversely quantizes the quantized transform coefficients using the quantization parameters. The inverse quantization unit (520) may also apply different quantization coefficients (scaling values) to the quantized transform coefficients arranged in two dimensions. The inverse quantization unit (520) may perform inverse quantization by applying a matrix of quantized coefficients (scaling values) from an image encoding device to a two-dimensional array of quantized transform coefficients.
[0090] The inverse transform unit (530) inversely transforms the inverse quantized transform coefficients from the frequency domain to the spatial domain to restore residual signals, thereby generating a residual block for the current block.
[0091] In addition, when the inverse transform unit (530) inversely transforms only a portion of a transform block (sub-block), it extracts a flag (cu_sbt_flag) indicating that only a sub-block of the transform block has been transformed, directionality (vertical / horizontal) information (cu_sbt_horizontal_flag) of the sub-block, and / or position information (cu_sbt_pos_flag) of the sub-block, and inversely transforms the transform coefficients of the corresponding sub-block from the frequency domain to the spatial domain to restore residual signals, and fills “0” values with residual signals for areas that have not been inversely transformed, thereby generating a final residual block for the current block.
[0092] In addition, when MTS is applied, the inverse transform unit (530) determines a transform function or a transform matrix to be applied in the horizontal and vertical directions using MTS information (mts_idx) signaled from the image encoding device, and performs inverse transform on the transform coefficients within the transform block in the horizontal and vertical directions using the determined transform function.
[0093] The prediction unit (540) may include an intra prediction unit (542) and an inter prediction unit (544). The intra prediction unit (542) is activated when the prediction type of the current block is intra prediction, and the inter prediction unit (544) is activated when the prediction type of the current block is inter prediction.
[0094] The intra prediction unit (542) determines the intra prediction mode of the current block among a plurality of intra prediction modes from the syntax elements for the intra prediction mode extracted from the entropy decoding unit (510), and predicts the current block using reference pixels around the current block according to the intra prediction mode.
[0095] The inter prediction unit (544) uses the syntax elements for the inter prediction mode extracted from the entropy decoding unit (510) to determine the motion vector of the current block and the reference picture referenced by the motion vector, and predicts the current block using the motion vector and the reference picture.
[0096] An adder (550) adds the residual block output from the inverse transform unit (530) and the predicted block output from the inter prediction unit (544) or the intra prediction unit (542) to restore the current block. The pixels within the restored current block are used as reference pixels when intra-predicting a block to be decoded later.
[0097] The loop filter unit (560) may include a deblocking filter (562), an SAO filter (564), and an ALF (566) as in-loop filters. The deblocking filter (562) deblocks the boundaries between restored blocks to remove blocking artifacts caused by block-by-block decoding. The SAO filter (564) and the ALF (566) perform additional filtering on restored blocks after deblocking filtering to compensate for differences between restored pixels and original pixels caused by lossy coding. The filter coefficients of the ALF are determined using information about filter coefficients decoded from the non-stream.
[0098] The restored blocks filtered through the deblocking filter (562), SAO filter (564), and ALF (566) are stored in the memory (570). When all blocks within a picture are restored, the restored picture is used as a reference picture for inter-predicting blocks within a picture to be encoded later.
[0099]
[0100] The present embodiment relates to encoding and decoding of images (video) as described above. More specifically, the present invention provides a video coding method and device that selectively utilizes syntax to construct a bitstream by considering predefined coding information, optimizable coding information, and input image information.
[0101] The following embodiments may be performed by components within a video encoding apparatus. They may also be performed by components within a video decoding apparatus.
[0102] The video encoding device can generate signaling information related to the present embodiment in terms of rate distortion optimization in encoding the current block. The video encoding device can encode the signaling information using the entropy encoding unit (155) and then transmit it to the video decoding device. The video decoding device can decode the signaling information related to the decoding of the current block from the bitstream using the entropy decoding unit (510).
[0103] In the following description, the term "target block" may be used interchangeably with the current block or coding unit (CU). Alternatively, the term "target block" may also refer to a portion of a coding unit.
[0104] Also, a value of a flag being true indicates that the flag is set to 1. Also, a value of a flag being false indicates that the flag is set to 0.
[0105] I. Syntax in VVC (Versatile Video Coding)
[0106] Existing video encoding and decoding devices encode or decode video using a single syntax that constitutes a bitstream, regardless of individual images, encoding conditions, etc. As shown in Table 1, the use of a single syntax results in the transmission of numerous flags indicating whether coding tools are to be used. Furthermore, numerous conditional statements exist during the bitstream parsing process based on flag values, resulting in frequent branching.
[0107]
[0108]
[0109]
[0110]
[0111]
[0112]
[0113]
[0114]
[0115] However, as described above, using a single syntax to construct a bitstream regardless of individual images and encoding / decoding conditions to encode / decode video has the following inefficient aspects.
[0116] First, encoding performance may degrade due to the transmission of unnecessary flags, indices, etc. Because video characteristics can vary, a single, pre-designed syntax may not be optimal for the video. For example, when encoding a video by activating screen content coding tools, flags indicating whether each tool is used and related information are signaled. In this case, these flags are signaled for areas within the video where no screen content exists at all, which is inefficient from an encoding / decoding perspective.
[0117] Second, inefficiencies arise from the use of branches (if statements) when decoding the syntax that composes the bitstream. Frequent branching can lead to issues such as instruction cache misses, pipeline delays, and branch prediction failures.
[0118] II. Implementation examples and embodiments according to the present disclosure
[0119] FIG. 8 is an exemplary diagram illustrating an image decoding device using syntax selection information according to one embodiment of the present disclosure.
[0120] The problem of the existing technology described above can be solved by providing multiple syntaxes and selecting one of the provided syntaxes, as in the example of Fig. 8.
[0121] In the implementation illustrated in Fig. 8, the video encoding device and the video decoding device can use an optimized syntax for various cases by having multiple syntaxes and then selecting one of them. In the example of Fig. 8, a syntax selector indicates syntax selection information. The video encoding device configures a syntax corresponding to the syntax selection information into a bitstream and then transmits the bitstream to the video decoding device. As in the example of Fig. 8, the video decoding device decodes the corresponding syntax using a bitstream parser corresponding to the syntax selection information.
[0122] As an example implementation, when not handling encoding / decoding for screen content, the intra encoding / decoding and related syntax for the luma channel can be configured as in Table 2.
[0123]
[0124]
[0125] As another implementation example, if conditional comparisons for block information are eliminated by obtaining information about the sizes of all blocks in advance, the syntax parsing complexity can be reduced as shown in Table 3.
[0126]
[0127]
[0128]
[0129]
[0130]
[0131]
[0132] Compared to Table 1, conditional comparisons for block information are removed from the italicized parts in Table 3.
[0133] As another implementation example, after reducing the restoration quality of the area to be encoded, a syntax can be configured as in Table 4 by not using various coding tools during encoding / decoding.
[0134]
[0135]
[0136]
[0137] Compared to the existing method of controlling whether to use coding on a per-image basis, this method of controlling whether to use coding tools on a per-CU / CTU / CTU row / tile / slice / picture basis is more efficient.
[0138] The coding unit syntax has been described as an example of the syntax that constitutes various bitstreams according to the present disclosure. However, the present disclosure can also be applied to other syntaxes, such as those illustrated in FIG. 7.
[0139] The following embodiments for application of the present disclosure are described with a focus on an image decoding device, but can be implemented identically or similarly in an image encoding device.
[0140] <Example 1> Adaptively selecting syntax by referring to various information
[0141] In this implementation example, the video decoding device selects a syntax for composing a bitstream by referring to various pieces of information.
[0142] FIG. 9 is an exemplary diagram illustrating the operation of a syntax selector according to one embodiment of the present disclosure.
[0143] As shown in the example of Fig. 9, the video decoding device derives syntax selection information for constructing an optimal bitstream based on various pieces of information, and then performs video decoding according to the derived syntax selection information. In the example of Fig. 9, the syntax selector represents syntax selection information. In some embodiments, the syntax selection information is also expressed as a syntax selector that indicates a syntax for constructing an optimal bitstream. In addition, the syntax selector indicates a bitstream parser used for parsing the syntax for constructing the optimal bitstream.
[0144] The information used to derive syntax selection information is classified into three types as follows:
[0145] The first type of information is predefined coding information. Predefined coding information is not information selected from among multiple cases during image encoding, but rather represents coding information in a predefined format. Predefined coding information includes the following:
[0146] Quantization parameter (QP)
[0147] Current component - Y, Cb, Cr, R, G, B, geometry, depth, occupancy, etc.
[0148] Current channel - luma, chroma, geometry, depth, occupancy, etc.
[0149] Coding configuration - all intra, random access, low-delay B, low-delay P, etc.
[0150] Picture / Subpicture / Slice / Tile Information (I / B / P)
[0151] GOP (Group of Pictures) information - size, location, properties, intra-prediction interval, current position within GOP, etc.
[0152] Slice / Tile / CTU - Size, Position, Attributes, etc.
[0153] Reference picture information - number of reference pictures, type of reference picture (I / P / B), quality of reference picture, etc.
[0154] Enabled coding tools - in-loop filters, prediction tools, transformation tools, quantization tools, etc.
[0155] Block scan order - raster scan order, reverse scan order, vertical scan order, etc.
[0156] Target decoder resources - display window size, battery consumption, memory consumption, bandwidth, etc.
[0157] The second type of information is optimizable coding information. Optimizable coding information refers to the form of information that can be selected to achieve the highest coding efficiency during image encoding. Typically, optimal coding information represents information selected based on a rate-distortion optimization process and includes the following:
[0158] Prediction type of the current block - inter, intra, machine learning-based, screen content, etc.
[0159] Predicted type ratio in current area
[0160] partitioning structure
[0161] Block size - maximum, minimum, average, 'maximum-minimum', mean absolute differences, standard deviation, etc.
[0162] Block aspect ratio - maximum, minimum, average, 'max-min', average absolute difference, standard deviation, etc.
[0163] boundary located - top, bottom, left, right, etc.
[0164] Here, 'boundary located' indicates whether the block to be decoded is adjacent to the boundary of a picture / tile / slice. This information may vary depending on the block partitioning, and is therefore included in the optimal possible encoding information.
[0165] The third piece of information is input video information. Input video information describes the characteristics of the input video and includes the following:
[0166] Content type - natural, screen, volumetric, point cloud, depth, 3D, geometric, lenslet, multiview, multiplane, etc.
[0167] Camera - Light Field, Plenoptic 1.0, Plenoptic 2.0, 360 o , fisheye, stereo, camera array, multi spectral, high dynamic range, etc.
[0168] Spatial resolution - width × height, temporal resolution - frame rate, bit resolution - bit depth, color resolution - chroma sub-sampling (e.g., 444, 422, 420, 411, 400, etc.)
[0169] Color formats - YCbCr, YCgCo, RGB, GBR, HSL, HSV, etc.
[0170] Motion - global motion, local motion, camera motion, etc.
[0171] Lighting (illumination_) - global lighting, local lighting, etc.
[0172] Image processing - gamma correction, gamma value, white balancing, balancing temperature, tone mapping, tone mapping method / curve, adaptive color transform, etc.
[0173] Meanwhile, conventional techniques such as VVC simultaneously parse the syntax of a coding unit during the process of parsing block partition information, as illustrated in the example of Fig. 10. Therefore, it is structurally impossible for conventional techniques to select an optimal coding unit syntax by referring to information such as the prediction type ratio, block size, and partitioning structure presented in this implementation example. Here, the syntax of a coding unit includes information dependent on the coding unit, such as the generation method of a prediction block, the transformation method, and residual signals.
[0174] Therefore, in the present disclosure, the video decoding device separates the process of parsing block segmentation information and the process of parsing coding unit syntax, as in the example of FIG. 11. That is, after acquiring all segmentation information, the video decoding device can refer to syntax information according to segmentation.
[0175] For example, according to the prior art, when parsing CU syntaxes 4 to 18 as in the example of FIG. 12a, since not all of the partition information of blocks within a CTU exists, the video decoding device cannot refer to information such as the average block size, min / max block size, etc. However, according to the present disclosure, when parsing CU syntaxes 13 to 20 as in the example of FIG. 12b, since all of the partition information of blocks within a CTU exists, the video decoding device can refer to the corresponding information.
[0176] <Example 2> Selecting a syntax for constructing a bitstream using explicit signals
[0177] In this implementation example, instead of referring to various pieces of information, the video decoding device parses syntax selection information constituting the bitstream, i.e., syntax indexes, and then selects syntax constituting the optimal bitstream using the parsed syntax indexes. At this time, the syntax index indicating the syntax constituting the optimal bitstream is transmitted by the video encoding device while being included in the bitstream. The video decoding device parses the syntax indexes from the bitstream without any additional information. The video decoding device decodes the syntax constituting the optimal bitstream using a bitstream parser according to the parsed syntax index. In Implementation Example 1, the video decoding device derives syntax selection information by itself, but in this implementation example, the syntax selection information is transmitted from the video encoding device to the video decoding device.
[0178] In this implementation example, as in Implementation Example 1, a method of separating the process of parsing block segmentation information and the process of parsing CU syntax can also be applied. That is, based on syntax selection information, the video decoding device can parse block segmentation information and then parse CU syntax by referring to the parsed block segmentation information.
[0179] <Example 2-1> Using out-of-band signaling
[0180] In this implementation example, the video decoding device pre-parses the syntax selection information constituting the bitstream at a higher level, rather than parsing it at the level where the syntax is parsed, as in the example of Fig. 13. For example, the video decoding device pre-parses the CU syntax selection information at the picture / slice / tile / CTU row / CTU level. When parsing the CU syntax, the video decoding device decodes the corresponding CU syntax based on the bitstream parser according to the pre-parsed information.
[0181] In addition to parsing the CU syntax, for other syntaxes exemplified in FIG. 7, the image decoding device can first parse syntax selection information at a higher level and then apply the pre-parsed information when parsing the syntax.
[0182] <Example 2-2> Using in-band signaling
[0183] In this implementation, the video decoding device parses the syntax selection information constituting the bitstream at the level of parsing the syntax, as in the example of Fig. 14. For example, when parsing the CU syntax, the video decoding device parses the CU syntax selection information immediately before parsing the CU syntax. The video decoding device decodes the corresponding CU syntax based on the bitstream parser according to the syntax selection information.
[0184] Hereinafter, a method of composing / parsing a bitstream according to syntax selection information is described using the cities of FIGS. 15 and 16.
[0185] FIG. 15 is a flowchart illustrating a method for an image encoding device to encode a current block according to one embodiment of the present disclosure.
[0186] The image encoding device encodes the current block to generate encoding information (S1500).
[0187] The video encoding device obtains syntax selection information of the current block (S1502).
[0188] As an example, a video encoding device obtains predefined encoding information, optimal possible encoding information, or input video information as information for derivation. The video encoding device implicitly derives syntax selection information by referring to the information for derivation.
[0189] Additionally, if the information for derivation is block division information, the image encoding device can generate encoding information of the current block by referring to the block division information. Here, the block division information indicates an average block size, a minimum block size, or a maximum block size.
[0190] As another example, if syntax selection information is determined at a higher level, the video encoding device explicitly uses the syntax selection information determined at the higher level as the syntax selection information for the current block. The syntax selection information at the higher level can be determined from the perspective of rate distortion optimization.
[0191] As another example, a video encoding device explicitly determines syntax selection information after generating encoding information for the current block. At this time, the syntax selection information can be determined in terms of rate distortion optimization.
[0192] The video encoding device selects a bitstream configurator using syntax selection information (S1504).
[0193] The video encoding device configures the bitstream using a bitstream constructor so that the bitstream includes the syntax of the current block corresponding to the syntax selection information among the encoding information of the current block (S1506).
[0194] If syntax selection information is implicitly derived, the video encoding device refers to the information for derivation to construct a bitstream. For example, if the information for derivation is block segmentation information, the video encoding device can construct a bitstream containing the syntax of the current block by referring to the block segmentation information. In this case, the video encoding device can construct the bitstream to include the block segmentation information.
[0195] On the other hand, if the syntax selection information is explicitly determined, the video encoding device encodes the syntax selection information and includes the encoded syntax selection information in the bitstream. Thereafter, the video encoding device transmits the configured bitstream to the video decoding device.
[0196] FIG. 16 is a flowchart illustrating a method by which an image decoding device decodes a current block according to one embodiment of the present disclosure.
[0197] The video decoding device obtains syntax selection information of the current block (S1600).
[0198] As an example, a video decoding device obtains predefined encoding information, optimal possible encoding information, or input video information as information for derivation. The video decoding device implicitly derives syntax selection information by referring to the information for derivation.
[0199] As another example, the video decoding device explicitly uses the syntax selection information parsed at a higher level as the syntax selection information of the current block.
[0200] As another example, immediately before parsing the bitstream, the video decoding device explicitly parses the syntax selection information of the current block.
[0201] The video decoding device selects a bitstream parser using syntax selection information (S1602).
[0202] The video decoding device generates decoding information of the current block by parsing the bitstream using a bitstream parser (S1604). Here, the bitstream includes the syntax of the current block corresponding to the syntax selection information.
[0203] If syntax selection information is implicitly derived, the video decoding device refers to the derivation information to parse the bitstream. For example, if the derivation information is block segmentation information, the video decoding device can refer to the block segmentation information to parse the syntax of the current block. In this case, the block segmentation information indicates the average block size, the minimum block size, or the maximum block size.
[0204] If syntax selection information is explicitly parsed, the video decoding device can decode the syntax of the current block by referring to the block division information after parsing the block division information.
[0205] The video decryption device restores the current block using the decryption information (S1606).
[0206] Although the flowchart / timing diagram of this specification describes each process as being executed sequentially, this is merely an illustrative description of the technical idea of one embodiment of the present disclosure. In other words, a person of ordinary skill in the art to which one embodiment of the present disclosure belongs may modify and apply various modifications and variations by changing the order described in the flowchart / timing diagram without departing from the essential characteristics of one embodiment of the present disclosure, or by executing one or more of the processes in parallel. Therefore, the flowchart / timing diagram is not limited to a chronological order.
[0207] It should be understood that the exemplary embodiments described above can be implemented in many different ways. The functions or methods described in one or more examples can be implemented in hardware, software, firmware, or any combination thereof. It should be understood that the functional components described herein are labeled as "units" to further emphasize their implementation independence.
[0208] Meanwhile, the various functions or methods described in this embodiment may also be implemented as instructions stored on a non-transitory storage medium that can be read and executed by one or more processors. Non-transitory storage media include, for example, all types of storage devices that store data in a form readable by a computer system. For example, non-transitory storage media include storage media such as erasable programmable read-only memory (EPROM), flash drives, optical drives, magnetic hard drives, and solid-state drives (SSDs).
[0209] The above description is merely an example of the technical idea of the present embodiment, and those skilled in the art will appreciate that various modifications and variations can be made without departing from the essential characteristics of the present embodiment. Therefore, the present embodiments are not intended to limit the technical idea of the present embodiment, but rather to explain it, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of the present embodiment should be interpreted by the claims below, and all technical ideas within a scope equivalent thereto should be interpreted as being included in the scope of rights of the present embodiment.
[0210] (Explanation of symbols)
[0211] 155: Entropy encoding unit
[0212] 510: Entropy decryption unit
[0213]
[0214] CROSS-REFERENCE TO RELATED APPLICATION
[0215] This patent application claims priority to Korean patent application No. 10-2023-0063331, filed in Korea on May 16, 2023, and Korean patent application No. 10-2024-0044159, filed in Korea on April 1, 2024, the entire contents of which are incorporated herein by reference.
Claims
1. A method for restoring a current block performed by a video decoding device, A step of obtaining syntax selection information of the current block; A step of selecting a bitstream parser using the above syntax selection information; A step of generating decryption information of the current block by parsing a bitstream using the bitstream parser, wherein the bitstream includes syntax of the current block corresponding to the syntax selection information; and A step of restoring the current block using the above decryption information. A method, characterized by including:
2. In paragraph 1, The step of obtaining the above syntax selection information is: A method characterized in that syntax selection information parsed at a higher level is used as syntax selection information of the current block.
3. In paragraph 1, The step of obtaining the above syntax selection information is: A method characterized by parsing the syntax selection information immediately before parsing the bitstream.
4. In paragraph 3, Further comprising a step of parsing block segmentation information from the above bitstream, The step of generating decryption information for the current block above is: A method characterized by decoding the syntax of the current block by referring to the block division information.
5. In paragraph 4, The above block division information is, A method characterized by having an average block size, a minimum block size, or a maximum block size.
6. In paragraph 1, The step of obtaining the above syntax selection information is: A step of obtaining pre-defined coding information, optimizable coding information, or input video information as information for derivation; and A step of deriving the syntax selection information by referring to the information for the above derivation. A method, characterized by including:
7. In paragraph 6, The step of generating decryption information for the current block above is: A method characterized by referring to the information for derivation for parsing the bitstream.
8. In paragraph 6, The step of generating decryption information for the current block above is: A method characterized in that, when the information for the above derivation is block division information, the syntax of the current block is decoded by referring to the block division information.
9. A method for encoding a current block performed by a video encoding device, A step of generating encoding information by encoding the current block above; A step of obtaining syntax selection information of the current block; A step of selecting a bitstream configurator using the above syntax selection information; and A step of configuring the bitstream using the bitstream constructor so that the bitstream includes the syntax of the current block corresponding to the syntax selection information among the encoding information of the current block. A method, characterized by including:
10. In paragraph 9, The step of obtaining the above syntax selection information is: A method characterized in that, when the syntax selection information is determined at a higher level, the syntax selection information determined at the higher level is used as the syntax selection information of the current block.
11. In paragraph 9, The step of obtaining the above syntax selection information is: A method characterized in that after generating the above encoding information, the syntax selection information is determined.
12. In paragraph 11, A method, characterized in that it further comprises a step of encoding the syntax selection information.
13. In paragraph 11, Further comprising a step of generating the above block division information, The step of generating the encoding information of the current block above is: A method characterized by generating encoding information of the current block by referring to the block division information.
14. In paragraph 13, The steps of configuring the above bitstream are: A method characterized in that the bitstream is configured to additionally include the block division information.
15. In paragraph 9, The step of obtaining the above syntax selection information is: A step of obtaining pre-defined coding information, optimizable coding information, or input video information as information for derivation; and A step of deriving the syntax selection information by referring to the information for the above derivation. A method, characterized by including:
16. In paragraph 15, The steps of configuring the above bitstream are: A method characterized by referring to the information for derivation to configure the bitstream.
17. In paragraph 15, The steps of configuring the above bitstream are: A method characterized in that, when the information for the above derivation is block division information, a bitstream including the syntax of the current block is configured by referring to the block division information.
18. A computer-readable recording medium storing a bitstream generated by an image encoding method, wherein the image encoding method comprises: A step of generating encoding information by encoding the current block, A step of obtaining syntax selection information of the current block; A step of selecting a bitstream configurator using the above syntax selection information; and A step of configuring the bitstream using the bitstream constructor so that the bitstream includes the syntax of the current block corresponding to the syntax selection information among the encoding information of the current block. A recording medium, characterized by including:
Citation Information
Patent Citations
Method and apparatus to transmite the block-partiton information for codec of CCTV camera
KR1020180021942A
Video decoder techniques
US20150117536A1
Parallel video parsing for video decoder processing
US20230081975A1
Synchronous, multi-stream decoder
US8514949B1
File format concepts for video coding
WO2021198488A1
