Decoding equipment, encoding equipment and data transmission equipment

By parsing and processing high-level syntax flags in video decoding devices, the inefficiency problem in existing technologies is solved, achieving efficient image/video compression and encoding. Separating configuration file, layer and level information from general constraint information improves encoding efficiency.

CN123123587APending Publication Date: 2026-11-17LG ELECTRONICS INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611499567.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2020-06-04
Filing Date
2021-06-03
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing technologies are inefficient in high-resolution, high-quality image/video coding, cannot effectively handle advanced syntax, and cannot skip the parsing of general constraint information.

Method used

By parsing the flags in the general constraint information in the video decoding device, the constraint information is parsed based on the flags, and prediction information is generated in the encoding device, and the configuration file, layer and level information are processed separately from the general constraint information.

Benefits of technology

It improves image/video compression efficiency, efficiently signals general constraint information, skips the parsing of general constraint information, and enhances coding efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123123587A_ABST
    Figure CN123123587A_ABST
Patent Text Reader

Abstract

This disclosure provides a decoding device, an encoding device, and a data transmission device. A video decoding method performed by a video decoding device according to this document includes the following steps: obtaining general constraint information from a bitstream; parsing from the bitstream a flag indicating whether the general constraint information includes information about constraints conforming to an output layer set; parsing information about the constraints in the general constraint information based on the flag; and decoding a current image based on the information about the constraints, wherein the general constraint information includes number information and alignment information about the constraints, and within the general constraint information, the alignment information may exist after the number information.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the original invention patent application No. 202180059146.1 (International Application No.: PCT / KR2021 / 006904, Application Date: June 3, 2021, Invention Title: Method and Apparatus for Processing High-Level Syntax in Image / Video Coding Systems). Technical Field

[0002] This technology relates to methods and apparatus for processing advanced syntax in the context of encoding / decoding image / video information in an image / video coding system. Background Technology

[0003] Recently, there has been an increasing demand for high-resolution, high-quality images / videos (such as 4K, 8K, or even Ultra High Definition (UHD) images / videos) across various fields. As image / video resolution or quality increases, more information or bits are transmitted compared to traditional image / video data. Therefore, transmitting and storing image / video data via media such as existing wired / wireless broadband lines or stored in traditional storage media increases transmission and storage costs.

[0004] Furthermore, there is growing interest and demand for virtual reality (VR) and artificial reality (AR) content, as well as immersive media such as holograms; and the broadcasting of images / videos that present characteristics different from those of actual images / videos, such as game images / videos, is also on the rise.

[0005] Therefore, efficient image / video compression technology is needed to effectively compress and send, store, or play high-resolution, high-quality images / videos exhibiting the various characteristics described above. Summary of the Invention

[0006] Technical issues

[0007] One of the technical topics of this article is to provide methods and devices for improving the coding efficiency of images / videos.

[0008] Another technical topic of this paper is to provide methods and devices for efficiently processing high-level syntaxes when encoding images / videos.

[0009] Another technical subject of this paper is to provide methods and devices for skipping the parsing of general constraint information when processing high-level grammars.

[0010] Another technical subject of this paper is to provide methods and apparatus for separating configuration file, layer, and level information from general constraint information when processing high-level syntax.

[0011] Technical solution

[0012] According to one embodiment of this document, a video decoding method performed by a video decoding device may include the following steps: obtaining general constraint information from a bitstream; parsing from the bitstream a flag indicating whether information about constraints conforming to an output layer set exists in the general constraint information; parsing information about the constraints from the general constraint information based on the flag; and decoding a current image based on the information about the constraints, wherein the general constraint information includes number information and alignment information about the constraints, and wherein the alignment information exists after the number information in the general constraint information.

[0013] According to another embodiment of this document, a video encoding method performed by a video encoding device may include the following steps: performing inter-frame prediction or intra-frame prediction on a current block in a current image; generating prediction information for the current block based on the inter-frame prediction or intra-frame prediction; and encoding image information including the prediction information, wherein the image information includes a flag indicating whether information about constraints conforming to the output layer set exists in general constraint information of the image information, wherein the general constraint information includes number information and alignment information about the constraints, and wherein the alignment information exists after the number information in the general constraint information.

[0014] According to another embodiment of this document, a computer-readable digital storage medium includes information that causes a video decoding device to perform a video decoding method, wherein the video decoding method may include the following steps: obtaining general constraint information from image information; parsing from the image information a flag indicating whether information about constraints conforming to an output layer set exists in the general constraint information; parsing information about the constraints from the general constraint information based on the flag; and decoding a current image based on the information about the constraints, wherein the general constraint information includes number information and alignment information about the constraints, and wherein the alignment information exists after the number information in the general constraint information.

[0015] Technical effect

[0016] According to the implementation method described herein, the overall image / video compression efficiency can be enhanced.

[0017] According to the embodiments described herein, when signaling image / video information, general constraint information can be signaled efficiently.

[0018] According to the implementation method described herein, when processing advanced syntax, the parsing of general constraint information can be skipped.

[0019] According to the implementation method described herein, when processing advanced syntax, configuration file, layer, and level information can be processed separately from general constraint information. Attached Figure Description

[0020] Figure 1 An example of a video / image coding system to which the embodiments applicable herein are illustrated is shown schematically.

[0021] Figure 2 This is a diagram schematically illustrating the configuration of a video / image encoding apparatus to which the embodiments described herein apply.

[0022] Figure 3 This is a schematic illustration of the configuration of a video / image decoding device applicable to the embodiments described herein.

[0023] Figure 4 An example of an illustrative image decoding process applicable to the embodiments described herein is shown.

[0024] Figure 5 An example of an illustrative image encoding process applicable to the embodiments described herein is shown.

[0025] Figure 6 An example of a layered structure for encoded images / videos is shown.

[0026] Figure 7 and Figure 8 Examples of video / image encoding methods and related components according to embodiments of this document are illustrated schematically.

[0027] Figure 9 and Figure 10 Examples of video / image decoding methods and related components according to embodiments of this document are illustrated schematically.

[0028] Figure 11 An example of a content streaming system to which the embodiments disclosed herein are applied is shown. Detailed Implementation

[0029] The disclosure herein may be modified in various forms, and specific embodiments thereof will be described and illustrated in the accompanying drawings. The terminology used herein is for describing particular embodiments only and is not intended to limit the methods disclosed herein. Expressions of a single number include the expression "at least one," provided that it is clearly read differently. Terms such as "comprising" and "having" are intended to indicate the presence of features, numbers, steps, operations, elements, components, or combinations thereof used in the disclosure, and therefore should be understood that the possibility of having or adding one or more different features, numbers, steps, operations, elements, components, or combinations thereof is not excluded.

[0030] Furthermore, the various configurations in the accompanying drawings described herein are independent illustrative diagrams used to explain the functions that are different features from each other, and do not imply that the various configurations are implemented by different hardware or different software. For example, two or more configurations in a configuration may be combined to form a single configuration, and a single configuration may also be divided into multiple configurations. Implementations that combine and / or separate configurations are included within the scope of this disclosure without departing from the spirit of the methods disclosed herein.

[0031] In this document, the terms “ / ” and “,” should be interpreted as indicating “and / or”. For example, the expression “A / B” can mean “A and / or B”. Furthermore, “A, B” can mean “A and / or B”. Additionally, “A / B / C” can mean “at least one of A, B, and / or C”. Furthermore, “A / B / C” can mean “at least one of A, B, and / or C”.

[0032] Furthermore, in this document, the term "or" should be interpreted as indicating "and / or". For example, the expression "A or B" can include: 1) only A, 2) only B, and / or 3) both A and B. In other words, the term "or" in this document should be interpreted as indicating "additionally or alternatively".

[0033] Furthermore, the parentheses used herein may mean "for example". Specifically, when referring to "prediction (intra-frame prediction)", it may mean that "intra-frame prediction" is presented as an example of "prediction". In other words, the term "prediction" in this document is not limited to "intra-frame prediction", and "intra-frame prediction" is presented as an example of "prediction". Moreover, even when referring to "prediction (i.e., intra-frame prediction)", it may mean that "intra-frame prediction" is presented as an example of "prediction".

[0034] In this document, technical features may be implemented individually or simultaneously and explained individually in a single figure.

[0035] In the following, embodiments described herein will be described in detail with reference to the accompanying drawings. Furthermore, throughout the drawings, the same reference numerals are used to indicate the same elements, and identical descriptions of the same elements may be omitted.

[0036] This document relates to video / image coding. For example, the methods / implementations disclosed herein can be applied to methods disclosed in the Universal Video Coding (VVC) standard. Additionally, the methods / implementations disclosed herein can be applied to methods disclosed in the Basic Video Coding (EVC) standard, the AOMedia Video 1 (AV1) standard, the second-generation Audio Video Coding Standard (AVS2), or next-generation video / image coding standards (e.g., H.267, H.268, etc.).

[0037] Various implementations related to video / image coding are presented herein, and these implementations may be combined with each other unless otherwise stated.

[0038] Figure 1 Examples of video / image coding systems to which the embodiments applicable herein are illustrated are provided.

[0039] Reference Figure 1 A video / image encoding system may include a first device (source device) and a second device (receiving device). The source device may send encoded video / image information or data to the receiving device in the form of a file or stream via a digital storage medium or network.

[0040] The source device may include a video source, an encoding device, and a transmitter. The receiving device may include a receiver, a decoding device, and a renderer. The encoding device may be referred to as a video / image encoding device, and the decoding device may be referred to as a video / image decoding device. The transmitter may be included in the encoding device. The receiver may be included in the decoding device. The renderer may include a display, and the display may be configured as a separate device or an external component.

[0041] Video sources can acquire video / images through processes that capture, synthesize, or generate video / images. Video sources may include video / image capture devices and / or video / image generation devices. Video / image capture devices may include, for example, one or more cameras, video / image archives including previously captured video / images, etc. Video / image generation devices may include, for example, computers, tablets, and smartphones, and can generate video / images (electronically). For example, virtual video / images can be generated by computers, etc. In this case, the video / image capture process can be replaced by a process that generates related data.

[0042] Encoding devices can encode input video / images. They can perform a series of processes such as prediction, transformation, and quantization to achieve compression and encoding efficiency. The encoded data (encoded video / image information) can be output as a bitstream.

[0043] The transmitter can send encoded images / image information or data, output in bitstream form, to the receiver of the receiving device in the form of a file or stream via digital storage media or a network. Digital storage media can include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, SSD, etc. The transmitter can include elements for generating media files according to a predetermined file format and may include elements for transmission via a broadcast / communication network. The receiver can receive / extract the bitstream and send the received bitstream to a decoding device.

[0044] Decoding devices can decode video / images by performing a series of processes such as inverse quantization, inverse transform, and prediction, which correspond to the operations of encoding devices.

[0045] The renderer can render decoded video / images. The rendered video / images can then be displayed on a monitor.

[0046] In this document, video can refer to a series of images over time. An image generally refers to a unit representing an image at a specific time frame, and a slice / tile refers to a unit that constitutes part of an image in terms of coding. A slice / tile may include one or more Code Tree Units (CTUs). An image may consist of one or more slices / tiles. An image may consist of one or more groups of tiles. A group of tiles may include one or more tiles. A tile can represent a rectangular area of ​​a row of CTUs within a tile in an image. A tile can be divided into multiple tiles, each of which consists of one or more rows of CTUs within the tile. A tile that is not divided into multiple tiles can also be referred to as a tile. A tile scan is a specific ordering of the CTUs that divide an image, where CTUs are ordered consecutively in a CTU raster scan within a tile, tiles within a tile are ordered consecutively in a raster scan of tiles within tiles, and tiles in an image are ordered consecutively in a raster scan of tiles within an image. A tile is a rectangular area of ​​a CTU within a specific tile column and a specific tile row in an image. A tile column is a rectangular region of multiple CTUs with a height equal to the height of the image and a width specified by a syntax element in the image parameter set. A tile scan is a specific ordering of the CTUs that segment the image, where the CTUs are ordered consecutively in a raster scan of the CTUs within a tile, and the tiles within an image are ordered consecutively in a raster scan of the tiles within the image. A slice comprises an integer number of tiles of an image that can be proprietaryly included in a single NAL unit. A slice can consist of a consecutive sequence of multiple complete tiles or only complete tiles of a single tile. In this document, tile groups and slices are used interchangeably. For example, in this document, a tile group / tile group header can be referred to as a slice / slice header.

[0047] A pixel, or image unit, can refer to the smallest unit that makes up a picture (or image). Additionally, the term "sample" can be used as the counterpart to a pixel. A sample can typically represent a pixel or a pixel value, and can represent only the pixel / pixel value of the luminance component or only the pixel / pixel value of the chrominance component.

[0048] A unit can represent a basic unit of image processing. A unit may include a specific region of an image and at least one of the information associated with that region. A unit may include a luminance block and two chrominance (e.g., cb, cr) blocks. In some cases, the terms "unit" and "block" or "region" may be used interchangeably. Typically, an M×N block may include a set (or array) of samples (or sample arrays) or transform coefficients in M ​​columns and N rows. Alternatively, samples may represent pixel values ​​in the spatial domain, and when such pixel values ​​are transformed to the frequency domain, they may represent transform coefficients in the frequency domain.

[0049] In some cases, a unit can be used interchangeably with terms such as a block or region. Typically, an M×N block can represent a sample consisting of M columns and N rows or a set of transformation coefficients. A sample can typically represent a pixel or pixel value, and can also represent only the pixel / pixel value of the luminance component, and only the pixel / pixel value of the chrominance component. A sample can be used as an item corresponding to the pixels or picometers of a picture (or image).

[0050] Figure 2 This is a schematic diagram illustrating the configuration of a video / image encoding apparatus to which embodiments applicable herein are applied. Hereinafter, a video encoding apparatus may include an image encoding apparatus.

[0051] Reference Figure 2 The encoding device 200 may include and be configured with an image segmenter 210, a predictor 220, a residual processor 230, an entropy encoder 240, an adder 250, a filter 260, and a memory 270. The predictor 220 may include an inter-frame predictor 221 and an intra-frame predictor 222. The residual processor 230 may include a transformer 232, a quantizer 233, an inverse quantizer 234, and an inverse transformer 235. The residual processor 230 may also include a subtractor 231. The adder 250 may be referred to as a reconstructor or a reconstruction block generator. According to embodiments, the image segmenter 210, predictor 220, residual processor 230, entropy encoder 240, adder 250, and filter 260 described above may be constituted by at least one hardware component (e.g., an encoder chipset or a processor). Additionally, the memory 270 may include a decoded image buffer (DPB) or may be constituted by a digital storage medium. The hardware component may also include the memory 270 as an internal / external component.

[0052] Image segmenter 210 can segment an input image (or picture or frame) input to encoding device 200 into one or more processing units. For example, a processing unit may be referred to as a coding unit (CU). In this case, the coding unit can be recursively segmented from a coding tree unit (CTU) or a maximum coding unit (LCU) according to a quadtree-binary-tritree (QTBTTT) structure. For example, a coding unit can be segmented into multiple deeper coding units based on a quadtree structure, a binary tree structure, and / or a ternary tree structure. In this case, for example, a quadtree structure can be applied first, followed by a binary tree structure and / or a ternary tree structure. Alternatively, a binary tree structure can be applied first. The encoding process according to this document can be performed based on the final coding unit that is no longer segmented. In this case, the maximum coding unit can be used as the final coding unit based on encoding efficiency according to image characteristics, or, if necessary, the coding unit can be recursively segmented into deeper coding units, and the coding unit with the optimal size can be used as the final coding unit. Here, the encoding process may include prediction, transformation, and reconstruction processes, which will be described later. As another example, the processing unit may also include a prediction unit (PU) or a transform unit (TU). In this case, the prediction unit and the transform unit can be separated or divided from the final encoding unit described above. The prediction unit may be a unit for predicting samples, and the transform unit may be a unit for deriving transform coefficients and / or a unit for deriving residual signals from transform coefficients.

[0053] In encoding device 200, a prediction signal (prediction block, prediction sample array) output from inter-frame predictor 221 or intra-frame predictor 222 can be subtracted from the input image signal (original block, original sample array) to generate a residual signal (residual block, residual sample array), and the generated residual signal is sent to converter 232. In this case, as shown, the unit in encoding device 200 used to subtract the prediction signal (prediction block, prediction sample array) from the input image signal (original block, original sample array) can be called subtractor 231. Predictor 220 can perform prediction on the block to be processed (hereinafter referred to as the current block) and generate a prediction block including the prediction samples of the current block. The predictor can determine whether to apply intra-frame prediction or inter-frame prediction on a unit of the current block or CU. As described later in the description of each prediction mode, predictor 220 can generate various information related to the prediction, such as prediction mode information, and send the generated information to entropy encoder 240. The information about the prediction can be encoded in entropy encoder 240 and output as a bitstream.

[0054] Intra-predictor 222 can predict the current block by referencing samples in the current image. Depending on the prediction mode, the referenced samples can be located near or far from the current block. In intra-prediction, the prediction mode can include multiple non-directional modes and multiple directional modes. Non-directional modes can include, for example, DC mode and planar mode. Depending on the level of detail in the prediction direction, the directional modes can include, for example, 33 or 65 directional prediction modes. However, this is just an example, and more or fewer directional prediction modes can be used depending on the settings. Intra-predictor 222 can also determine the prediction mode to be applied to the current block by using prediction modes applied to neighboring blocks.

[0055] Inter-frame predictor 221 can deduce the predicted block of the current block based on a reference block (reference sample array) specified by motion vectors on a reference image. Here, to reduce the amount of motion information transmitted in inter-frame prediction mode, motion information can be predicted on a block, sub-block, or sample basis based on the correlation between motion information between neighboring blocks and the current block. Motion information may include motion vectors and reference image indices. Motion information may also include inter-frame prediction direction (L0 prediction, L1 prediction, Bi prediction, etc.) information. In the case of inter-frame prediction, neighboring blocks may include spatially neighboring blocks existing in the current image and temporally neighboring blocks existing in the reference image. The reference image including the reference block and the reference image including the temporally neighboring block may be the same or different. The temporally neighboring block may be called a juxtaposed reference block, a co-located CU (colCU), etc., and the reference image including the temporally neighboring block may be called a juxtaposed image (colPic). For example, inter-frame predictor 221 can configure a motion information candidate list based on neighboring blocks and generate information indicating which candidate to use to deduce the motion vector and / or reference image index of the current block. Inter-frame prediction can be performed based on various prediction modes. For example, in skip mode and merge mode, the inter-frame predictor 221 can use motion information from neighboring blocks as motion information for the current block. In skip mode, unlike merge mode, residual signals may not be sent. In motion vector prediction (MVP) mode, the motion vector of the current block can be indicated by using motion vectors from neighboring blocks as motion vector predictors and signaling the motion vector difference.

[0056] Predictor 220 can generate prediction signals based on various prediction methods described below. For example, predictor 220 can not only apply intra-frame prediction or inter-frame prediction to predict a block, but can also apply both intra-frame prediction and inter-frame prediction simultaneously. This can be called Inter-Frame Intra-Frame Combined Prediction (CIIP). Alternatively, the predictor can predict blocks based on an intra-block copy (IBC) prediction mode or a palette mode. IBC prediction mode or palette mode can be used for image / video coding of content such as games, for example, Screen Content Coding (SCC). IBC essentially performs prediction in the current image, but can be performed similarly to inter-frame prediction because the reference block is derived in the current image. That is, IBC can use at least one of the inter-frame prediction techniques described herein. Palette mode can be considered as an example of intra-frame coding or intra-frame prediction. When applying palette mode, sample values ​​within the image can be signaled based on information about the palette table and palette index.

[0057] The predicted signal generated by the predictor (including inter-frame predictor 221 and / or intra-frame predictor 222) can be used to generate the reconstructed signal or the residual signal.

[0058] Transformer 232 can generate transform coefficients by applying transform techniques to the residual signal. For example, the transform techniques may include at least one of Discrete Cosine Transform (DCT), Discrete Sine Transform (DST), Graph-Based Transform (GBT), or Conditional Nonlinear Transform (CNT). Here, GBT refers to the transform obtained from a graph when the relationship information between pixels is represented by a graph. CNT refers to the transform generated based on a prediction signal generated using all previously reconstructed pixels. Furthermore, the transform processing can be applied to square pixel blocks of the same size, or it can be applied to blocks of variable size that are not square.

[0059] Quantizer 233 quantizes the transform coefficients and sends them to entropy encoder 240, which encodes the quantized signal (information about the quantized transform coefficients) and outputs a bitstream. This information about the quantized transform coefficients can be called residual information. Quantizer 233 can rearrange the block-form quantized transform coefficients into a one-dimensional vector based on the coefficient scan order, and generate information about the quantized transform coefficients based on this one-dimensional vector form.

[0060] The entropy encoder 240 can perform various encoding methods, such as exponential Golomb, context-adaptive variable-length coding (CAVLC), and context-adaptive binary arithmetic coding (CABAC). The entropy encoder 240 can encode information required for video / image reconstruction (e.g., values ​​of syntax elements, etc.) together or separately, except for the quantization transform coefficients. It can transmit or store encoded information (e.g., encoded video / image information) in the form of a bitstream at NAL (Network Abstraction Layer) units. The video / image information may also include information about various parameter sets such as Adaptive Parameter Set (APS), Picture Parameter Set (PPS), Sequence Parameter Set (SPS), or Video Parameter Set (VPS). Additionally, the video / image information may include general constraint information. In this document, information and / or syntax elements that are sent / signaled from the encoding device to the decoding device may be included in the video / image information. The video / image information can be encoded through the above encoding process and included in the bitstream. The bitstream can be transmitted over a network or stored in a digital storage medium. The network may include a broadcast network and / or a communication network, and the digital storage medium may include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, and SSD. A transmitting unit (not shown) for transmitting signals output from the entropy encoder 240 and / or a storage unit (not shown) for storing the signals may be included as internal / external components of the encoding device 200, and alternatively, the transmitter may be included in the entropy encoder 240.

[0061] The quantization transform coefficients output from quantizer 233 can be used to generate a prediction signal. For example, the residual signal (residual block or residual sample) can be reconstructed by applying inverse quantization and inverse transform to the quantization transform coefficients using inverse quantizer 234 and inverse transformer 235. Adder 250 adds the reconstructed residual signal to the prediction signal output from inter-frame predictor 221 or intra-frame predictor 222 to generate a reconstructed signal (reconstructed image, reconstructed block, reconstructed sample array). If the block to be processed has no residual (such as when a skip mode is applied), the prediction block can be used as a reconstructed block. Adder 250 can be referred to as a reconstruction unit or reconstructed block generator. The generated reconstructed signal can be used for intra-frame prediction of the next block to be processed in the current image, and can be used for inter-frame prediction of the next image by filtering as described below.

[0062] In addition, Luminance Mapping and Chroma Scaling (LMCS) can be applied during image encoding and / or reconstruction processing.

[0063] Filter 260 can improve subjective / objective image quality by applying filtering to the reconstructed signal. For example, filter 260 can generate a modified reconstructed image by applying various filtering methods to the reconstructed image and store the modified reconstructed image in memory 270 (specifically, the DPB of memory 270). Various filtering methods may include, for example, deblocking filtering, sample adaptive offset, adaptive loop filtering, bilateral filtering, etc. Filter 260 can generate various filtering-related information and send the generated information to entropy encoder 240, as described later in the description of the various filtering methods. The filtering-related information can be encoded by entropy encoder 240 and output as a bitstream.

[0064] The modified reconstructed image sent to memory 270 can be used as a reference image in inter-frame predictor 221. When inter-frame prediction is applied through the encoding device, prediction mismatch between the encoding device 200 and the decoding device can be avoided, and encoding efficiency can be improved.

[0065] The DPB of memory 270 can store a modified reconstructed image used as a reference image in inter-frame predictor 221. Memory 270 can store motion information of blocks from which motion information in the current image is derived (or encoded) and / or motion information of reconstructed blocks in the image. The stored motion information can be sent to inter-frame predictor 221 and used as motion information for spatially or temporally neighboring blocks. Memory 270 can store reconstructed samples of reconstructed blocks in the current image and can transmit these reconstructed samples to intra-frame predictor 222.

[0066] Furthermore, image / video coding according to this disclosure can include multi-layer image / video coding. Multi-layer image / video coding can include scalable coding. Multi-layer coding or scalable coding can process input signals from individual layers. The input signals (input images / pictures) can vary depending on the layers in at least one of resolution, frame rate, bit depth, color format, aspect ratio, and view. In this case, redundant transmission / processing of information can be reduced and compression efficiency improved by performing prediction between layers using the differences between layers (i.e., based on scalability).

[0067] Figure 3 This is a diagram illustrating the configuration of a video / image decoding device applicable to the embodiments described herein.

[0068] Reference Figure 3The decoding device 300 may include and be configured with an entropy decoder 310, a residual processor 320, a predictor 330, an adder 340, a filter 350, and a memory 360. The predictor 330 may include an inter-frame predictor 332 and an intra-frame predictor 331. The residual processor 320 may include an inverse quantizer 321 and an inverse transformer 322. According to embodiments, the entropy decoder 310, residual processor 320, predictor 330, adder 340, and filter 350 described above may be constructed from hardware components (e.g., a decoder chipset or processor). Additionally, the memory 360 may include a decoded image buffer (DPB) or may be constructed from a digital storage medium. The hardware components may also include the memory 360 as an internal / external component.

[0069] When the input includes a bitstream containing video / image information, the decoding device 300 can interact with... Figure 2 The processing of video / image information in the encoding device correspondingly reconstructs the image. For example, the decoding device 300 can deduce units / blocks based on block segmentation information obtained from the bitstream. The decoding device 300 can perform decoding using processing units applied in the encoding device. Therefore, the decoding processing unit can be, for example, an encoding unit, and the encoding unit can be segmented from encoding tree units or maximum encoding units according to a quadtree structure, binary tree structure, and / or ternary tree structure. One or more transform units can be derived from the encoding unit. The reconstructed image signal decoded and output by the decoding device 300 can be reproduced by a reproduction device.

[0070] Decoding device 300 can receive data in bitstream form from... Figure 2The signal output by the encoding device can be decoded by the entropy decoder 310. For example, the entropy decoder 310 can parse the bitstream to derive the information (e.g., video / image information) required for image reconstruction (or picture reconstruction). The video / image information may also include information about various parameter sets such as Adaptive Parameter Set (APS), Picture Parameter Set (PPS), Sequence Parameter Set (SPS), or Video Parameter Set (VPS). In addition, the video / image information may also include general constraint information. The decoding device can also decode the picture based on the information about the parameter sets and / or general constraint information. The signaling / receiving information and / or syntax elements described later herein can be decoded and obtained from the bitstream through the decoding process. For example, the entropy decoder 310 decodes the information in the bitstream based on encoding methods such as Exponential Golomb coding, Context Adaptive Variable Length Coding (CAVLC), or Context Adaptive Arithmetic Coding (CABAC) and outputs the quantized values ​​of the syntax elements and transform coefficients of the residuals required for image reconstruction. More specifically, the CABAC entropy decoding method can receive a bin corresponding to each syntax element in the bitstream, determine the context model using information about the target syntax element, decoding information about the target block, or information about symbols / bins decoded in previous stages, and perform arithmetic decoding on the bin by predicting the occurrence probability of the bin based on the determined context model, generating a symbol corresponding to the value of each syntax element. In this case, after determining the context model, the CABAC entropy decoding method can update the context model by using information from the decoded symbol / bin for the context model of the next symbol / bin. The prediction-related information from the information decoded by the entropy decoder 310 can be provided to the predictors (inter-frame predictor 332 and intra-frame predictor 331), and the residual values ​​(i.e., quantization transform coefficients and related parameter information) from which entropy decoding has been performed in the entropy decoder 310 can be input to the residual processor 320.

[0071] The residual processor 320 can derive residual signals (residual blocks, residual samples, residual sample arrays). Additionally, filtering information from the information decoded by the entropy decoder 310 can be provided to the filter 350. Furthermore, a receiving unit (not shown) for receiving signals output from the encoding device can be further configured as an internal / external component of the decoding device 300, or the receiving unit can be a component of the entropy decoder 310. Furthermore, the decoding device according to this document can be referred to as a video / image / picture decoding device, and the decoding device can be classified as an information decoder (video / image / picture information decoder) and a sample decoder (video / image / picture sample decoder). The information decoder may include the entropy decoder 310, and the sample decoder may include at least one of an inverse quantizer 321, an inverse transformer 322, an adder 340, a filter 350, a memory 360, an inter-frame predictor 332, and an intra-frame predictor 331.

[0072] The dequantizer 321 can dequantize the quantized transform coefficients and output the transform coefficients. The dequantizer 321 can rearrange the quantized transform coefficients in the form of two-dimensional blocks. In this case, the rearrangement can be performed based on the coefficient scan order executed in the encoding device. The dequantizer 321 can perform dequantization on the quantized transform coefficients using quantization parameters (e.g., quantization step size information) and obtain the transform coefficients.

[0073] The inverse transformer 322 performs an inverse transformation on the transformation coefficients to obtain the residual signal (residual block, residual sample array).

[0074] In this paper, at least one of quantization / dequantization and / or transform / inverse transform may be omitted. When quantization / dequantization is omitted, the quantization transform coefficients may be referred to as transform coefficients. When transform / inverse transform is omitted, the transform coefficients may be referred to as coefficients or residual coefficients, or for consistency, they may still be referred to as transform coefficients.

[0075] In this paper, quantization transform coefficients and transform coefficients can be referred to as transform coefficients and scaling transform coefficients, respectively. In this case, residual information can include information about the transform coefficients, and this information can be transmitted as a signal using residual coding syntax. Transform coefficients can be derived based on the residual information (or information about the transform coefficients), and scaling transform coefficients can be derived through the inverse transform (scaling) of the transform coefficients. Residual samples can be derived based on the inverse transform (scaling) of the scaling transform coefficients. This can also be applied / expressed in other parts of this paper.

[0076] Predictor 330 can perform prediction on the current block and generate a prediction block that includes prediction samples of the current block. The predictor can determine whether to apply intra-frame prediction or inter-frame prediction to the current block based on the prediction information output from entropy decoder 310, and can determine the specific intra-frame / inter-frame prediction mode.

[0077] Predictor 330 can generate prediction signals based on various prediction methods described below. For example, the predictor can not only apply intra-frame prediction or inter-frame prediction to predict a block, but can also apply intra-frame prediction and inter-frame prediction simultaneously. This can be referred to as combined intra-frame and inter-frame prediction (CIIP). Alternatively, the predictor can predict blocks based on an intra-block copy (IBC) prediction mode or a palette mode. IBC prediction mode or palette mode can be used for content image / video coding such as games, for example, Screen Content Coding (SCC). IBC essentially performs prediction in the current image, but can be performed similarly to inter-frame prediction because a reference block is derived in the current image. That is, IBC can use at least one of the inter-frame prediction techniques described herein. Palette mode can be considered as an example of intra-frame coding or intra-frame prediction. When applying palette mode, sample values ​​within the image can be signaled based on information about the palette table and palette index.

[0078] Intra-predictor 331 can predict the current block by referencing samples in the current image. Depending on the prediction mode, the referenced samples may be located near or far from the current block. In intra-prediction, the prediction mode can include multiple non-directional modes and multiple directional modes. Intra-predictor 331 can determine the prediction mode applied to the current block by using prediction modes applied to neighboring blocks.

[0079] Inter-frame predictor 332 can deduce the predicted block of the current block based on a reference block (reference sample array) specified by a motion vector on a reference image. In this case, to reduce the amount of motion information transmitted in the inter-frame prediction mode, motion information can be predicted on a block, sub-block, or sample basis based on the correlation of motion information between neighboring blocks and the current block. Motion information may include motion vectors and reference image indices. Motion information may also include inter-frame prediction direction (L0 prediction, L1 prediction, Bi prediction, etc.) information. In the case of inter-frame prediction, neighboring blocks may include spatially neighboring blocks existing in the current image and temporally neighboring blocks existing in the reference image. For example, inter-frame predictor 332 can configure a motion information candidate list based on neighboring blocks and deduce the motion vector and / or reference image index of the current block based on the received candidate selection information. Inter-frame prediction can be performed based on various prediction modes, and the information about the prediction may include information indicating the mode of inter-frame prediction for the current block.

[0080] Adder 340 can generate a reconstruction signal (reconstructed image, reconstruction block, reconstruction sample array) by adding the obtained residual signal to the prediction signal (prediction block, prediction sample array) output from the predictor (including inter-frame predictor 332 and / or intra-frame predictor 331). If the block to be processed has no residual (e.g., when a skip mode is applied), the prediction block can be used as the reconstruction block.

[0081] Adder 340 can be called a reconstructor or reconstruction block generator. The generated reconstructed signal can be used for intra-frame prediction of the next block to be processed in the current image, or it can be filtered and output as described below, or it can be used for inter-frame prediction of the next image.

[0082] In addition, Luminance Mapping and Chromaticity Scaling (LMCS) can be applied in image decoding processing.

[0083] Filter 350 can improve subjective / objective image quality by applying filtering to the reconstructed signal. For example, filter 350 can generate a modified reconstructed image by applying various filtering methods to the reconstructed image and store the modified reconstructed image in memory 360 (specifically, the DPB of memory 360). Various filtering methods may include, for example, deblocking filtering, sample adaptive shifting, adaptive loop filtering, bilateral filtering, etc.

[0084] The (modified) reconstructed image stored in the DPB of memory 360 can be used as a reference image in inter-frame predictor 332. Memory 360 can store motion information of blocks from which motion information in the current image is derived (or decoded) and / or motion information of reconstructed blocks in the image. The stored motion information can be sent to inter-frame predictor 332 for use as motion information of spatially or temporally neighboring blocks. Memory 360 can store reconstructed samples of reconstructed blocks in the current image and can transmit the reconstructed samples to intra-frame predictor 331.

[0085] In this document, the implementation described in the filter 260, inter-frame predictor 221 and intra-frame predictor 222 of the encoding device 200 may be the same as or correspond to the filter 350, inter-frame predictor 332 and intra-frame predictor 331.

[0086] Figure 4 An example of an illustrative image decoding process to which the embodiments described herein can be applied is shown.

[0087] In image / video coding, images / video pictures can be encoded / decoded according to the decoding order. The image order, corresponding to the output order of the decoded images, can be configured differently from the decoding order. Furthermore, when performing inter-frame prediction based on the configured image order, both forward and backward prediction can be performed.

[0088] exist Figure 4 In China, the S400 can be composed of the above-mentioned components. Figure 3 The entropy decoder 310 of the decoding device described herein executes step S410, which may be executed by the predictor 330, step S420 by the residual processor 320, step S430 by the adder 340, and step S440 by the filter 350. Step S400 may include the information decoding process described herein, step S410 may include the inter-frame / intra-frame prediction process described herein, step S420 may include the residual processing process described herein, step S430 may include the block / image reconstruction process described herein, and step S440 may include the loop filtering process described herein.

[0089] Reference Figure 4 For example, Figure 3 The image decoding process indicated in the description can schematically include (through decoding) an image / video information acquisition process from the bitstream (S400), an image reconstruction process (S410 to S430), and a loop filtering process for the reconstructed image (S440). The image reconstruction process can be performed based on prediction samples and residual samples obtained through inter-frame / intra-frame prediction (S410) and residual processing (inverse quantization and inverse transform of the quantization transform coefficients) (S420) as described herein. For the reconstructed image generated by the image reconstruction process, a modified reconstructed image can be generated through the loop filtering process, and the modified reconstructed image can be output as a decoded image and can also be stored in the decoded image buffer or memory 360 of the decoding device for use as a reference image in the inter-frame prediction process after image decoding. In some cases, the loop filtering process can be skipped, and in this case, the reconstructed image can be output as a decoded image and can also be stored in the decoded image buffer or memory 360 of the decoding device for use as a reference image in the inter-frame prediction process after image decoding. As described above, the loop filtering process (S440) may include a deblocking filtering process, a sample adaptive offset (SAO) process, an adaptive loop filter (ALF) process, and / or a bilateral filtering process, and some or all of these processes may be skipped. Alternatively, one or more of the deblocking filtering process, the sample adaptive offset (SAO) process, the adaptive loop filter (ALF) process, and / or the bilateral filter process may be applied sequentially, or all of the processes may be applied sequentially. For example, the SAO process may be performed after the deblocking filtering process is applied to the reconstructed image. Similarly, the ALF process may be performed after the deblocking filtering process is applied to the reconstructed image. This can be performed in the same manner even in an encoding device.

[0090] Figure 5 An example of an illustrative image encoding process applicable to the embodiments described herein is given.

[0091] exist Figure 5 In China, the S500 can be composed of the components described above. Figure 2 The predictor 220 of the coding apparatus described herein executes S510, which may be executed by the residual processor 230, and S520 may be executed by the entropy encoder 240. S500 may include the inter-frame / intra-frame prediction process described herein, S510 may include the residual processing process described herein, and S520 may include the information encoding process described herein.

[0092] Reference Figure 5 As mentioned above Figure 2 As described above, the image encoding process typically includes encoding information for image reconstruction (e.g., prediction information, residual information, segmentation information, etc.) and outputting the encoded information as a bitstream, as well as generating a reconstructed image for the current image and optionally applying loop filtering to the reconstructed image. The encoding device can derive residual samples (which are modified) from the quantized transform coefficients using the dequantizer 234 and the inverse transform 235, and then the encoding device can generate a reconstructed image based on the prediction samples as the output of S700 and the (modified) residual samples. The reconstructed image generated as described above can be the same as the reconstructed image generated in the decoding device. A modified reconstructed image can be generated by performing a loop filtering process on the reconstructed image, and the modified reconstructed image is then stored in the decoding image buffer or memory 270 of the decoding device. Furthermore, as in the decoding device, the modified reconstructed image can be used as a reference image during the inter-frame prediction process when encoding the image. As described above, in some cases, part or all of the loop filtering process can be skipped. When performing the loop filtering process, the (loop) filtering-related information (parameters) can be encoded in the entropy encoder 240 and then sent in the form of a bit stream, and the decoding device can perform the loop filtering process based on the filtering-related information by using the same method as the encoding device.

[0093] By performing the aforementioned loop filtering process, noise (such as occlusion artifacts and ringing artifacts) occurring during image / moving image encoding can be reduced, and subjective / objective visual quality can be enhanced. Furthermore, by having both the encoding and decoding devices perform the loop filtering process, they can obtain the same prediction results, increasing the reliability of image encoding and reducing the size (or amount) of data to be sent for image encoding.

[0094] As described above, the image reconstruction process can be performed in both the decoding and encoding devices. Reconstructed blocks can be generated for each block unit based on intra-frame prediction / inter-frame prediction, and a reconstructed image including these blocks can be generated. When the current image / slice / tile group is an I-type image / slice / tile group, the blocks included in the current image / slice / tile group can be reconstructed only based on intra-frame prediction. Furthermore, when the current image / slice / tile group is a P-type or B-type image / slice / tile group, the blocks included in the current image / slice / tile group can be reconstructed based on either intra-frame prediction or inter-frame prediction. In this case, inter-frame prediction can be applied to portions of the blocks within the current image / slice / tile group, and intra-frame prediction can be applied to the remaining blocks. The color components of the image can include both luma and chroma components. And, unless expressly limited (or constrained) in this specification, the methods and implementations described herein can be applied to both luma and chroma components.

[0095] Figure 6 An example of a layered structure for encoded images / videos is shown.

[0096] Reference Figure 6 The encoded image / video is divided into a VCL (Video Coding Layer) responsible for the image / video decoding process and itself, a subsystem for sending and storing encoded information, and a Network Abstraction Layer (NAL) that exists between the VCL and the subsystems and is responsible for network adaptation functions.

[0097] VCL can generate VCL data that includes compressed image data (slice data), or generate parameter sets or additional supplemental enhancement information (SEI) messages required for the image decoding process, such as image parameter sets (image parameter sets: PPS), sequence parameter sets (sequence parameter sets: SPS), and video parameter sets (video parameter sets: VPS).

[0098] In NAL, a NAL cell can be generated by adding header information (NAL cell header) to the raw byte sequence payload (RBSP) generated in VCL. In this case, RBSP refers to slice data, parameter sets, SEI messages, etc., generated in VCL. The NAL cell header may include NAL cell type information, which is specified based on the RBSP data included in the corresponding NAL cell.

[0099] As shown in the figure, NAL units can be divided into VCL NAL units and non-VCL NAL units based on the RBSP generated in VCL. VCL NAL units can refer to NAL units that include information about the image (slice data), while non-VCL NAL units can refer to NAL units that contain information required for decoding the image (parameter set or SEI message).

[0100] The VCL NAL units and non-VCL NAL units described above can be transmitted over a network by attaching header information according to the subsystem's data standard. For example, NAL units can be transformed into predetermined standard data formats (such as H.266 / VVC file format, Real-time Transport Protocol (RTP), Transport Stream (TS), etc.) and transmitted over various networks.

[0101] As described above, in a NAL cell, the NAL cell type can be specified according to the RBSP data structure included in the corresponding NAL cell, and information about the NAL cell type can be stored in the NAL cell header and signaled.

[0102] For example, NAL cells can be broadly classified into VCL NAL cell type and non-VCL NAL cell type depending on whether the NAL cell includes information about the image (slice data). VCL NAL cell type can be classified according to the nature and type of the image included in the VCL NAL cell, while non-VCL NAL cell type can be classified according to the type of parameter set.

[0103] The following is an example of a NAL cell type specified based on the type of the parameter set included in a non-VCL NAL cell type.

[0104] - DCI (Decoding Capability Information) NAL Unit: Includes the type of NAL unit for DCI.

[0105] - VPS (Video Parameter Set) NAL Unit: Includes the type of NAL unit for the VPS.

[0106] - SPS (Sequence Parameter Set) NAL Unit: The type of NAL unit that includes SPS.

[0107] - PPS (Picture Parameter Set) NAL Unit: Includes the type of NAL unit for PPS.

[0108] - APS (Adaptive Parameter Set) NAL Unit: The type of NAL unit including APS.

[0109] - PH (Picture Header) NAL Unit: Types of NAL units including PH.

[0110] The NAL unit type described above has syntax information specific to the NAL unit type, which can be stored in the NAL unit header and signaled. For example, this syntax information can be nal_unit_type, and the NAL unit type can be specified by the nal_unit_type value.

[0111] Furthermore, as described above, an image can include multiple slices, and a slice can include a slice header and slice data. In this case, an image header can be further added to multiple slices within an image (slice header and slice dataset). The image header (image header syntax) can include information / parameters common to the image. The slice header (slice header syntax) can include information / parameters common to the slice. APS (APS syntax) or PPS (PPS syntax) can include information / parameters common to one or more slices or images. SPS (SPS syntax) can include information / parameters common to one or more sequences. VPS (VPS syntax) can include information / parameters common to multiple layers. DCI (DCI syntax) can include information / parameters related to decoding capabilities.

[0112] In this specification, High-Level Syntax (HLS) may include at least one of APS syntax, PPS syntax, SPS syntax, VPS syntax, DCI syntax, image header syntax, and slice header syntax. Furthermore, in this specification, Low-Level Syntax (LLS) may include, for example, slice data syntax, CTU syntax, and transform unit syntax.

[0113] In this specification, the image / video information encoded by the encoding device to the decoding device and subsequently signaled in bitstream format may include not only information related to intra-frame segmentation, intra / inter-frame prediction information, residual information, loop filtering information, etc., but also slice header information, image header information, APS information, PPS information, SPS information, VPS information, and / or DCI information. Furthermore, the image / video information may further include general constraint information and / or NAL unit header information.

[0114] Furthermore, as stated above, the video / image information in this specification may include higher-level signaling, and video / image encoding methods may be performed based on the video / image information.

[0115] The encoded image may include one or more slices. Parameters describing the encoded image can be signaled in the image header, and parameters describing the slices can be signaled in the slice header. The image header (PH) is carried within its own NAL cell type. The slice header exists at the beginning of the NAL cell, which includes the slice payload (slice data).

[0116] Additionally, images can be divided into sub-images, tiles, and / or slices. Signaling for sub-images resides in the SPS, signaling for tiles and rectangular slices resides in the PPS, and finally, signaling for raster scan slices resides in the slice header.

[0117] In addition, signaling for configuration files, layers, and levels can exist in VPS and / or SPS, as shown in Tables 1 and 2 below.

[0118] [Table 1]

[0119] In Table 1, `vps_video_parameter_set_id` provides an identifier for the VPS, which can be referenced in another syntax element. The value of `vps_video_parameter_set_id` should be greater than 0.

[0120] vps_max_layers_minus1+1 represents the maximum number of layers allowed in each encoded video sequence (VCS) of the VPS.

[0121] Increasing 1 in `vps_max_sublayers_minus1` indicates the maximum number of time-limited sublayers that can exist in each CVS layer referencing the VPS. The value of `vps_max_sublayers_minus1` should be in the range of 0 to 6.

[0122] vps_num_ptls_minus1+1 represents the number of profile_tier_level() syntax structures in the VPS. The value of vps_num_ptls_minus1 should be less than TotalNumOlss, which represents the number of all output layer sets (OLS).

[0123] If the value of vps_pt_present_flag[i] is 1, it means that the configuration file, tier, and general constraint information exist in the i-th profile_tier_level() syntax structure in the VPS. If the value of vps_pt_present_flag[i] is 0, it means that the configuration file, tier, and general constraint information do not exist in the i-th profile_tier_level() syntax structure in the VPS.

[0124] The value of vps_pt_present_flag[0] is inferred to be 1. If the value of vps_pt_present_flag[i] is 0, it is inferred that the configuration file, layer, and general constraint information of the i-th profile_tier_level() syntax structure in the VPS are the same as those of the (i-1)-th profile_tier_level() syntax structure in the VPS.

[0125] `vps_ptl_max_temporal_id[i]` represents the TemporalId of the topmost sublayer, and this level information exists in the `i`th `profile_tier_level()` syntax structure in the VPS. The value of `vps_ptl_max_temporal_id[i]` should be in the range of 0 to `vps_max_sublayers_minus1`. If it does not exist, it is inferred that the value of `vps_ptl_max_temporal_id[i]` is the same as the value of `vps_max_sublayers_minus1`.

[0126] The value of vps_ptl_alignment_zero_bit is equal to 0.

[0127] vps_ols_ptl_idx[i] represents the index of the profile_tier_level() syntax structure in the list of profile_tier_level() syntax structures applied to the i-th OLS in the VPS. If it exists, the value of vps_ols_ptl_idx[i] should be in the range of 0 to vps_num_ptls_minus1.

[0128] If it does not exist, the value of vps_ols_ptl_idx[i] is inferred as follows.

[0129] - If the value of vps_num_ptls_minus1 is 0, then the value of vps_ols_ptl_idx[i] is inferred to be 0.

[0130] Otherwise (if the value of vps_num_ptls_minus1 is greater than 0, and vps_num_ptls_minus1+1 equals TotalNumOlss), the value of vps_ols_ptl_idx[i] is inferred to be equal to i.

[0131] If NumLayersInOls[i] is 1, then the profile_tier_level() syntax structure applied to the i-th OLS exists even in the SPS referenced by the layer in the i-th OLS. If NumLayersInOls[i] is 1, then the bitstream compatibility requirement should be that the profile_tier_level() syntax structure signaled in the VPS is the same as that used by the SPS for the i-th OLS.

[0132] Each profile_tier_level() syntax structure in a VPS should be referenced in the range of 0 to TotalNumOlss-1 by at least one value for i.

[0133] [Table 2]

[0134] Referring to Table 2, sps_seq_parameter_set_id provides the identifier for SPS, which can be referenced by other syntax elements.

[0135] SPS NAL units share the same value space as the value space of sps_seq_parameter_set_id, regardless of the value of nuh_layer_id.

[0136] spsLayerId is referred to as the nuh_layer_id value of a specific SPS NAL cell, and vclLayerId is referred to as the nuh_layer_id value of a specific VCL NAL cell. Unless spsLayerId is less than or equal to vclLayerId, a specific VCL NAL cell does not reference that specific SPS NAL cell, and nuh_layer_id even includes layers in the VPS that are specified by the VPS that includes the same layer as vclLayerId, where all OLS have the same nuh_layer_id as spslayerId.

[0137] If the value of sps_video_parameter_set_id is greater than 0, it means that the VPS's vps_video_parameter_set_id value is referenced by SPS.

[0138] If the value of sps_video_parameter_set_id is 0, then the following applies.

[0139] - The SPS does not reference the VPS, and when decoding each coding layer video sequence (CLVS) that references the SPS, the VPS is not referenced.

[0140] The value of -vps_max_layers_minus1 is inferred to be 0.

[0141] The value of -vps_max_sublayers_minus1 is inferred to be 6.

[0142] - CVS should consist of only one layer (i.e., all VCL NAL units in CVS have the same nuh_layer_id value).

[0143] The value of -GeneralLayerIdx[nuh_layer_id] is inferred to be 0.

[0144] The value of -vps_independent_layer_flag[GeneralLayerIdx [nuh_layer_id] is inferred to be 1.

[0145] If the value of vps_independent_layer_flag[GeneralLayerIdx[nuh_layer_id] is 1, then the SPS referenced by the CLVS with a nuhLayerId having a specific nuh_layer_id value should have the same nuh_layer_id as the nuhLayerId.

[0146] In all SPS referenced by CLVS in CVS, the value of sps_video_parameter_set_id should be the same.

[0147] Increasing 1 by 1 to sps_max_sublayers_minus1 indicates the maximum number of time-limited sublayers that can exist in each CLVS referencing SPS. The value of sps_max_sublayers_minus1 should be in the range of 0 to vps_max_sublayers_minus1.

[0148] sps_reserved_zero_4bits equals 0.

[0149] If the value of `sps_ptl_dpb_hrd_params_present_flag` is 1, it indicates that the `profile_tier_level()` and `dpb_parameters()` syntax structures exist in SPS, and the `general_hrd_parameters()` and `ols_hrd_parameters()` syntax structures also exist in SPS. If the value of `sps_ptl_dpb_hrd_params_present_flag` is 0, it indicates that these four syntax structures do not exist in SPS.

[0150] If the value of sps_video_parameter_set_id is greater than 0 and there exists an OLS where nuh_layer_id only includes one layer that is the same as the layer with nuh_layer_id in SPS, or if the value of sps_video_parameter_set_id is 0, then the value of sps_ptl_dpb_hrd_params_present_flag is the same as 1.

[0151] In addition, the syntax structure of PTL (Profile, Layer, Level) information can be as follows.

[0152] [Table 3]

[0153] Referring to Table 3, the profile_tier_level() syntax provides level information and optionally provides configuration file, layer, sub-configuration file and general constraint information.

[0154] If the `profile_tier_level()` syntax structure is included in the VPS, then `OlsInScope` is one or more OLSs specified by the VPS. If the `profile_tier_level()` syntax structure is included in the SPS, then `OlsInScope` only includes the lowest-level OLS among the layers referencing the SPS, and the lowest-level layer is an independent layer.

[0155] general_profile_idc indicates the configuration file that OlsInScope conforms to.

[0156] general_tier_flag represents the layer context used to interpret general_level_idc.

[0157] general_level_idc indicates the level that OlsInScope conforms to.

[0158] As the value of general_level_idc increases, it indicates a higher level. The maximum level for signaling in the DCINAL unit used in OlsInScope can be higher than the level for signaling in the SPS of the CLVS included in OlsInScope, but cannot be lower.

[0159] When OlsInScope conforms to several profiles, general_profile_idc represents the profile determined by the encoding device that provides a preferred bitstream identifier or preferred decoding result.

[0160] When the CVS of OlsInScope conforms to different profiles, several profile_tier_level() syntax structures can be included in the DCI NAL unit, so that there is at least one set of profiles, layers and levels of the decoding device capable of decoding each CVS of OlsInScope.

[0161] num_sub_profiles represents the number of syntax elements in general_sub_profile_idc[i].

[0162] general_sub_profile_idc[i] represents the i-th interoperability metadata.

[0163] If the value of sublayer_level_present_flag[i] is 1, it means that the level information exists in the profile_tier_level() syntax element used to represent the sublayer where TemporalId is i. If the value of sublayer_level_present_flag[i] is 0, it means that the level information does not exist in the profile_tier_level() syntax structure used to represent the sublayer where TemporalId is i.

[0164] The value of ptl_alignment_zero_bits is the same as 0.

[0165] The semantics of the sublayer_level_idc[i] syntax element are the same as those of the general_level_idc syntax element, but it is applied to the representation of the sublayer in which TemporalId is i.

[0166] If it does not exist, the value of sublayer_level_idc[i] is inferred as follows.

[0167] -sublayer_level_idc[maxNumSubLayersMinus1] is inferred to be the same as general_level_idc, which has the same profile_tier_level() structure.

[0168] - In maxNumSubLayersMinus1-1, for i in the range including 0 (in descending order of i values), sublayer_level_idc[i] is inferred to be the same as sublayer_level_idc[i+1].

[0169] For reference, a sublayer can represent a time-scalable layer of a time-scalable bitstream consisting of VCL NAL units with a TemporalId variable having a specific value and associated non-VCL NAL units. A sublayer representation can be a subset of a bitstream consisting of NAL units from a specific sublayer and lower sublayers.

[0170] general_constraint_info() can include the following syntax elements.

[0171] [Table 4]

[0172] Referring to Table 3, the signaling for the level indicator (i.e., `general_level_idc`) follows the signaling for the general constraint information (`general_constraint_info`). Accordingly, if the general constraint information is present in the PTL information, the decoding device should parse the general constraint information first, thus complicating the parsing of the level indicator. Furthermore, since the general constraint information may not be necessary in the decoding device, the decoding device might want to skip its parsing. However, according to Table 3, if the general constraint information is present in the PTL information, its parsing cannot be skipped.

[0173] Furthermore, when the value of profileTierPresentFlag is 1, signaling for general constraint information is always present in the PTL information. However, when profile, layer, and level information exist, general constraint information is not always required to be present in the PTL information. Accordingly, a mechanism is needed to prevent signaling for general constraint information even when PTL information is present.

[0174] Furthermore, the signaling for general constraint information resides in the middle of the signals for configuration files, layers, and levels. This places a burden on the decoding information, which needs to be processed separately from the general constraint information.

[0175] The following figures are provided to illustrate specific examples in this document. Names of specific devices or labels for specific signals / information described in the figures are provided by way of example; therefore, the technical features of this specification are not limited to the specific names used in the figures.

[0176] To address the aforementioned problems, this paper provides the following methods. These methods can be applied independently or in combination.

[0177] 1. In configuration files, layer, and level structures (PTL structures), level indicators can be signaled before their existence is conditionally specified in the syntax. For example, in PTL information, `general_level_idc` can be signaled before `general_profile_idc`.

[0178] 2. A flag can be added to indicate whether a signaling flag is given for General Constraint Information (GCI). This flag can be called gci_present_flag. Flags for General Constraint Information include the syntax elements specified in Table 4 as well as syntax elements that are not yet retained.

[0179] 3. The total number of bits including the general constraint information of gci_present_flag is specified in bytes (i.e., the number of bits is a multiple of 8).

[0180] 4. The bits reserved for general constraint flags begin at the byte alignment position. As a result, some bits for byte alignment may exist before the reserved bits.

[0181] 5. In addition to the new flag `gci_present_flag`, the syntax element representing the number of reserved bytes in the GCI structure can be changed to represent the number of general constraint flags (including reserved bits and flags), and can be signaled first directly below `gci_present_flag` in the GCI structure. This syntax element can be called `gci_num_constraint_bytes`. If the value of `gci_present_flag` is 0, then the value of `gci_num_constraint_bytes` is 0. The number of bits for signaling `gci_present_flag` and `gci_num_constraint_bytes` can be byte-aligned. For example, the number of bits for signaling `gci_num_constraint_bytes` can be changed to 7.

[0182] 6. As an alternative to item 4, for the general constraint flag, the reserved bits do not necessarily begin at the byte alignment position. As a result, this eliminates the need for byte-aligned bits before the reserved bits are present.

[0183] 7. As an alternative to item 1, configuration file, layer, and level information can be signaled in a manner that does not separate them from other syntax elements. This can be achieved by moving the signaling of general constraint information after the signaling of level information.

[0184] 8. As an alternative to item 5, the signaling for gci_num_constraint_bytes can replace gci_present_flag instead of being added to gci_present_flag.

[0185] 9. The syntax structure of general constraint information (general_constraint_info()) exists in the profile tier level structure (profile_tier_level syntax) after the configuration files of sub-layers, configuration files of layer and level information, and signaling of layer and level information.

[0186] 10. When the syntax structure of general constraint information exists at the end of the configuration file level structure, the size of the general constraint information may or may not be byte-aligned.

[0187] As an implementation, the encoding device can signal the profile_tier_level syntax with the structure shown in Table 5 below, and its semantics can be the same as those in Table 6 below.

[0188] [Table 5]

[0189] [Table 6]

[0190] Referring to Tables 5 and 6, `general_level_idc` represents the level that OlsInScope conforms to. As the value of `general_level_idc` increases, a higher level is indicated. The maximum level for signaling in the DCI NAL unit used for OlsInScope can be higher than, but not lower than, the level for signaling in the SPS of the CLVS included in OlsInScope. When OlsInScope conforms to several profiles, `general_profile_idc` represents the profile determined by the encoding device that provides the preferred decoding result or preferred bitstream identifier. When the CVS of OlsInScope conforms to different profiles, several `profile_tier_level` syntax structures can be included in the DCI NAL unit, such that for each CVS of OlsInScope, at least one set of profiles, layers, and levels of the decoding device capable of decoding the CVS exists.

[0191] general_profile_idc indicates the configuration file that OlsInScope conforms to.

[0192] general_tier_flag represents the layer context used to interpret general_level_idc.

[0193] In the `profile_tier_level` syntax structure in Table 3, general constraint information (`general_constraint_info`) can exist after the configuration file information (`general_profile_idc`), layer information (`general_tier_flag`), and level information (`general_level_idc`). Accordingly, the decoding device can process the general constraint information separately after processing the configuration file, layer, and level information.

[0194] Furthermore, as an example, the encoding device can signal the general_constraint_info syntax with the structure shown in Table 7 below.

[0195] [Table 7]

[0196] In Table 7, gci_present_flag indicates whether information about constraints (such as general_non_packed_constraint_flag) exists in the general_constraint_info syntax (general constraint information).

[0197] gci_num_reserved_bytes represents the number of bytes reserved for general constraint information.

[0198] gci_alignment_zero_bit is information used for byte alignment and has a value of 0.

[0199] gci_reserved_byte[i] represents the bytes reserved for general constraint information. gci_reserved_byte[i] has no effect on the decoding process and can have a certain value.

[0200] For example, the semantics of gci_present_flag can be the same as in Table 8 below.

[0201] [Table 8]

[0202] Referring to Table 8, if the value of gci_present_flag is 1, it means that the general constraint information (flag) exists in the profile_tier_level syntax when the value of profileTierPresentFlag is 1. If the value of gci_present_flag is 0, it means that the general constraint information does not exist in the profile_tier_level syntax.

[0203] If the value of gci_present_flag is 0 for the profile_tier_level syntax with a profileTierPresentFlag value of 1, then the value of max_bitdepth_constraint_idc is inferred to be 8, and the value of max_chroma_format_constraint_idc to be 3. Additionally, the value of other syntax elements in the general_constraint_info syntax (from general_non_packed_constraint_flag to no_aps_constraint_flag) is inferred to be 0.

[0204] Accordingly, if the general constraint information is not necessary for encoding the image information, the encoding device can encode the value of gci_present_flag as 0, and the decoding device can skip parsing the general constraint information if the value of gci_present_flag is 0.

[0205] As another example, the encoding device can signal the general_constraint_info syntax with the structure in Table 9 below.

[0206] [Table 9]

[0207] In Table 9, the semantics of gci_present_flag can be the same as in Table 8, and the semantics of gci_num_constraint_bytes can be the same as in Table 10.

[0208] [Table 10]

[0209] Referring to Table 10, `gci_num_constraint_bytes` excludes the bytes used to signal `gci_present_flag` and `gci_num_constraint_bytes`, and represents the length of the general constraint flags, including reserved bits in bytes. The value of `gci_num_constraint_bytes` is 0 or 9. If the value of `gci_present_flag` is 0, then the value of `gci_num_constraint_bytes` is 0. If the value of `gci_present_flag` is not 0, then the value of `gci_num_constraint_bytes` should not be less than 9. The value of `gci_num_constraint_bytes` can become 9 if the number of general constraint flags (information about general constraints) is changed when signaling general constraint information.

[0210] As another example, the encoding device can signal the general_constraint_info syntax with the structure shown in Table 11 below.

[0211] [Table 11]

[0212] In Table 11, the value of numSpecifiedFlags represents the number of specified (unreserved) general constraint flags. This value is 66 (i.e., the number of flags from general_non_packed_constraint_flag to no_aps_constraint_flag).

[0213] The semantics of gci_present_flag and gci_num_constraint_bytes can be the same as in Tables 8 and 10, and the semantics of gci_reserved_bit[i] can be the same as in Table 12.

[0214] [Table 12]

[0215] Referring to Table 12, the value of gci_reserved_bit[i] is a value that does not affect the decoding process and can have a certain value.

[0216] In addition, as another implementation, the encoding device can signal the profile_tier_level syntax having the structure shown in Table 13 below.

[0217] [Table 13]

[0218] Referring to Table 13, in the profile_tier_level syntax, level information (general_level_idc) can be signaled after configuration file information (general_profile_idc) and layer information (general_tier_flag), and general constraint information (general_constraint_info) can be signaled after level information.

[0219] In this case, the encoding device can signal the general_constraint_info syntax with the structure shown in Table 14 or Table 15 below.

[0220] [Table 14]

[0221] [Table 15]

[0222] In Table 15, gci_num_constraint_bytes represents the number of reserved bytes for information about constraints (general constraint flags), excluding bytes used to signal gci_num_constraint_bytes, and is expressed in bytes as the length of the general constraint flags including reserved bits. The value of gci_num_constraint_bytes is 0 or 9.

[0223] gci_reserved_bit[i] can be parsed in the general_constraint_info syntax based on the value of gci_num_constraint_bytes.

[0224] As another implementation, the encoding device can signal the profile_tier_level syntax having the structure shown in Table 16 below.

[0225] [Table 16]

[0226] Referring to Table 16, general constraint information can be included at the end of the profile_tier_level syntax.

[0227] In this case, the encoding device can signal the general_constraint_info syntax with the structures shown in Tables 17 to 19 below.

[0228] [Table 17]

[0229] [Table 18]

[0230] [Table 19]

[0231] In Table 17, gci_num_constraint_bits represents the number of bits reserved for information about general constraints (general constraint flags). gci_reserved_bit[i] can be parsed in the general_constraint_info syntax based on the value of gci_num_constraint_bits.

[0232] Referring to Tables 17 to 19, alignment information (gci_alignment_zero_bit) can exist at the end of the general_constraint_info syntax. In other words, in the general_constraint_info syntax, alignment information can be included after the number of bits reserved for general constraint information (gci_num_constraint_bits or gci_num_constraint_bytes) and reserved bits (gci_reserved_bit[i] or gci_reserved_byte[i]).

[0233] As another implementation, the encoding device can signal the profile_tier_level syntax having the structure shown in Table 20 below.

[0234] [Table 20]

[0235] Referring to Table 20, general constraint information can be present at the end of the profile_tier_level syntax. In other words, in the profile_tier_level syntax, general constraint information can be signaled after the configuration file information (general_profile_idc), layer information (general_tier_flag), and level information (general_level_idc).

[0236] In this case, the encoding device can signal the general_constraint_info syntax with the structures shown in Tables 21 to 24 below.

[0237] [Table 21]

[0238] [Table 22]

[0239] [Table 23]

[0240] [Table 24]

[0241] In Tables 21 and 22, gci_num_constraint_bits represents the number of bits reserved for information about constraints (general constraint flags). gci_reserved_bit[i] can be parsed in the general_constraint_info syntax based on the value of gci_num_constraint_bits.

[0242] Referring to Tables 21 to 24, bits or bytes reserved for general constraint information can be included at the end of the general_constraint_info syntax.

[0243] Figure 7 and Figure 8 Examples of video / image encoding methods and related components according to embodiments of this document are illustrated.

[0244] Figure 7 The publicly disclosed video / image coding methods can be derived from... Figure 2 and Figure 8 The (video / image) encoding device 200 disclosed herein is used. As an example, Figure 7 S700 and S710 can be executed by the predictor 220 of the encoding device 200. S720 can be executed by the entropy encoder 240 of the encoding device 200. Figure 7 The video / image encoding methods disclosed herein may include the embodiments described above.

[0245] Specifically, refer to Figure 7 and Figure 8 The predictor 220 of the encoding device can perform at least one of inter-frame prediction or intra-frame prediction on the current block in the current image (S700), and based on this, can generate a prediction sample (prediction block) and prediction information for the current block (S710).

[0246] When performing intra-frame prediction, predictor 220 can predict the current block by referring to samples within the current image (neighboring samples of the current block). Predictor 220 can determine the prediction mode to be applied to the current block by using the prediction mode applied to neighboring samples.

[0247] When performing inter-frame prediction, predictor 220 can generate prediction information and predicted blocks for the current block by performing inter-frame prediction based on the motion information of the current block. The prediction information described above may include information related to the prediction mode, information related to motion information, etc. The information related to motion information may include candidate selection information (e.g., merge index, mvp_flag, or mvp_index), which is information used to derive motion vectors. In addition, the information related to motion information may include the aforementioned information about motion vector difference (MVD) and / or reference image index information. Furthermore, the information related to motion information may include information indicating whether L0 prediction, L1 prediction, or dual prediction is applied. For example, predictor 220 can derive motion information of the current block in the current image based on motion estimation. To this end, by using the original block in the original image corresponding to the current block, predictor 220 can search for highly relevant similar reference blocks in fractional pixels within a defined search range in the reference image. Then, predictor 220 can derive motion information from the searched reference blocks. The similarity of blocks can be derived based on the difference between sample values ​​based on phase. For example, block similarity can be calculated based on the sum of absolute differences (SAD) between the current block (or current block template) and a reference block (or reference block template). In this case, motion information can be derived based on the reference block with the minimum SAD within the search region. The derived motion information can be signaled to the decoding device using various methods based on inter-frame prediction modes.

[0248] The residual processor 230 of the encoding device can generate residual samples and residual information based on the predicted samples generated from the predictor 220 and the original images (original blocks, original samples). In this document, residual information is information related to the residual samples, and residual information may include information related to the (quantization) transformation coefficients of the residual samples.

[0249] The adder (or reconstructor) of the encoding device can generate reconstructed samples (reconstructed images, reconstructed blocks, arrays of reconstructed samples) by adding the residual samples generated in the residual processor 230 and the predicted samples generated in the predictor 220.

[0250] The entropy encoder 240 of the encoding device can encode image information including prediction information generated by predictor 220, residual information generated by residual processor 230, and information about HLS (S720).

[0251] Information about HLS can include information / syntax about the parameter set used for decoding image / video information. For example, the parameter set can include APS, PPS, SPS, VPS, etc. SPS and / or VPS can include PTL information (profile_tier_level syntax) as described above in Tables 1 and 2.

[0252] PTL information can include configuration file information (general_profile_idc) representing the configuration file conforming to the output layer set, level information (general_level_idc) representing the level of conforming to the output layer set, layer context information used to interpret the level information, and general constraint information used for the constraints conforming to the output layer set. General constraint information can be simply referred to as constraint information.

[0253] If PTL information is included in the VPS, the output layer set includes one or more output layer sets specified by the VPS. If PTL information is included in the SPS, the output layer set is the set of output layers that only references the lowest level of the SPS.

[0254] The encoding device can generate level information representing the level of the output layer set conforming to when generating PTL information, and can also generate configuration file information representing the configuration file of the output layer set conforming to, layer context information for interpreting the level information, and general constraint information. Here, in the PTL information (profile_tier_level syntax), the general constraint information can exist after the level information. That is, in the PTL information, the level information can exist first before the general constraint information.

[0255] General constraint information may include a flag (gci_present_flag) indicating whether information about the constraint (general constraint flag) exists in the general constraint information. If the value of gci_present_flag is 1, then information about the constraint can be included in the general constraint information. If the value of gci_present_flag is 0, then information about the constraint may not exist in the general constraint information.

[0256] In addition, general constraint information may include alignment information (gci_alignment_zero_bit) with a value of 0. In general constraint information, alignment information may be present after the number of bits reserved as information about the constraint and / or after the reserved bits. As an example, alignment information may be present at the end of the general constraint information.

[0257] The entropy encoder 240 of the encoding device can encode image information including level information, configuration file information, layer information, and / or general constraint information. The encoded image information can be transmitted or stored in the NAL unit as a bit stream.

[0258] According to this paper, since the encoding device can avoid signaling general constraint information even when signaling PTL information, it can configure the value of gci_present_flag to 0. Therefore, if general constraint information is unnecessary during decoding, the encoding device can choose not to signal it. Furthermore, since general constraint information exists after configuration file information, layer information, and level information in the PTL information, the decoding device can process general constraint information separately from these information.

[0259] Figure 9 and Figure 10 Examples of video / image decoding methods and related components according to embodiments of this document are illustrated schematically.

[0260] Figure 9 The publicly disclosed video / image decoding method can be used by Figure 3 and Figure 10 The (video / image) decoding device 300 disclosed herein performs the operation. Specifically, for example, Figure 9 S900 to S920 can be executed by the entropy decoder 310 of the decoding device. S940 can be executed by the residual processor 320, predictor 330 and adder 340 of the decoding device. Figure 9 The video / image decoding methods disclosed herein may include the embodiments described above.

[0261] Reference Figure 9 and Figure 10The entropy decoder 310 of the decoding device can obtain image information from the bitstream. Image information may include prediction-related information, residual information, information about HLS, and loop filtering-related information. Prediction-related information may include inter-frame / intra-frame prediction classification information, intra-frame prediction mode-related information, and inter-frame prediction mode-related information. Information about HLS may include information / syntax of the parameter set used for decoding the image / video information. Here, the parameter set may include APS, PPS, SPS, VPS, etc. SPS and / or VPS may include PTL information (profile_tier_level syntax) as described above in Tables 1 and 2. PTL information may include profile information (general_profile_idc) representing the profile conformance of the output layer set, level information (general_level_idc) representing the level of conformance of the output layer set, layer context information (general_tier_flag) used to interpret the level information, and general constraint information (general_constraint_info) used for constraints on the conformance of the output layer set.

[0262] The entropy decoder 310 of the decoding device can parse level information representing the level of the output layer set conformance, configuration file information representing the configuration file of the output layer set conformance, and / or layer context information used to interpret the level information from the PTL information in the bitstream. Additionally, the entropy decoder 310 of the decoding device can obtain general constraint information of the constraints conforming to the output layer set conformance from the PTL information in the bitstream (S900). Here, the general constraint information may exist after the level information in the PTL information. That is, the entropy decoder 310 of the decoding device can obtain the general constraint information after parsing the level information in the PTL information.

[0263] The entropy decoder 310 of the decoding device can parse a flag (gci_present_flag) indicating whether information about constraints (general constraint information) exists in the general_constraint_info syntax from the general constraint information (S910). Furthermore, the entropy decoder 310 of the decoding device can parse information about constraints from the general constraint information based on this flag (S920). For example, if the value of gci_present_flag is 1, then information about constraints can be included in the general constraint information. If the value of gci_present_flag is 0, then information about constraints may not exist in the general constraint information.

[0264] Furthermore, the general constraint information may include number information, representing the number of bits reserved as information about the constraint, reserved bits, and alignment information (gci_alignment_zero_bit) with a value of 0. The alignment information may exist after the number information and / or the reserved bits. In other words, the entropy decoder 310 of the decoding device may parse the alignment information after parsing the number information and reserved bits from the general constraint information. For example, the alignment information may be parsed last from the general constraint information.

[0265] The decoding device can perform a decoding process on the current image based on HLS information, prediction-related information, and residual information, including level information and general constraint information (S930).

[0266] For example, the predictor 330 of the decoding device can generate a prediction sample of the current block in the current image by performing inter-frame prediction and / or intra-frame prediction on the current block in the current image based on HLS information obtained from the bitstream and using prediction-related information. Additionally, the residual processor 320 of the decoding device can generate residual samples based on residual information obtained from the bitstream. The adder 340 of the decoding device can generate reconstructed samples based on the prediction samples generated by the predictor 330 and the residual samples generated by the residual processor 320, and can generate a reconstructed image (reconstructed block) based on the reconstructed samples.

[0267] Subsequently, loop filtering processes (such as deblocking filtering, SAO, and / or ALF processes) can be applied to the reconstructed image as needed to enhance subjective / objective image quality.

[0268] Although the method has been described based on a flowchart listing the steps or blocks in the sequence of the above embodiments, the steps herein are not limited to a particular order, and specific steps may be performed in different steps or in a different order or simultaneously relative to those described above. Furthermore, those skilled in the art will understand that the steps in the flowchart are not exclusive, and one or more steps may be included or removed from the flowchart without affecting the scope of this document.

[0269] The methods described above can be in the form of software, and the encoding and / or decoding devices described herein can be included in apparatus for performing image processing, such as TVs, computers, smartphones, set-top boxes, display devices, etc.

[0270] When the embodiments described herein are implemented in software, the methods described above can be implemented by modules (processes or functions) that perform the functions described above. Modules can be stored in memory and executed by a processor. Memory can be installed inside or outside the processor and can be connected to the processor via various known means. The processor may include application-specific integrated circuits (ASICs), other chipsets, logic circuits, and / or data processing devices. Memory may include read-only memory (ROM), random access memory (RAM), flash memory, memory cards, storage media, and / or other storage devices. In other words, the embodiments described herein can be implemented and executed on a processor, microprocessor, controller, or chip. For example, the functional units shown in the corresponding figures can be implemented and executed on a computer, processor, microprocessor, controller, or chip. In this case, information about the implementation (e.g., information about instructions) or algorithms can be stored in a digital storage medium.

[0271] Furthermore, the decoding and encoding devices using the embodiments described herein can be included in multimedia broadcast transceivers, mobile communication terminals, home theater video devices, digital cinema video devices, surveillance cameras, video chat devices, and real-time communication devices, such as video communication, mobile streaming devices, storage media, cameras, video-on-demand (VoD) service providers, over-the-top (OTT) video devices, internet streaming service providers, 3D video devices, virtual reality (VR) devices, augmented reality (AR) devices, image telephony video devices, vehicle terminals (e.g., vehicle (including autonomous vehicle) terminals, aircraft terminals, or ship terminals), and medical video devices; and can be used to process image signals or data. For example, OTT video devices can include game consoles, Blu-ray players, internet-connected TVs, home theater systems, smartphones, tablet PCs, and digital video recorders (DVRs).

[0272] Furthermore, the processing methods applying the embodiments described herein can be generated in the form of a computer-executable program and can be stored in a computer-readable recording medium. Multimedia data having data structures according to the embodiments described herein can also be stored in a computer-readable recording medium. Computer-readable recording media include all types of storage devices and distributed storage devices for storing computer-readable data. Computer-readable recording media can include, for example, Blu-ray discs (BD), Universal Serial Bus (USB), ROM, PROM, EPROM, EEPROM, RAM, CD-ROM, magnetic tape, floppy disks, and optical data storage devices. Computer-readable recording media also include media embodied in the form of a carrier wave (e.g., transmission over the Internet). Furthermore, bitstreams generated by encoding methods can be stored in a computer-readable recording medium or transmitted via wired or wireless communication networks.

[0273] Furthermore, the embodiments described herein can be embodied in computer program product based on program code, and the program code can be executed on a computer according to the embodiments described herein. The program code can be stored on a computer-readable medium.

[0274] Figure 11 Examples of content streaming systems to which the implementation methods described herein can be applied.

[0275] Reference Figure 11 Content streaming systems using the embodiments described herein typically include encoding servers, streaming servers, network servers, media storage devices, user devices, and multimedia input devices.

[0276] An encoding server is used to compress content input from multimedia input devices such as smartphones, cameras, or camcorders into digital data to generate a bitstream, which is then sent to a streaming server. As another example, when multimedia input devices such as smartphones, cameras, or camcorders generate bitstreams directly, the encoding server can be omitted.

[0277] Bitstreams can be generated using the encoding methods or bitstream generation methods described herein, and the streaming server can temporarily store the bitstreams during the sending or receiving of the bitstreams.

[0278] The streaming server sends multimedia data to the user device via a web server based on user requests, and the web server acts as a medium for notifying the user of services. When a user requests a desired service from the web server, the web server delivers the request to the streaming server, and the streaming server sends multimedia data to the user. In this scenario, the content streaming system may include a separate control server. In this case, the control server is used to control the commands / responses between devices within the content streaming system.

[0279] A streaming server can receive content from media storage and / or encoding servers. For example, when receiving content from an encoding server, the content can be received in real time. In this case, to provide a smooth streaming service, the streaming server can store the bitstream for a predetermined period of time.

[0280] For example, user equipment may include mobile phones, smartphones, laptops, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation devices, tablet PCs, ultrabooks, wearable devices (e.g., smartwatches, smart glasses, head-mounted displays (HMDs)), digital TVs, desktop computers, digital signage, etc.

[0281] In a content streaming system, each server can function as a distributed server, and in this case, data received by each server can be processed in a distributed manner.

Claims

1. A decoding device for image decoding, the decoding device comprising: A memory; and at least one processor connected to the memory, the at least one processor being configured to: Obtain general constraint information from the bit stream; Parse the flag from the bitstream indicating whether information about the constraints conforming to the output layer set exists in the general constraint information; Based on the flag, determine whether to parse the information about the constraint from the general constraint information; and The current image is decoded based on the information regarding the constraints. The general constraint information includes information about the number of constraints and alignment information, and In the general constraint information, the alignment information exists after the number information.

2. An encoding device for image encoding, the encoding device comprising: A memory; and at least one processor connected to the memory, the at least one processor being configured to: Perform inter-frame prediction or intra-frame prediction on the current block in the current image; Prediction information for the current block is generated based on the inter-frame prediction or the intra-frame prediction; and The image information, including the predicted information, is encoded. The image information includes a flag indicating whether information about the constraints conforming to the output layer set exists in the general constraint information of the image information. The general constraint information includes information about the number of constraints and alignment information, and In the general constraint information, the alignment information exists after the number information.

3. An apparatus for transmitting data relating to an image, the apparatus comprising: At least one processor, the at least one processor being configured to perform the following steps to obtain a bitstream for the image: performing inter-frame prediction or intra-frame prediction on the current block in the current image; Generate prediction information for the current block based on the inter-frame prediction or the intra-frame prediction; and encode image information including the prediction information; and A transmitter configured to transmit the data comprising the bit stream. The image information includes a flag indicating whether information about the constraints conforming to the output layer set exists in the general constraint information of the image information. The general constraint information includes information about the number of constraints and alignment information, and In the general constraint information, the alignment information exists after the number information.