Image coding method based on POC information and non-reference picture flag in video or image coding system

IN605043BActive Publication Date: 2026-10-06LG ELECTRONICS INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
IN202217074731
Authority / Receiving Office
IN · IN
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-05-27
Filing Date
2022-12-22
Publication Date
2026-10-06

AI Technical Summary

Technical Problem

The increasing demand for high-resolution, high-quality images and videos, particularly in fields like virtual reality and ultra-high definition, poses a challenge due to the increased data transmission and storage costs, necessitating a highly efficient compression technique.

Method used

The method involves signaling picture order count (POC) information and a non-reference picture flag, allowing for the derivation of POC values based on these flags, enhancing video/image coding efficiency by optimizing compression and decoding processes.

Benefits of technology

This approach enhances overall image/video compression efficiency, reducing data transmission and storage costs while supporting advanced imaging technologies like VR and UHD.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

According to the disclosure of the present document, image information acquired via a bitstream includes POC information, and a non-reference picture flag related to whether a picture is not used as a reference picture. A POC value of a current picture is derived on the basis of the POC information, and the POC information includes POC information of a previous picture in decoding order for the current picture. The previous picture in the decoding order for deriving the POC value of the current picture may be limited to a picture where a value of the non-reference picture flag is 0. Accordingly, an incorrect POC value can be prevented from being derived in video / image coding.
Need to check novelty before this filing date? Find Prior Art

Description

BACKGROUND OF THE DISCLOSUREField of the disclosure[1] The present disclosure relates to video / image coding technology, and more particularly,to an image coding method based on picture order count (POC) information and a nonreference picture flag in a video or image coding system.Related Art[2] Recently, the demand for high resolution, high quality image / video such as 4K or 8KUltra High Definition (UHD) image / video is increasing in various fields. As the image / videoresolution or quality becomes higher, relatively more amount of information or bits aretransmitted than for conventional image / video data. Therefore, if image / video data aretransmitted via a medium such as an existing wired / wireless broadband line or stored in alegacy storage medium, costs for transmission and storage are readily increased.[3] Moreover, interests and demand are growing for virtual reality (VR) and artificialreality (AR) contents, and immersive media such as hologram; and broadcasting ofimages / videos exhibiting image / video characteristics different from those of an actualimage / video, such as game images / videos, are also growing.[4] Therefore, a highly efficient image / video compression technique is required toeffectively compress and transmit, store, or play high resolution, high quality images / videosshowing various characteristics as described above.SUMMARY[5] An exemplary embodiment of the present disclosure provides a method and anapparatus for enhancing video / image coding efficiency.[6] An exemplary embodiment of the present disclosure provides a method and anapparatus for signaling picture order count (POC) information.[7] An exemplary embodiment of the present disclosure provides a method and anapparatus for signaling a non-reference picture flag related to whether a picture is not used asa reference picture.[8] An exemplary embodiment of the present disclosure provides a method and anapparatus for deriving a previous picture in a decoding order for deriving a POC value of acurrent picture based on a non-reference picture flag.[9] An exemplary embodiment of the present disclosure provides a method and anapparatus for deriving a previous picture in a decoding order for deriving a POC value of acurrent picture based on MaxPicOrderCntLsb.

[10] An exemplary embodiment of the present disclosure provides a video / image decodingmethod performed by a decoding apparatus.

[11] An exemplary embodiment of the present disclosure provides a decoding apparatus forperforming a video / image decoding.

[12] An exemplary embodiment of the present disclosure provides a video / image encodingmethod performed by an encoding apparatus.

[13] An exemplary embodiment of the present disclosure provides an encoding apparatusfor performing video / image encoding.

[14] An exemplary embodiment of the present disclosure provides a computer readabledigital storage medium in which encoded video / image information generated by the vide / imageencoding method disclosed in at least one of the exemplary embodiments of the presentdisclosure is stored.

[15] An exemplary embodiment of the present disclosure provides a computer readabledigital storage medium in which encoded information or encoded video / image informationcausing the vide / image decoding method disclosed in at least one of the exemplaryembodiments of the present disclosure to be performed by the decoding apparatus is stored.ADVANTAGEOUS EFFECTS

[16] The exemplary embodiment of the present disclosure may enhance the overallimage / video compression efficiency.

[17] The exemplary embodiment of the present disclosure may signal picture order count(POC) information.

[18] The exemplary embodiment of the present disclosure may signal a non-referencepicture flag related to whether a picture is not used as a reference picture.

[19] The exemplary embodiment of the present disclosure may derive a previous picture ina decoding order for deriving a POC value of a current picture based on a non-reference pictureflag.

[20] The exemplary embodiment of the present disclosure may derive a previous picture ina decoding order for deriving a POC value of a current picture based on MaxPicOrderCntLsb.BRIEF DESCRIPTION OF THE DRAWINGS

[21] FIG. 1 schematically illustrates an example of a video / image coding system to whichexemplary embodiments of the present disclosure are applicable.

[22] FIG. 2 is a diagram for schematically explaining a configuration of a video / imageencoding apparatus to which the exemplary embodiments of the present disclosure areapplicable.

[23] FIG. 3 is a diagram for schematically explaining a configuration of a video / imagedecoding apparatus to which the exemplary embodiments of the present disclosure areapplicable.

[24] FIG. 4 exemplarily illustrates a hierarchical structure for the coded video / image.

[25] FIG. 5 is a diagram illustrating a temporal layer structure for NAL units in a bitstreamsupporting temporal scalability.

[26] FIG. 6 shows a video / image encoding method based on inter prediction.

[27] FIG. 7 shows a video / image decoding method based on inter prediction.

[28] FIG. 8 shows an example of a picture order count (POC)-based video / image encodingmethod.

[29] FIG. 9 shows an example of a POC-based video / image decoding method.

[30] FIGS. 10 and 11 schematically show an example of a video / image encoding methodand related components according to embodiment(s) of the present disclosure.

[31] FIGS. 12 and 13 schematically show an example of a video / image decoding methodand related components according to an embodiment of the present disclosure.

[32] FIG. 14 shows an example of a content streaming system to which embodimentsdisclosed in the present disclosure may be applied.DESCRIPTION OF EXEMPLARY EMBODIMENTS

[33] The present disclosure may be modified in various forms, and specific embodimentsthereof will be described and shown in the drawings. However, the embodiments are notintended for limiting the present disclosure. The terms used in the following description areused to merely describe specific embodiments, but are not intended to limit the presentdisclosure. An expression of a singular number includes an expression of the plural number,so long as it is clearly read differently. The terms such as "include" and "have" are intendedto indicate that features, numbers, steps, operations, elements, components, or combinationsthereof used in the following description exist and it should be thus understood that thepossibility of presence or addition of one or more different features, numbers, steps, operations,elements, components, or combinations thereof is not excluded.

[34] Meanwhile, each of the components in the drawings described in the present disclosureare shown independently for the convenience of description regarding different characteristicfunctions, and do not mean that the components are implemented in separate hardware orseparate software. For example, two or more of each configuration may be combined to formone configuration, or one configuration may be divided into a plurality of configurations.Embodiments in which each configuration is integrated and / or separated are also included inthe scope of the present disclosure without departing from the spirit of the present disclosure.

[35] Hereinafter, exemplary embodiments of the present disclosure will be described indetail with reference to the accompanying drawings. Hereinafter, the same referencenumerals are used for the same components in the drawings, and redundant description of thesame components may be omitted.

[36] FIG. 1 schematically illustrates an example of a video / image coding system to whichexemplary embodiments of the present disclosure are applicable.

[37] Referring to FIG. 1, a video / image coding system may include a first apparatus (asource device) and a second apparatus (a receiving device). The source device may deliverencoded video / image information or data in the form of a file or streaming to the receivingdevice via a digital storage medium or network.

[38] The source device may include a video source, an encoding apparatus, and atransmitter. The receiving device may include a receiver, a decoding apparatus, and arenderer. The encoding apparatus may be called a video / image encoding apparatus, and thedecoding apparatus may be called a video / image decoding apparatus. The transmitter may beincluded in the encoding apparatus. The receiver may be included in the decoding apparatus.The renderer may include a display, and the display may be configured as a separate device oran external component.

[39] The video source may obtain video / image through a process of capturing, synthesizing,or generating the video / image. The video source may include a video / image capture deviceand / or a video / image generating device. The video / image capture device may include, forexample, one or more cameras, video / image archives including previously capturedvideo / images, and the like. The video / image generating device may include, for example,computers, tablets and smartphones, and may (electronically) generate video / images. Forexample, a virtual video / image may be generated through a computer or the like. In this case,the video / image capturing process may be replaced by a process of generating related data.

[40] The encoding apparatus may encode input video / image. The encoding apparatusmay perform a series of procedures such as prediction, transform, and quantization forcompression and coding efficiency. The encoded data (encoded video / image information)may be output in the form of a bitstream.

[41] The transmitter may transmit the encoded image / image information or data output inthe form of a bitstream to the receiver of the receiving device through a digital storage mediumor a network in the form of a file or streaming. The digital storage medium may includevarious storage mediums such as USB, SD, CD, DVD, Blu-ray, HDD, SSD, and the like. Thetransmitter may include an element for generating a media file through a predetermined fileformat and may include an element for transmission through a broadcast / communicationnetwork. The receiver may receive / extract the bitstream and transmit the received bitstreamto the decoding apparatus.

[42] The decoding apparatus may decode the video / image by performing a series ofprocedures such as dequantization, inverse transform, and prediction corresponding to theoperation of the encoding apparatus.

[43] The renderer may render the decoded video / image. The rendered video / image maybe displayed through the display.

[44] The present disclosure relates to a video / image coding. For example,methods / exemplary embodiments disclosed in the present disclosure are applicable to a methoddisclosed in a versatile video coding (VVC) standard. Further, the methods / exemplaryembodiments disclosed in the present disclosure are applicable to a method disclosed in anessential video coding (EVC) standard, an AOMedia Video 1 (AV1) standard, a 2nd generationof audio video coding (AVS2) standard, or a next-generation video / image coding standard (e.g.,H.267 or H.268).

[45] The present disclosure presents various embodiments of video / image coding, and theembodiments may be performed in combination with each other unless otherwise mentioned.

[46] In the present disclosure, a video may mean a group of a series of images over time.A picture generally means a unit representing one image in a specific time period, and a sliceand a tile are units constituting a part of a picture in coding. The slice / tile may include oneor more coding tree units (CTUs). One picture may be composed of one or more slices / tiles.A tile is a rectangular region of CTUs within a particular tile column and a particular tile rowin a picture. The tile column is a rectangular region of CTUs having a height equal to theheight of the picture and a width specified by syntax elements in the picture parameter set.The tile row is a rectangular region of CTUs having a height specified by syntax elements inthe picture parameter set and a width equal to the width of the picture. A tile scan is a specificsequential ordering of CTUs partitioning a picture in which the CTUs are ordered consecutivelyin CTU raster scan in a tile whereas tiles in a picture are ordered consecutively in a raster scanof the tiles of the picture. A slice includes an integer number of complete tiles or an integernumber of consecutive complete CTU rows within a tile of a picture that may be exclusivelycontained in a single NAL unit.

[47] Meanwhile, one picture may be divided into two or more subpictures. The subpicturemay be a rectangular region of one or more slices within a picture.

[48] A pixel or a pel may mean a smallest unit constituting one picture (or image). Also,'sample' may be used as a term corresponding to a pixel. A sample may generally representa pixel or a value of a pixel, and may represent only a pixel / pixel value of a luma componentor only a pixel / pixel value of a chroma component.

[49] A unit may represent a basic unit of image processing. The unit may include at leastone of a specific region of the picture and information related to the region. One unit mayinclude one luma block and two chroma (ex., Cb, cr) blocks. The unit may be usedinterchangeably with terms such as block or area in some cases. In a general case, an MxNblock may include samples (or sample arrays) or a set (or array) of transform coefficients of Mcolumns and N rows.

[50] In the present disclosure, "A or B" may mean "only A", "only B", or "both A and B".In other words, in the present disclosure, "A or B" may be interpreted as "A and / or B". Forexample, in the present disclosure, "A, B, or C" may mean "only A", "only B", "only C", or"any combination of A, B, and C".

[51] A slash ( / ) or a comma used in the present disclosure may mean "and / or". Forexample, "A / B" may mean "A and / or B". Therefore, "A / B" may mean "only A", "only B",or "both A and B". For example, "A, B, C" may mean "A, B, or C".

[52] In the present disclosure, "at least one of A and B" may mean "only A", "only B", or"both A and B". Further, in the present disclosure, expressions of "at least one of A or B" or"at least one of A and / or B" may be interpreted the same as "at least one of A and B".

[53] Further, in the present disclosure, "at least one of A, B, and C" may mean "only A","only B", "only C", or "any combination of A, B, and C". Further, "at least one of A, B, orC" or "at least one of A, B, and / or C" may mean "at least one of A, B, and C".

[54] Further, a parenthesis used in the present disclosure may mean "for example".Specifically, if it is indicated by a "prediction (intra prediction)", an "intra prediction" may beproposed as an example of the "prediction". In other words, the "prediction" in the presentdisclosure is not limited to the "intra prediction", and the "intra prediction" may be proposedas the example of the "prediction". Further, even if it is indicated by a "prediction (i.e., intraprediction)", the "intra prediction" may be proposed as the example of the "prediction".

[55] In the present disclosure, a technical feature individually described in one drawing mayalso be individually implemented, and also be simultaneously implemented.

[56] FIG. 2 is a diagram for schematically explaining a configuration of a video / imageencoding apparatus to which exemplary embodiments of the present disclosure are applicable.Hereinafter, the encoding apparatus may include an image encoding apparatus and / or a videoencoding apparatus.

[57] Referring to FIG. 2, the encoding apparatus 200 includes an image partitioner 210, apredictor 220, a residual processor 230, and an entropy encoder 240, an adder 250, a filter 260,and a memory 270. The predictor 220 may include an inter predictor 221 and an intrapredictor 222. The residual processor 230 may include a transformer 232, a quantizer 233, adequantizer 234, and an inverse transformer 235. The residual processor 230 may furtherinclude a subtractor 231. The adder 250 may be called a reconstructor or a reconstructedblock generator. The image partitioner 210, the predictor 220, the residual processor 230, theentropy encoder 240, the adder 250, and the filter 260 may be configured by at least onehardware component (ex. An encoder chipset or processor) according to an embodiment. Inaddition, the memory 270 may include a decoded picture buffer (DPB) or may be configuredby a digital storage medium. The hardware component may further include the memory 270as an internal / external component.

[58] The image partitioner 210 may partition an input image (or a picture or a frame) inputto the encoding apparatus 200 into one or more processors. For example, the processor maybe called a coding unit (CU). In this case, the coding unit may be recursively partitionedaccording to a quad-tree binary-tree ternary-tree (QTBTTT) structure from a coding tree unit(CTU) or a largest coding unit (LCU). For example, one coding unit may be partitioned intoa plurality of coding units of a deeper depth based on a quad tree structure, a binary treestructure, and / or a ternary structure. In this case, for example, the quad tree structure may beapplied first and the binary tree structure and / or ternary structure may be applied later.Alternatively, the binary tree structure may be applied first. The coding procedure accordingto the present disclosure may be performed based on the final coding unit that is no longerpartitioned. In this case, the largest coding unit may be used as the final coding unit based oncoding efficiency according to image characteristics, or if necessary, the coding unit may berecursively partitioned into coding units of deeper depth and a coding unit having an optimalsize may be used as the final coding unit. Here, the coding procedure may include a procedureof prediction, transform, and reconstruction, which will be described later. As anotherexample, the processor may further include a prediction unit (PU) or a transform unit (TU).In this case, the prediction unit and the transform unit may be split or partitioned from theaforementioned final coding unit. The prediction unit may be a unit of sample prediction, andthe transform unit may be a unit for deriving a transform coefficient and / or a unit for derivinga residual signal from the transform coefficient.

[59] The unit may be used interchangeably with terms such as block or area in some cases.In a general case, an MxN block may represent a set of samples or transform coefficientscomposed of M columns and N rows. A sample may generally represent a pixel or a value ofa pixel, may represent only a pixel / pixel value of a luma component or represent only apixel / pixel value of a chroma component. A sample may be used as a term corresponding toone picture (or image) for a pixel or a pel.

[60] In the encoding apparatus 200, a prediction signal (predicted block, prediction samplearray) output from the inter predictor 221 or the intra predictor 222 is subtracted from an inputimage signal (original block, original sample array) to generate a residual signal residual block,residual sample array), and the generated residual signal is transmitted to the transformer 232.In this case, as shown, a unit for subtracting a prediction signal (predicted block, predictionsample array) from the input image signal (original block, original sample array) in the encoder200 may be called a subtractor 231. The predictor may perform prediction on a block to beprocessed (hereinafter, referred to as a current block) and generate a predicted block includingprediction samples for the current block. The predictor may determine whether intraprediction or inter prediction is applied on a current block or CU basis. As described later inthe description of each prediction mode, the predictor may generate various kinds ofinformation related to prediction, such as prediction mode information, and transmit thegenerated information to the entropy encoder 240. The information on the prediction may beencoded in the entropy encoder 240 and output in the form of a bitstream.

[61] The intra predictor 222 may predict the current block by referring to the samples in thecurrent picture. The referred samples may be located in the neighborhood of the current blockor may be located apart according to the prediction mode. In the intra prediction, predictionmodes may include a plurality of non-directional modes and a plurality of directional modes.The non-directional mode may include, for example, a DC mode and a planar mode. Thedirectional mode may include, for example, 33 directional prediction modes or 65 directionalprediction modes according to the degree of detail of the prediction direction. However, thisis merely an example, more or less directional prediction modes may be used depending on asetting. The intra predictor 222 may determine the prediction mode applied to the currentblock by using a prediction mode applied to a neighboring block.

[62] The inter predictor 221 may derive a predicted block for the current block based on areference block (reference sample array) specified by a motion vector on a reference picture.Here, in order to reduce the amount of motion information transmitted in the inter predictionmode, the motion information may be predicted in units of blocks, subblocks, or samples basedon correlation of motion information between the neighboring block and the current block.The motion information may include a motion vector and a reference picture index. Themotion information may further include inter prediction direction (L0 prediction, L1 prediction,Bi prediction, etc.) information. In the case of inter prediction, the neighboring block mayinclude a spatial neighboring block present in the current picture and a temporal neighboringblock present in the reference picture. The reference picture including the reference blockand the reference picture including the temporal neighboring block may be the same ordifferent. The temporal neighboring block may be called a collocated reference block, a colocated CU (colCU), and the like, and the reference picture including the temporal neighboringblock may be called a collocated picture (colPic). For example, the inter predictor 221 mayconfigure a motion information candidate list based on neighboring blocks and generateinformation indicating which candidate is used to derive a motion vector and / or a referencepicture index of the current block. Inter prediction may be performed based on variousprediction modes. For example, in the case of a skip mode and a merge mode, the interpredictor 221 may use motion information of the neighboring block as motion information ofthe current block. In the skip mode, unlike the merge mode, the residual signal may not betransmitted. In the case of the motion vector prediction (MVP) mode, the motion vector ofthe neighboring block may be used as a motion vector predictor and the motion vector of thecurrent block may be indicated by signaling a motion vector difference.

[63] The predictor 220 may generate a prediction signal based on various predictionmethods described below. For example, the predictor may not only apply intra prediction orinter prediction to predict one block but also simultaneously apply both intra prediction andinter prediction. This may be called combined inter and intra prediction (CIIP). In addition,the predictor may be based on an intra block copy (IBC) prediction mode or a palette mode forprediction of a block. The IBC prediction mode or palette mode may be used for contentimage / video coding of a game or the like, for example, screen content coding (SCC). TheIBC basically performs prediction in the current picture but may be performed similarly to interprediction in that a reference block is derived in the current picture. That is, the IBC may useat least one of the inter prediction techniques described in the present disclosure. The palettemode may be considered as an example of intra coding or intra prediction. When the palettemode is applied, a sample value within a picture may be signaled based on information on thepalette table and the palette index.

[64] The prediction signal generated by the predictor (including the inter predictor 221and / or the intra predictor 222) may be used to generate a reconstructed signal or to generate aresidual signal. The transformer 232 may generate transform coefficients by applying atransform technique to the residual signal. For example, the transform technique may includeat least one of a discrete cosine transform (DCT), a discrete sine transform (DST), a graphbased transform (GBT), or a conditionally non-linear transform (CNT). Here, the GBT meanstransform obtained from a graph when relationship information between pixels is representedby the graph. The CNT refers to transform generated based on a prediction signal generatedusing all previously reconstructed pixels. In addition, the transform process may be appliedto square pixel blocks having the same size or may be applied to blocks having a variable sizerather than square.

[65] The quantizer 233 may quantize the transform coefficients and transmit them to theentropy encoder 240 and the entropy encoder 240 may encode the quantized signal(information on the quantized transform coefficients) and output a bitstream. Theinformation on the quantized transform coefficients may be referred to as residual information.The quantizer 233 may rearrange block type quantized transform coefficients into a onedimensional vector form based on a coefficient scanning order and generate information on thequantized transform coefficients based on the quantized transform coefficients in the onedimensional vector form. Information on transform coefficients may be generated. Theentropy encoder 240 may perform various encoding methods such as, for example, exponentialGolomb, context-adaptive variable length coding (CAVLC), context-adaptive binaryarithmetic coding (CABAC), and the like. The entropy encoder 240 may encode informationnecessary for video / image reconstruction other than quantized transform coefficients (ex.values of syntax elements, etc.) together or separately. Encoded information (ex. Encodedvideo / image information) may be transmitted or stored in units of NALs (network abstractionlayer) in the form of a bitstream. The video / image information may further includeinformation on various parameter sets such as an adaptation parameter set (APS), a pictureparameter set (PPS), a sequence parameter set (SPS), or a video parameter set (VPS). Inaddition, the video / image information may further include general constraint information. Inthe present disclosure, information and / or syntax elements transmitted / signaled from theencoding apparatus to the decoding apparatus may be included in video / picture information.The video / image information may be encoded through the above-described encodingprocedure and included in the bitstream. The bitstream may be transmitted over a network ormay be stored in a digital storage medium. The network may include a broadcasting networkand / or a communication network, and the digital storage medium may include various storagemedia such as USB, SD, CD, DVD, Blu-ray, HDD, SSD, and the like. A transmitter (notshown) transmitting a signal output from the entropy encoder 240 and / or a storage unit (notshown) storing the signal may be included as internal / external element of the encodingapparatus 200, and alternatively, the transmitter may be included in the entropy encoder 240.

[66] The quantized transform coefficients output from the quantizer 233 may be used togenerate a prediction signal. For example, the residual signal (residual block or residualsamples) may be reconstructed by applying dequantization and inverse transform to thequantized transform coefficients through the dequantizer 234 and the inverse transformer 235.The adder 250 adds the reconstructed residual signal to the prediction signal output from theinter predictor 221 or the intra predictor 222 to generate a reconstructed signal (reconstructedpicture, reconstructed block, reconstructed sample array). If there is no residual for the blockto be processed, such as a case where the skip mode is applied, the predicted block may be usedas the reconstructed block. The adder 250 may be called a reconstructor or a reconstructedblock generator. The generated reconstructed signal may be used for intra prediction of a nextblock to be processed in the current picture and may be used for inter prediction of a nextpicture through filtering as described below.

[67] Meanwhile, luma mapping with chroma scaling (LMCS) may be applied duringpicture encoding and / or reconstruction.

[68] The filter 260 may improve subjective / objective image quality by applying filtering tothe reconstructed signal. For example, the filter 260 may generate a modified reconstructedpicture by applying various filtering methods to the reconstructed picture and store themodified reconstructed picture in the memory 270, specifically, a DPB of the memory 270.The various filtering methods may include, for example, deblocking filtering, a sampleadaptive offset, an adaptive loop filter, a bilateral filter, and the like. The filter 260 maygenerate various kinds of information related to the filtering and transmit the generatedinformation to the entropy encoder 240 as described later in the description of each filteringmethod. The information related to the filtering may be encoded by the entropy encoder 240and output in the form of a bitstream.

[69] The modified reconstructed picture transmitted to the memory 270 may be used as thereference picture in the inter predictor 221. When the inter prediction is applied through theencoding apparatus, prediction mismatch between the encoding apparatus 200 and thedecoding apparatus may be avoided and encoding efficiency may be improved.

[70] The DPB of the memory 270 DPB may store the modified reconstructed picture foruse as a reference picture in the inter predictor 221. The memory 270 may store the motioninformation of the block from which the motion information in the current picture is derived(or encoded) and / or the motion information of the blocks in the picture that have already beenreconstructed. The stored motion information may be transmitted to the inter predictor 221and used as the motion information of the spatial neighboring block or the motion informationof the temporal neighboring block. The memory 270 may store reconstructed samples ofreconstructed blocks in the current picture and may transfer the reconstructed samples to theintra predictor 222.

[71] FIG. 3 is a diagram schematically explaining a configuration of a video / imagedecoding apparatus to which exemplary embodiments of the present disclosure are applicable.Hereinafter, the decoding apparatus may include an image decoding apparatus and / or a videodecoding apparatus.

[72] Referring to FIG. 3, the decoding apparatus 300 may include an entropy decoder 310,a residual processor 320, a predictor 330, an adder 340, a filter 350, and a memory 360. Thepredictor 330 may include an inter predictor 331 and an intra predictor 332. The residualprocessor 320 may include a dequantizer 321 and an inverse transformer 321. The entropydecoder 310, the residual processor 320, the predictor 330, the adder 340, and the filter 350may be configured by a hardware component (ex. A decoder chipset or a processor)according to an embodiment. In addition, the memory 360 may include a decoded picturebuffer (DPB) or may be configured by a digital storage medium. The hardware componentmay further include the memory 360 as an internal / external component.

[73] When a bitstream including video / image information is input, the decoding apparatus300 may reconstruct an image corresponding to a process in which the video / image informationis processed in the encoding apparatus of FIG. 2. For example, the decoding apparatus 300may derive units / blocks based on block partition related information obtained from thebitstream. The decoding apparatus 300 may perform decoding using a processor applied inthe encoding apparatus. Thus, the processor of decoding may be a coding unit, for example,and the coding unit may be partitioned according to a quad tree structure, binary tree structureand / or ternary tree structure from the coding tree unit or the largest coding unit. One or moretransform units may be derived from the coding unit. The reconstructed image signal decodedand output through the decoding apparatus 300 may be reproduced through a reproducingapparatus.

[74] The decoding apparatus 300 may receive a signal output from the encoding apparatusof FIG. 2 in the form of a bitstream, and the received signal may be decoded through the entropydecoder 310. For example, the entropy decoder 310 may parse the bitstream to deriveinformation (ex. video / image information) necessary for image reconstruction (or picturereconstruction). The video / image information may further include information on variousparameter sets such as an adaptation parameter set (APS), a picture parameter set (PPS), asequence parameter set (SPS), or a video parameter set (VPS). In addition, the video / imageinformation may further include general constraint information. The decoding apparatus mayfurther decode picture based on the information on the parameter set and / or the generalconstraint information. Signaled / received information and / or syntax elements described laterin the present disclosure may be decoded may decode the decoding procedure and obtainedfrom the bitstream. For example, the entropy decoder 310 decodes the information in thebitstream based on a coding method such as exponential Golomb coding, CAVLC, or CABAC,and output syntax elements required for image reconstruction and quantized values oftransform coefficients for residual. More specifically, the CABAC entropy decoding methodmay receive a bin corresponding to each syntax element in the bitstream, determine a contextmodel using a decoding target syntax element information, decoding information of a decodingtarget block or information of a symbol / bin decoded in a previous stage, and perform anarithmetic decoding on the bin by predicting a probability of occurrence of a bin according tothe determined context model, and generate a symbol corresponding to the value of each syntaxelement. In this case, the CABAC entropy decoding method may update the context modelby using the information of the decoded symbol / bin for a context model of a next symbol / binafter determining the context model. The information related to the prediction among theinformation decoded by the entropy decoder 310 may be provided to the predictor (the interpredictor 332 and the intra predictor 331), and the residual value on which the entropy decodingwas performed in the entropy decoder 310, that is, the quantized transform coefficients andrelated parameter information, may be input to the residual processor 320. The residualprocessor 320 may derive the residual signal (the residual block, the residual samples, theresidual sample array). In addition, information on filtering among information decoded bythe entropy decoder 310 may be provided to the filter 350. Meanwhile, a receiver (not shown)for receiving a signal output from the encoding apparatus may be further configured as aninternal / external element of the decoding apparatus 300, or the receiver may be a componentof the entropy decoder 310. Meanwhile, the decoding apparatus according to the presentdisclosure may be referred to as a video / image / picture decoding apparatus, and the decodingapparatus may be classified into an information decoder (video / image / picture informationdecoder) and a sample decoder (video / image / picture sample decoder). The informationdecoder may include the entropy decoder 310, and the sample decoder may include at least oneof the dequantizer 321, the inverse transformer 322, the adder 340, the filter 350, the memory360, the inter predictor 332, and the intra predictor 331.

[75] The dequantizer 321 may dequantize the quantized transform coefficients and outputthe transform coefficients. The dequantizer 321 may rearrange the quantized transformcoefficients in the form of a two-dimensional block form. In this case, the rearrangement maybe performed based on the coefficient scanning order performed in the encoding apparatus.The dequantizer 321 may perform dequantization on the quantized transform coefficients byusing a quantization parameter (ex. quantization step size information) and obtain transformcoefficients.

[76] The inverse transformer 322 inversely transforms the transform coefficients to obtaina residual signal (residual block, residual sample array).

[77] The predictor 330 may perform prediction on the current block and generate apredicted block including prediction samples for the current block. The predictor 330 maydetermine whether intra prediction or inter prediction is applied to the current block based onthe information on the prediction output from the entropy decoder 310 and may determine aspecific intra / inter prediction mode.

[78] The predictor 330 may generate a prediction signal based on various predictionmethods described below. For example, the predictor 330 may not only apply intra predictionor inter prediction to predict one block but also simultaneously apply intra prediction and interprediction. This may be called combined inter and intra prediction (CIIP). In addition, thepredictor 330 may be based on an intra block copy (IBC) prediction mode or a palette modefor prediction of a block. The IBC prediction mode or palette mode may be used for contentimage / video coding of a game or the like, for example, screen content coding (SCC). TheIBC basically performs prediction in the current picture but may be performed similarly to interprediction in that a reference block is derived in the current picture. That is, the IBC may useat least one of the inter prediction techniques described in the present disclosure. The palettemode may be considered as an example of intra coding or intra prediction. When the palettemode is applied, a sample value within a picture may be signaled based on information on thepalette table and the palette index.

[79] The intra predictor 331 may predict the current block by referring to the samples in thecurrent picture. The referred samples may be located in the neighborhood of the current blockor may be located apart according to the prediction mode. In the intra prediction, predictionmodes may include a plurality of non-directional modes and a plurality of directional modes.The intra predictor 331 may determine the prediction mode applied to the current block byusing a prediction mode applied to a neighboring block. The intra predictor 331 may predictthe current block by referring to the samples in the current picture. The referenced samplesmay be located in the neighborhood of the current block or may be located apart according tothe prediction mode. In intra prediction, prediction modes may include a plurality of nondirectional modes and a plurality of directional modes. The intra predictor 331 may determinethe prediction mode applied to the current block by using the prediction mode applied to theneighboring block.

[80] The inter predictor 332 may derive a predicted block for the current block based on areference block (reference sample array) specified by a motion vector on a reference picture.In this case, in order to reduce the amount of motion information transmitted in the interprediction mode, motion information may be predicted in units of blocks, subblocks, orsamples based on correlation of motion information between the neighboring block and thecurrent block. The motion information may include a motion vector and a reference pictureindex. The motion information may further include inter prediction direction (L0 prediction,L1 prediction, Bi prediction, etc.) information. In the case of inter prediction, the neighboringblock may include a spatial neighboring block present in the current picture and a temporalneighboring block present in the reference picture. For example, the inter predictor 332 mayconfigure a motion information candidate list based on neighboring blocks and derive a motionvector of the current block and / or a reference picture index based on the received candidateselection information. Inter prediction may be performed based on various prediction modes,and the information on the prediction may include information indicating a mode of interprediction for the current block.

[81] The adder 340 may generate a reconstructed signal (reconstructed picture,reconstructed block, reconstructed sample array) by adding the obtained residual signal to theprediction signal (predicted block, prediction sample array) output from the predictor(including the inter predictor 332 and / or the intra predictor 331). If there is no residual forthe block to be processed, such as when the skip mode is applied, the predicted block may beused as the reconstructed block.

[82] The adder 340 may be called reconstructor or a reconstructed block generator. Thegenerated reconstructed signal may be used for intra prediction of a next block to be processedin the current picture, may be output through filtering as described below, or may be used forinter prediction of a next picture.

[83] Meanwhile, luma mapping with chroma scaling (LMCS) may be applied in the picturedecoding process.

[84] The filter 350 may improve subjective / objective image quality by applying filtering tothe reconstructed signal. For example, the filter 350 may generate a modified reconstructedpicture by applying various filtering methods to the reconstructed picture and store themodified reconstructed picture in the memory 360, specifically, a DPB of the memory 360.The various filtering methods may include, for example, deblocking filtering, a sampleadaptive offset, an adaptive loop filter, a bilateral filter, and the like.

[85] The (modified) reconstructed picture stored in the DPB of the memory 360 may beused as a reference picture in the inter predictor 332. The memory 360 may store the motioninformation of the block from which the motion information in the current picture is derived(or decoded) and / or the motion information of the blocks in the picture that have already beenreconstructed. The stored motion information may be transmitted to the inter predictor 332so as to be utilized as the motion information of the spatial neighboring block or the motioninformation of the temporal neighboring block. The memory 360 may store reconstructedsamples of reconstructed blocks in the current picture and transfer the reconstructed samplesto the intra predictor 331.

[86] In the present disclosure, the embodiments described in the filter 260, the interpredictor 221, and the intra predictor 222 of the encoding apparatus 200 may be the same as orrespectively applied to correspond to the filter 350, the inter predictor 332, and the intrapredictor 331of the decoding apparatus 300. The same may also apply to the unit 332 and theintra predictor 331.

[87] As described above, in performing video coding, a prediction is performed to enhancecompression efficiency. A predicted block including prediction samples for a current block,that is, a target coding block, may be generated through the prediction. In this case, thepredicted block includes the prediction samples in a spatial domain (or pixel domain). Thepredicted block is identically derived in the encoding apparatus and the decoding apparatus.The encoding apparatus may enhance image coding efficiency by signaling, to the decodingapparatus, information on a residual (residual information) between the original block not anoriginal sample value itself of the original block and the predicted block. The decodingapparatus may derive a residual block including residual samples based on the residualinformation, may generate a reconstructed including reconstructed samples by adding theresidual block and the predicted block, and may generate a reconstructed picture including thereconstructed blocks.

[88] The residual information may be generated through a transform and quantizationprocedure. For example, the encoding apparatus may derive the residual block between theoriginal block and the predicted block, may derive transform coefficients by performing atransform procedure on the residual samples (residual sample array) included in the residualblock, may derive quantized transform coefficients by performing a quantization procedure onthe transform coefficients, and may signal related residual information to the decodingapparatus (through a bitstream). In this case, the residual information may includeinformation, such as value information, location information, transform scheme, transformkernel, and quantization parameter of the quantized transform coefficients. The decodingapparatus may perform a dequantization / inverse transform procedure based on the residualinformation, and may derive residual samples (or residual block). The decoding apparatusmay generate a reconstructed picture based on the predicted block and the residual block.Furthermore, the encoding apparatus may derive a residual block by dequantizing / inversetransforming the quantized transform coefficients for reference to the inter prediction of asubsequent picture, and may generate a reconstructed picture.

[89] In the present disclosure, at least one of the quantization / the dequantization and / or thetransform / the inverse transform may be omitted. If the quantization / dequantization areomitted, the quantized transform coefficient may be referred to as a transform coefficient. Ifthe transform / the inverse transform are omitted, the transform coefficient may also be referredto as a coefficient or a residual coefficient, or for unity of expression, also be still referred toas the transform coefficient.

[90] Further, in the present disclosure, the quantized transform coefficient and the transformcoefficient may be referred to as a transform coefficient and a scaled transform coefficient,respectively. In this case, the residual information may include information about thetransform coefficient(s), and the information about the transform coefficient(s) may be signaledthrough a residual coding syntax. The transform coefficients may be derived based on theresidual information (or the information about the transform coefficient(s)), and the scaledtransform coefficients may be derived through the inverse transform (scaling) for the transformcoefficients. The residual samples may be derived based on the inverse transform (transform)for the scaled transform coefficients. This may be likewise applied to / expressed in other partsof the present disclosure.

[91] FIG. 4 exemplarily illustrates a hierarchical structure for the coded video / image.

[92] Referring to FIG. 4, the coded video / image may be classified into a video coding layer(VCL) which deals with a decoding processing of videos / images and themselves, a subsystemfor transmitting and storing encoded information, and a network abstraction layer which existsbetween the VCL and the subsystem and is in charge of a network adaption function.

[93] For example, in the VCL, VCL data including compressed image data (slice data) maybe generated or a parameter set including a picture parameter set (PPS), a sequence parameterset (SPS), a video parameter set (VPS), or a supplemental enhancement information (SEI)message additionally necessary for the image decoding process may be generated.

[94] Further, for example, in the NAL, an NAL unit may be generated by adding headerinformation (NAL unit header) to a raw byte sequence payload (RBSP) generated in the VCL.In this case, the RBSP may refer to the slice data, parameter set, and SEI message generated inthe VCL. The NAL unit header may include NAL unit type information designated accordingto the RBSP data included in the corresponding NAL unit.

[95] Further, for example, as illustrated in FIG. 4, the NAL unit may be classified into aVCL NAL unit and a non-VCL NAL unit according to the RBSP generated in the VCL. TheVCL NAL unit may mean the NAL unit including information about the image (slice data),and the non-VCL NAL unit may mean the NAL unit including information necessary for theimage decoding (parameter set or SEI message).

[96] The aforementioned VCL NAL unit and non-VCL NAL unit may be transmittedthrough a network by attaching header information according to a data standard of thesubsystem. For example, the NAL unit may be transformed into a predetermined data formatof the standard, such as H.266 / VVC file format, a real-time transport protocol (RTP), or atransport stream (TS), and transmitted through various networks.

[97] Further, as described above, a NAL unit type may designated for the NAL unitaccording to a data structure of the RBSP included in the corresponding NAL unit, and theinformation about the NAL unit type may be stored in and signaled to the NAL unit header.

[98] For example, the NAL unit may be classified into a VCL NAL unit type and a nonVCL NAL unit type according to whether to include the information about the image (slicedata). Further, the VCL NAL unit type may be classified according to the property and typeof picture included in the VCL NAL unit, and the non-VCL NAL unit type may be classifiedaccording to the type of parameter set.

[99] The following description may be an example of the NAL unit type designatedaccording to the type of parameter set included in the non-VCL NAL unit type.

[100] - An adaptation parameter set (APS) NAL unit: Type for the NAL unit including theAPS

[101] - A decoding parameter set (DPS) NAL unit: Type for the NAL unit including the DPS

[102] - A video parameter set (VPS) NAL unit: Type for the NAL unit including the VPS

[103] - A sequence parameter set (SPS) NAL unit: Type for the NAL unit including the SPS

[104] - A picture parameter set (PPS) NAL unit: Type for the NAL unit including the PPS

[105] - A picture header (PH) NAL unit: Type for the NAL unit including the PH

[106] The aforementioned NAL unit types may have syntax information about the NAL unittype, and the syntax information may be stored in and signaled to the NAL unit header. Forexample, the syntax information may be nal_unit_type, and the NAL unit type may bedesignated as a value of the nal_unit_type.

[107] Meanwhile, as described above, one picture may include a plurality of slices, and theslice may include a slice header and a slice data. In this case, one picture header may be addedto (embedded in) the plurality of slices (a set of the slice header and the slice data). Thepicture header (picture header syntax) may include information / parameters commonlyapplicable to the picture. The slice header (slice header syntax) may includeinformation / parameters commonly applicable to the slice. The APS (APS syntax) or the PPS(PPS syntax) may include information / parameters commonly applicable to one or more slicesor pictures. The SPS (SPS syntax) may include information / parameters commonly applicableto one or more sequences. The VPS (VPS syntax) may include information / parameterscommonly applicable to a plurality of layers. The DPS (DPS syntax) may includeinformation / parameters commonly applicable to the entire image. The DPS may includeinformation / parameters related to the concatenation of a coded video sequence (CVS). In thepresent disclosure, a high level syntax (HLS) may include at least one of the APS syntax, thePPS syntax, the SPS syntax, the VPS syntax, the DPS syntax, the picture header syntax, andthe slice header syntax.

[108] Meanwhile, as described above, one NAL unit type may be generally set for onepicture, and as described above, the NAL unit type may be signaled through the nal_unit_typein the NAL unit header of the NAL unit including the slice. The following Table expressesan example of NAL unit type codes an NAL unit type classes.

[109] [Table 1]

[110]

[111] In this regard, a clean random access (CRA) picture may be related to a random accessskipped leading (RASL) picture or a random access decodable leading (RADL) picture, whichexists in a bitstream. An instantaneous decoding refresh (IDR) picture with the samenal unit type as that of the variable IDR NLP does not have a related leading picture in thebitstream. In other words, the IDR picture with the same nal unit type as that of the variableIDR W RADL does not have a related RASL picture in the bitstream, but may have a relatedRADL picture. The IDR picture is an IRAP picture in which each VCLNAL unit has thesame nal unit type as that of the IDRA WRADL or the IDRNLP.

[112] In performing the decoding procedure, the IDR picture does not use the inter predictionand may be a picture whose decoding order in the bitstream is first. Alternatively, the IDRpicture may appear in the bitstream later. Each IDR picture may be a picture whose decodingorder in the CVS may be first. The IDR picture in which each VCL_NAL unit has the samenalunittype as that of the IDR WRADL may have the related RADL picture. The IDRpicture in which each VCL_NAL unit has the same nal unit type as that of the IDR NLPdoes not have the related leading picture. In other words, the IDR picture does not have therelated RASL pictures.

[113] In the present disclosure, the video / image information encoded from the encodingapparatus to the decoding apparatus and signaled in the form of the bitstream may includeinformation included in the slice header, information included in the picture header,information included in the APS, information included in the PPS, information included in theSPS, information included in the VPS, and / or information included in the DPS as well aspartitioning-related information in the picture, intra / inter prediction information, residualinformation, and in-loop filtering information. Further, the video / image information mayfurther include information of the NAL unit header.

[114] Meanwhile, a bitstream (or temporal scalable bitstream) supporting temporalscalability includes information on a temporally scaled temporal layer. The information onthe temporal layer may be identification information of a temporal layer specified according tothe temporal scalability of an NAL unit. For example, temporal_id syntax information maybe used for temporal layer identification information, and the temporal_id syntax informationmay be stored in a NAL unit header in an encoding apparatus and signaled to a decodingapparatus. Hereinafter, in the present disclosure, the temporal layer may also be referred toas a sub-layer, a temporal sub-layer, or a temporal scalable layer.

[115] FIG. 5 is a diagram illustrating a temporal layer structure for NAL units in a bitstreamsupporting temporal scalability.

[116] When the bitstream supports temporal scalability, NAL units included in the bitstreamhave identification information (e.g., temporal_id) of a temporal layer. As an example, atemporal layer including NAL units having a temporal_id value of 0 may provide the lowesttemporal scalability, and a temporal layer including NAL units having a temporal_id value of2 may provide the highest temporal scalability.

[117] In FIG. 5, a box marked with I refers to an I picture, and a box marked with B refersto a B picture. In addition, arrows indicate a reference relationship with respect to whether apicture refers to another picture.

[118] As shown in FIG. 5, NAL units of a temporal layer having a temporal_id value of 0are reference pictures that may be referenced by NAL units of a temporal layer having atemporal_id value of 0, 1, or 2. NAL units of a temporal layer having a temporal_id value of1 are reference pictures that may be referenced by NAL units of a temporal layer having atemporal_id value of 1 or 2. NAL units of a temporal layer having a temporal_id value of 2may be reference pictures that may be referenced by NAL units of the same temporal layer,that is, a temporal layer having a temporal_id value of 2, or may be non-reference pictures thatare not referenced by other pictures.

[119] If, as shown in FIG. 5, NAL units of a temporal layer having a temporal_id value of 2,that is, the uppermost temporal layer, are non-reference pictures, these NAL units may beextracted (or removed) from a bitstream without affecting other pictures in a decoding process.

[120] If the inter prediction is applied, the predictors of the encoding apparatus / the decodingapparatus may derive the prediction samples by performing the inter prediction in units of block.The inter prediction may be a prediction derived in a manner that is dependent on data elements(e.g., sample values or motion information) of the picture(s) other than the current picture. Ifthe inter prediction is applied to the current block, a predicted block (prediction sample array)for the current block may be induced based on a reference block (reference sample array)specified by the motion vector on the reference picture indicated by the reference picture index.At this time, to reduce an amount of the motion information transmitted in the inter predictionmode, the motion information of the current block may be predicted in units of block, subblock,or sample based on the correlation of the motion information between the neighboring blockand the current block. The motion information may include the motion vector and thereference picture index. The motion information may further include inter prediction type(L0 prediction, L1 prediction, and Bi prediction) information. If the inter prediction is applied,the neighboring block may include a spatial neighboring block existing in the current pictureand a temporal neighboring block existing in the reference picture. The reference pictureincluding the reference block and the reference picture including the temporal neighboringblock may also be the same, and also be different. The temporal neighboring block may bereferred to as a collocated reference block or a collocated CU (colCU), and the reference pictureincluding the temporal neighboring block may be referred to as a collocated picture (colPic).For example, a motion information candidate list may be constituted based on the neighboringblocks of the current block, and a flag or index information indicating which candidate isselected (used) to derive the motion vector of the current block and / or the reference pictureindex may be signaled. The inter prediction may be performed based on various predictionmodes, and for example, in the skip mode and the merge mode, the motion information of thecurrent block may be the same as the motion information of the selected neighboring block.In the skip mode, the residual signal may not be transmitted unlike in the merge mode. In themotion vector prediction (MVP) mode, the motion vector of the selected neighboring blockmay be used as a motion vector predictor, and a motion vector difference may be signaled. Inthis case, the motion vector of the current block may be derived by using the sum of the motionvector predictor and the motion vector difference.

[121] The motion information may include L0 motion information and / or L1 motioninformation according to the inter prediction types (L0 prediction, L1 prediction, and Biprediction). A motion vector in an L0 direction may be referred to as an L0 motion vector oran MVL0, and a motion vector in an L1 direction may be referred to as an L1 motion vector oran MVL1. A prediction based on the L0 motion vector may be referred to as the L0 prediction,a prediction based on the L1 motion vector may be referred to as the L1 prediction, and aprediction based on both the L0 motion vector and the L1 motion vector may be referred to asthe Bi prediction. Here, the L0 motion vector may refer to a motion vector associated with areference picture list L0 (L0), and the L1 motion vector may refer to a motion vector associatedwith a reference picture list L1 (L1). The reference picture list L0 may include pre-picturesof the current picture on the output order as the reference pictures, and the reference picturelist L1 may include post-pictures of the current picture on the output order. The pre-picturesmay be referred to as a forward (reference) picture, and the post-pictures may be referred to asa backward (reference) picture. The reference picture list L0 may further include the postpictures of the current picture as the reference pictures on the output order. In this case, in thereference picture list L0, the pre-pictures may be first indexed and then the post-pictures maybe indexed. The reference picture list L1 may further include the pre-pictures of the currentpicture on the output order as the reference pictures. In this case, in the reference picture listL1, the post-pictures may be first indexed and then the pre-pictures may be indexed. Here,the output order may correspond to a picture order count (POC) order.

[122] A video / image encoding procedure based on the inter prediction may schematicallyinclude the following description, for example.

[123] FIG 6 illustrate a video / image encoding method based on the inter prediction.

[124] Referring to FIG 6, the encoding apparatus performs inter prediction for a currentblock (S600). The encoding apparatus may derive an inter prediction mode and motioninformation of the current block and generate prediction samples of the current block. Here,procedures of determining the inter prediction mode, deriving the motion information, andgenerating the prediction samples may also be simultaneously performed, and any oneprocedure may also be performed prior to other procedures. For example, the inter predictorof the encoding apparatus may include a prediction mode determination unit, a motioninformation derivation unit, and a prediction sample derivation unit, in which the predictionmode determination unit may determine the prediction mode for the current block, the motioninformation derivation unit may derive the motion information of the current block, and theprediction sample derivation unit may derive the prediction samples of the current block. Forexample, the inter predictor of the encoding apparatus may search for a block similar to thecurrent block in a certain region (search region) of the reference pictures through motionestimation and derive a reference block in which a difference with the current block isminimum or a certain standard or less. Based on the above, the reference picture indexindicating the reference picture at which the reference block is located may be derived, and themotion vector may be derived based on a difference between locations of the reference blockand the current block. The encoding apparatus may determine a mode applied to the currentblock among various prediction modes. The encoding apparatus may compare RD costs forvarious prediction modes and determine an optimal prediction mode for the current block.

[125] For example, if the skip mode or the merge mode is applied to the current block, theencoding apparatus may constitute a merge candidate list to be described later and derive areference block in which a difference with the current block is minimum or a certain standardor less among the reference blocks indicated by merge candidates included in the mergecandidate list. In this case, the merge candidate associated with the derived reference blockmay be selected, and the merge index information indicating the selected merge candidate maybe generated to be signaled to the decoding apparatus. The motion information of the currentblock may be derived by using the motion information of the selected merge candidate.

[126] As another example, if the (A)MVP mode is applied to the current block, the encodingapparatus may constitute an (A)MVP candidate list to be described later and use the motionvector of the selected mvp candidate among the motion vector predictor (mvp) candidatesincluded in the (A)MVP candidate list as an mvp of the current block. In this case, forexample, the motion vector indicating the reference block derived by the aforementionedmotion estimation may be used as the motion vector of the current block, and an mvp candidatehaving the motion vector having the smallest difference with the motion vector of the currentblock among the mvp candidates may become the selected mvp candidate. The motion vectordifference (MVD), which is a difference obtained by subtracting the mvp from the motionvector of the current block, may be derived. In this case, information about the MVD may besignaled to the decoding apparatus. Further, if the (A)MVP mode is applied, a value of thereference picture index may be composed of reference picture index information and separatelysignaled to the decoding apparatus.

[127] The encoding apparatus may derive residual samples based on the prediction samples(S610). The encoding apparatus may derive the residual samples through a comparisonbetween original samples and the prediction samples of the current block.

[128] The encoding apparatus encodes image information including prediction informationand residual information (S620). The encoding apparatus may output the encoded imageinformation in the form of a bitstream. The prediction information as information related tothe prediction procedure may include information about the prediction mode information (e.g.,a skip flag, a merge flag, or a mode index) and the motion information. The information aboutthe motion information may include candidate selection information (e.g., a merge index, anmvp flag, or an mvp index), which is information for deriving the motion vector. Further, theinformation about the motion information may include the aforementioned information aboutthe MVD and / or reference picture index information. Further, the information about themotion information may include information representing whether L0 prediction, L1 prediction,or B1 prediction is applied. The residual information is information about the residualsamples. The residual information may include information about quantized transformcoefficients for the residual samples.

[129] The output bitstream may be stored in a (digital) storage medium and delivered to thedecoding apparatus, or also be delivered to the decoding apparatus through a network.

[130] Meanwhile, as described above, the encoding apparatus may generate a reconstructedpicture (including reconstructed samples and a reconstructed block) based on the referencesamples and the residual samples. This is to derive the same prediction result as that obtainedby being performed by the decoding apparatus in the encoding apparatus, and as a result, it ispossible to enhance coding efficiency. Therefore, the encoding apparatus may store thereconstructed picture (or the reconstructed samples and the reconstructed block) in a memoryand use the reconstructed picture as the reference picture for the inter prediction. Asdescribed above, the in-loop filtering procedure or the like may be further applied to thereconstructed picture.

[131] The video / image decoding procedure based on the inter prediction may schematicallyinclude the following description, for example.

[132] FIG. 7 schematically illustrate examples of the video / image decoding method basedon the inter prediction and the inter predictor in the decoding apparatus.

[133] Referring to FIG. 7, the decoding apparatus may perform an operation correspondingto the operation performed by the encoding apparatus. The decoding apparatus may performthe prediction for the current block based on the received prediction information and derive theprediction samples.

[134] Specifically, the decoding apparatus may determine a prediction mode for the currentblock based on the received prediction information (S700). The decoding apparatus maydetermine which inter prediction mode is applied to the current block based on the predictionmode information in the prediction information.

[135] For example, the decoding apparatus may determine whether the merge mode isapplied to the current block or the (A)MVP mode is applied thereto based on the merge flag.Alternatively, the decoding apparatus may select one of various inter prediction modecandidates based on the mode index. The inter prediction mode candidates may include theskip mode, the merge mode, and / or the (A)MVP mode, or include various inter predictionmodes to be described later.

[136] The decoding apparatus derives motion information of the current block based on thedetermined inter prediction mode (S710). For example, if the skip mode or the merge modeis applied to the current block, the decoding apparatus may constitute a merge candidate list tobe described later and select one merge candidate of the merge candidates included in the mergecandidate list. The selection may be performed based on the aforementioned selectioninformation (merge index). The motion information of the current block may be derived byusing the motion information of the selected merge candidate. The motion information of theselected merge candidate may be used as the motion information of the current block.

[137] As another example, if the (A)MVP mode is applied to the current block, the decodingapparatus may constitute an (A)MVP candidate list to be described later and use a motionvector of a selected mvp candidate among motion vector predictor (mvp) candidates includedin the (A)MVP candidate list as an mvp of the current block. The selection may be performedbased on the aforementioned selection information (the mvp flag or the mvp index). In thiscase, an MVD of the current block may be derived based on the information about the MVD,and the motion vector of the current block may be derived based on the mvp and MVD of thecurrent block. Further, the reference picture index of the current block may be derived basedon the reference picture index information. The picture indicated by the reference pictureindex in the reference picture list about the current block may be derived as the referencepicture referenced for the inter prediction of the current block.

[138] Meanwhile, as described later, the motion information of the current block may bederived without constituting the candidate list, and in this case, the motion information of thecurrent block may be derived according to a procedure disclosed in the prediction mode to bedescribed later. In this case, the constitution of the candidate list described above may beomitted.

[139] The decoding apparatus may generate prediction samples for the current block basedon the motion information of the current block (S720). In this case, the decoding apparatusmay derive the reference picture based on the reference picture index of the current block andderive the prediction samples of the current block using the samples of the reference blockindicated by the motion vector of the current block on the reference picture. In this case, asdescribed later, a prediction sample filtering procedure for all or some of the prediction samplesof the current block may be further performed in some cases.

[140] For example, the inter predictor of the decoding apparatus may include a predictionmode determination unit, a motion information derivation unit, and a prediction samplederivation unit, in which the prediction mode determination unit may determine the predictionmode for the current block based on the received prediction mode information, the motioninformation derivation unit may derive the motion information (the motion vector and / or thereference picture index) of the current block based on the information about the motioninformation received by the motion information derivation unit, and the prediction samplederivation unit may derive the prediction samples of the current block.

[141] The decoding apparatus generates residual samples for the current block based onreceived residual information (S730). The decoding apparatus may generate reconstructedsamples for the current block based on the prediction samples and the residual samples andgenerate a reconstructed picture based on the generated reconstructed samples (S740).Thereafter, the in-loop filtering procedure or the like may be further applied to thereconstructed picture as described above.

[142] As described above, the inter prediction procedure may include determining an interprediction mode, deriving motion information according to the determined prediction mode,and performing prediction (generating a prediction sample) based on the derived motioninformation. The inter prediction procedure may be performed by the encoding apparatus andthe decoding apparatus as described above.

[143] Meanwhile, in the VVC standard, there is a signaling mechanism that allows a systemlevel entity to know whether any one picture is not used as a reference for other pictures.Through this signaling of information, a system level entity may remove a specific picture (i.e.,a picture marked not to be used as a reference for other pictures) in a specific situation. Forexample, when network congestion occurs, a media-aware network router may delete anetwork packet carrying a coded bit of a picture that is marked not to be used as a reference forother pictures.

[144] In relation to this, according to an existing embodiment, the picture header may includethe syntax of Table 2 below so that whether any one picture is not used as a reference for otherpictures may be known. The syntax of Table 2 below may be a part of the picture header.

[145] [Table 2]

[146] Here, semantics of syntax elements included in the syntax of Table 2 may be expressed,for example, as shown in Table 3 below.

[147] [Table 3]

[148] That is, according to the existing embodiment, the image information obtained througha bitstream may include a non-reference picture flag.

[149] For example, the non-reference picture flag may be related to whether a picture is notused as a reference picture. That is, the non-reference picture flag may indicate whether apicture is not used as a reference picture.

[150] As an example, the non-reference picture flag may be expressed in the form of aph non ref pic flag syntax element. For example, the ph non ref picflag syntax elementmay specify whether a picture is not used as a reference picture.

[151] According to the existing embodiment, when the value of the non-reference pictureflag is 1, it may indicate that a picture is not used as a reference picture, and when the value ofthe non-reference picture flag is 0, it may indicate that a picture is used as a reference picture.

[152] Meanwhile, according to the existing embodiment, a process for deriving a POC for acurrent picture may be as shown in Table 4 below.

[153] [Table 4]

[154]

[155] That is, the variable PicOrderCntVal may mean a POC value of the current picture.

[156] In this case, for example, when inter-layer prediction is used for the current layer (thatis, the value of the syntax element vps_independent_layer_flag is 0), the POC value of thecurrent picture may be derived based on the picture in a current access unit (AU) of thereference layer.

[157] For example, if inter-layer prediction is not used for the current layer (the value of thesyntax element vps_independent_layer_flag is 1), the POC value of the current picture may bederived based on a previous picture in a decoding order specified by a variable prevTid0Picunder certain conditions.

[158] Here, the semantics of the syntax elements included in Table 4 may be expressed, forexample, as shown in Table 5 below.

[159] [Table 5]

[160] According to the existing embodiment, image information obtained through thebitstream may include the non-reference picture flag, layer ID information, POC last significantbit (LSB) information, POC most significant bit (MSB) cycle presence flag, and POC MSBcycle information.

[161] Here, for example, the layer ID information may be related to a layer identifier towhich the NAL unit belongs. That is, the layer ID information may indicate / represent a layeridentifier to which the NAL unit belongs.

[162] For example, the layer ID information may be expressed in the form of a nuh_layer_idsyntax element. For example, the nuh_layer_id syntax element may specify a layer identifierto which a NAL unit belongs.

[163] For example, the POC LSB information may be related to a remainder obtained bydividing a POC value of a picture by MaxPicOrderCntLsb, which is a maximum value of apredetermined POC LSB. That is, the POC LSB information may indicate / represent theremainder obtained by dividing the POC value of a picture by MaxPicOrderCntLsb, which isthe maximum value of the predetermined POC LSB.

[164] As an example, the POC LSB information may be expressed in the form of aph_pic_order_cnt_lsb syntax element. For example, the ph_pic_order_cnt_lsb syntaxelement may specify a remainder obtained by dividing a POC value of a picture byMaxPicOrderCntLsb which is a maximum value of a predetermined POC LSB.

[165] For example, the POC MSB cycle presence flag may be related to the presence orabsence of POC MSB cycle information of the current picture. That is, the POC MSB cyclepresence flag may indicate / represent whether POC MSB cycle information of the currentpicture is present.

[166] As an example, the POC MSB cycle presence flag may be expressed in the form of aph_poc_msb_cycle_present_flag syntax element. For example, theph_poc_msb_cycle_present_flag syntax element may specify whether POC MSB cycleinformation of the current picture is present.

[167] For example, the POC MSB cycle information may be related to the value of the POCMSB cycle of the current picture. That is, the POC MSB cycle information mayindicate / represent the POC MSB cycle value of the current picture.

[168] For example, the POC MSB cycle information may be expressed in the form of aph_poc_msb_cycle_val syntax element. For example, the ph_poc_msb_cycle_val syntaxelement may specify a value of the POC MSB cycle of the current picture.

[169] According to the existing embodiment, a POC value (PicOrderCntVal) of the currentpicture may be derived based on a previous picture in a decoding order specified by the variableprevTid0Pic under certain conditions as described above.

[170] For example, if the value of the POC MSB cycle presence flag is 0 and the currentpicture is not a coded layer video sequence start (CLVSS) picture, the POC value of the currentpicture may be derived based on the previous picture in the decoding order specified byprevTid0Pic.

[171] Specifically, for example, the POC value (PicOrderCntVal) of the current picture maybe derived by adding a variable PicOrderCntMsb indicating the POC MSB of the currentpicture and the value of the POC LSB information of the current picture. In this case, forexample, the PicOrderCntMsb indicating the POC MSB of the current picture may be derivedbased on the variable prevPicOrderCntLsb and the variable prevPicOrderCntMsb related to theprevious picture in the decoding order specified by prevTid0Pic.

[172] In this case, for example, the variable prevPicOrderCntLsb may be set equal to thevalue of the POC LSB information for the previous picture in the decoding order specified byprevTid0Pic. Also, the variable prevPicOrderCntMsb may be set equal to the value of thevariable PicOrderCntMsb for the previous picture in the decoding order specified by thevariable prevTid0Pic.

[173] Also, for example, in the previous picture in the decoding order designated byprevTid0Pic, a value of the layer ID information is the same as a value of the layer IDinformation for the current picture, a temporal ID (TemporalId) is 0, and it may be limited topictures other than a random access skipped leading (RADL) picture or a random accessdecodable leading (RADL) picture.

[174] Here, the temporal ID (TemporalId) may be, for example, identification informationof the temporal layer described with reference to FIG. 5.

[175] Meanwhile, the POC value of the current picture may be used to construct a referencepicture set (and / or a reference picture list) for picture output and / or inter prediction. Also, forexample, decoded pictures may be output according to a POC order.

[176] FIG. 8 shows an example of a POC-based video / image encoding method. The stepsof FIG. 8 may be applied to the embodiment(s) disclosed in the present disclosure.Alternatively, the steps of FIG. 8 may be used as an example for describing a procedure relatedto the embodiment(s) disclosed in the present disclosure. Also, any one of the steps of FIG.8 may be omitted.

[177] Referring to FIG. 8, the encoding apparatus may derive POC values of referencepictures constituting a reference picture set and derive POC values of a current picture (S800).For example, when the POC values of the reference pictures and the POC value of the currentpicture are derived, the encoding apparatus may perform inter prediction based on the referencepicture set. For example, the reference picture set may be replaced with a reference picturelist. For example, the encoding apparatus may derive POC values of the reference picturesconstituting the reference picture list, and may derive the POC values of the current picture.

[178] Also, as an example, the reference picture list may include a reference picture list 0(L0) and a reference picture list 1 (L1). Here, the reference picture list 0 may include areference picture having a smaller POC value than the POC of the current picture. Thereference picture list 1 may include a reference picture having a POC value greater than that ofthe current picture.

[179] The encoding apparatus may generate POC information (S810). For example, theencoding apparatus may generate the POC information based on POC values of the referencepictures and POC values of the current picture. The encoding apparatus may encodevideo / image information including POC information (S820).

[180] For example, the video / image information may include high level syntax (HLS).Also, the high level syntax may include the POC information. The POC information mayinclude POC-related information and syntax elements presented in embodiments of the presentdisclosure.

[181] For example, the POC information may include POC information related to the currentpicture, POC information related to a previous picture in decoding order for deriving the POCof the current picture, or POC information related to reference picture(s).

[182] For example, the POC information may include at least one of a syntax elementph_non_reference_picture_flag, a syntax element ph_non_reference_picture_flag, a syntaxelement ph_poc_msb_cycle_present_flag, a syntax element ph_poc_msb_cycle_val, and / or asyntax element ph_pic_order_cnt_lsb.

[183] FIG. 9 shows an example of a POC-based video / image decoding method. The stepsin FIG. 9 may be applied to the embodiment(s) disclosed in the present disclosure.Alternatively, the steps of FIG. 9 may be used as an example for describing a procedure relatedto the embodiment(s) disclosed in the present disclosure. Also, any one of the steps of FIG.may be omitted.

[184] Referring to FIG. 9, the decoding apparatus obtains video / image information includingPOC information from a bitstream (S900). For example, the video / image information mayinclude high level syntax. Also, the high level syntax may include POC information. ThePOC information may include POC-related information and syntax elements presented inembodiments of the present disclosure.

[185] For example, the POC information may include POC information related to the currentpicture, POC information related to a previous picture in decoding order for deriving the POCof the current picture, or POC information related to reference picture(s).

[186] For example, the POC information may include at least one of a syntax elementph_non_reference_picture_flag, a syntax element ph_non_reference_picture_flag, a syntaxelement ph_poc_msb_cycle_present_flag, a syntax element ph_poc_msb_cycle_val, and / or asyntax element ph_pic_order_cnt_lsb.

[187] The decoding apparatus derives POC values of the current picture and referencepictures (S910). For example, the decoding apparatus may derive the POC value of thecurrent picture and the POC values of the reference pictures based on the POC information.For example, the POC value of the current picture may be derived based on POC informationrelated to at least one of the current picture, a variable prevPicOrderCntLsb, and a variableprevPicOrderCntMsb. Also, as an example, a POC value of an ith reference picture amongthe POC values of the reference pictures may be derived based on a POC difference valueindicated by POC information related to the reference pictures. For example, if i is 0, thePOC information related to the reference pictures may be a POC difference value between thecurrent picture and the ith reference picture. For example, if i is greater than 0, the POCinformation related to the reference pictures may be a POC difference value between the ithreference picture and an (i-1)th reference picture.

[188] The decoding apparatus constructs a reference picture set based on the POC values(S920). For example, the decoding apparatus may construct a reference picture set based onthe POC value of the current picture and the POC values of the reference pictures.

[189] The decoding apparatus derives a reference picture list based on the reference pictureset (S930). For example, the decoding apparatus may derive a reference picture list for thecurrent picture based on the reference picture set.

[190] The decoding apparatus performs inter prediction on the current picture based on thereference picture list (S940). For example, the decoding apparatus may perform interprediction on the current picture based on the reference picture list.

[191] Meanwhile, any one of the reference picture set or the reference picture list may beomitted. For example, if S930 is omitted, the decoding apparatus may perform interprediction on the current picture based on the reference picture set in S940. Or, for example,instead of S920 and S930, the decoding apparatus may construct a reference picture list basedon the POC values. As an example, the reference picture list may include a reference picturelist 0 (L0) and a reference picture list 1 (L1). Here, the reference picture list 0 may include areference picture having a smaller POC value than the POC of the current picture. Referencepicture list 1 may include a reference picture having a larger POC value than the POC of thecurrent picture.

[192] However, according to an existing embodiment, the current POC decoding processincludes a problem related to a non-reference picture. In the POC decoding process, thePicOrderCntMsb for the current picture is derived based on the POC value of the previouspicture designated as prevTid0Pic. In this case, the previous picture designated asprevTid0Pic should be the same picture in encoding and decoding so that the POC value of thecurrent picture is consistently derived. However, in determining prevTid0Pic, as prevTid0Picis a non-reference picture (the value of the syntax element ph_non_ref_pic_flag is 1), whetherit is a picture that may be removed by the system entity is not considered. If the picturedesignated as prevTid0Pic for the current picture is removed by the system and does not existin the bitstream, the decoder may unconsciously use a picture different from the previouspicture in the encoder as prevTid0Pic to derive the POC value of the current picture. As aresult, there is a problem that the decoder may derive an incorrect POC value.

[193] In this regard, embodiments of the present disclosure may include one or more of thefollowing features.

[194] 1) In the POC decoding process, a picture designated as prevTid0Pic may be restrictedso that it cannot be a picture in which the value of ph_non_ref_pic_flag is 1.

[195] 2) The value of ph_non_ref_pic_flag of a picture having a TemporalId of 0 may belimited so that it cannot be 1.

[196] 3) When the Coded Layer Video Sequence (CLVS) has a plurality of temporal sublayers, pictures in the base temporal sub-layer (that is, pictures having TemporalId of 0) maybe limited not to have a value of ph_non_ref_pic_flag equal to 1.

[197] 4) When the CLVS includes only pictures other than intra pictures (that is, the valueof intra_only_constraint_flag is equal to 1), a picture having a TemporalId of 0 may be limitednot to have a value of ph_non_ref_pic_flag as 1.

[198] 5) When the CLVS includes only pictures that are not intra pictures (that is, the valueof intra_only_constraint_flag is equal to 1) and there are a plurality of temporal sub-layers inthe CLVS, a picture having a TemporalId of 0 may be limited not to have a value ofph_non_ref_pic_flag as 1.

[199] 6) In the case of two consecutive pictures in which TemporalId is 0 and the value ofph_non_ref_pic_flag is 0, an absolute value of the POC difference between the two consecutivepictures may be limited not to be greater than half of MaxPicOrderCntLsb.

[200] 7) For each picture, the absolute value of the POC difference between the currentpicture and the picture selected by prevTid0Pic may be limited not to be greater than half ofMaxPicOrderCntLsb.

[201] According to an embodiment proposed in the present disclosure, image informationobtained through a bitstream may include POC information and the non-reference picture flagaccording to the existing embodiment.

[202] For example, the POC information may include POC information of a previous picturein a decoding order with respect to the current picture.

[203] Here, as an example, the POC information of the previous picture in the decoding orderof the current picture may be related to the POC LSB information of the previous picture.That is, the POC information of the previous picture may be related to the remainder obtainedby dividing the POC value of the previous picture by MaxPicOrderCntLsb, which is themaximum value of the predetermined POC LSB. For example, the POC information of theprevious picture may be expressed in the form of a ph_pic_order_cnt_lsb syntax element forthe previous picture (prevTid0Pic).

[204] According to the embodiment, the POC derivation process for the current picture maybe as shown in Table 6 below.

[205] [Table 6]

[206] According to the embodiment, the POC value of the current picture may be derivedbased on the POC value of the previous picture in decoding order.

[207] For example, as in the existing embodiment, when the value of the POC MSB cyclepresence flag is 0 and the current picture is not a CLVSS picture, the POC value of the currentpicture may be derived based the previous picture in the decoding order specified asprevTid0Pic.

[208] Also, for example, in the previous picture in the decoding order designated asprevTid0Pic, as in the previous embodiment, the value of the layer ID information may be thesame as the value of the layer ID information for the current picture, the temporal ID(TemporalId) may be 0, and the previous picture may be limited to a RASL picture or a nonRADL picture.

[209] In addition, according to the embodiment, the previous picture in the decoding orderfor deriving the POC value of the current picture may be limited to a picture in which the valueof the non-reference picture flag is 0. According to the embodiment, the picture in which thevalue of the non-reference picture flag is 1 cannot be designated as the previous picture indecoding order.

[210] According to the embodiment proposed in the present disclosure, the POC informationmay further include a delta POC MSB cycle presence flag and delta POC MSB cycle long term(LT) information.

[211] For example, the delta POC MSB cycle presence flag may be related to the presenceof delta POC MSB cycle long term (LT) information for a long-term reference picture. Thatis, the delta POC MSB cycle presence flag may indicate / represent whether delta POC MSBcycle LT information for a long-term reference picture exists.

[212] For example, the delta POC MSB cycle presence flag may be expressed in the form ofa delta_poc_msb_cycle_present_flag syntax element. For example, thedelta_poc_msb_cycle_present_flag syntax element may specify whether delta POC MSB cycleLT information for a long-term reference picture exists.

[213] For example, the delta POC MSB cycle LT information may be related to the POCMSB of the long-term reference picture. That is, the delta POC MSB cycle LT informationmay be a value for calculating the POC MSB of the long-term reference picture.

[214] For example, the delta POC MSB cycle LT information may be expressed in the formof a delta_poc_msb_cycle_lt syntax element. For example, the delta_poc_msb_cycle_ltsyntax element may specify a value for calculating the POC MSB of the long-term referencepicture.

[215] According to the embodiment, when the value of the delta POC MSB cycle presenceflag is 1, the POC information may further include the delta POC MSB cycle LT information.When the value of the delta POC MSB cycle presence flag is 0, the delta POC MSB cycle LTinformation may not exist.

[216] Also, according to the embodiment, the POC value of the long-term reference picturemay be derived based on at least one of the delta POC MSB cycle presence flag and the deltaPOC MSB cycle LT information.

[217] Also, according to the embodiment, in a case in which the POC value of the long-termreference picture may be derived based on at least one of the delta POC MSB cycle presenceflag and the delta POC MSB cycle LT information and there are more than one specific POCvalue in which the remainder obtained by dividing MaxPicOrderCntLsb which is the maximumvalue of the POC LSB predetermined in the previous picture POC set is the same as the POCLSB of the long-term reference picture, the value of the delta POC MSB cycle presence flagmay be limited to 1.

[218] Alternatively, according to the embodiment, in a case in which the POC value of thelong-term reference picture may be derived based on at least one of the delta POC MSB cyclepresence flag and the delta POC MSB cycle LT information and there are more than onespecific POC value in which the remainder obtained by dividing MaxPicOrderCntLsb whichis the maximum value of the POC LSB predetermined in the previous picture POC set is thesame as the POC LSB of the long-term reference picture, the value of the delta POC MSBcycle presence flag may be limited to 1.

[219] At this time, according to the embodiment, the previous picture POC set may includethe POC value of the previous picture in the decoding order for the current picture, the POCvalue of each reference picture having the same layer ID as the current picture in the referencepicture list for the previous picture, and a POC value of each picture that follows the previouspicture and precedes the current picture in decoding order and has the same layer ID as thecurrent picture.

[220] According to the embodiment, the semantics of the delta POC MSB cycle presenceflag may be expressed, for example, as shown in Table 7 below.

[221] [Table 7]

[222] In addition, according to an embodiment proposed in the present disclosure, thevariable maxPicOrderCnt and the variable minPicOrderCnt may be set to maximum andminimum values of the POC values of specific pictures, respectively. For example, thespecific pictures may be shown in Table 8 below.

[223] [Table 8]

[224] That is, according to the embodiment, a maximum value of the POC value for thespecific pictures may be set to the same value for each of the specific pictures, and the minimumvalue of the POC value for the specific pictures may be set to the same value for each of thespecific pictures.

[225] In this case, for example, the specific pictures having the same layer ID as the layer IDof the current picture may have a TemporalId of 0, may have a value of the non-referencepicture flag of 0, and may include a previous picture in decoding order other than a RASL orRADL picture.

[226] That is, according to the embodiments described above, the previous picture in thedecoding order designated as prevTid0Pic for deriving the POC value of the current picturemay be limited to a picture in which the value of the non-reference picture flag is 0. Throughthis, the encoder and the decoder may support the same picture designated as prevTid0Pic, andas a result, it is possible to prevent the POC value for the current picture from being erroneouslyderived in the decoding process.

[227] In addition, according to the embodiment proposed in the present disclosure, a POCdifference value between the current picture and the previous picture in the decoding order forderiving the POC value of the current picture may be smaller than a half value ofMaxPicOrderCntLsb which is the maximum value of the predetermined POC LSB.

[228] Alternatively, according to an embodiment proposed in the present disclosure, thePOC difference value between the current picture and the previous picture in the decodingorder for deriving the POC value of the current picture may not be larger than the half value ofMaxPicOrderCntLsb which is the maximum value of the predetermined POC LSB.

[229] That is, according to the above-described embodiments, the POC difference valuebetween the previous picture and the current picture in the decoding order specified asprevTid0Pic for deriving the POC value of the current picture may be limited to be less thanhalf of MaxPicOrderCntLsb. Through this, an error due to network congestion may beprevented and an accurate POC value may be derived.

[230] According to an embodiment proposed in the present disclosure, the semantics of thenon-reference picture flag included in the syntax of Table 1 may be represented, for example,as shown in Table 9 below.

[231] [Table 9]

[232] That is, when the temporal ID (TemporalId) of the current picture is 0, the value of thenon-reference picture flag for the current picture may be limited not to be 1.

[233] According to the embodiment proposed in the present disclosure, the semantics of thenon-reference picture flag included in the syntax of Table 1 may be represented, for example,as shown in Table 10 below.

[234] [Table 10]

[235] That is, when the current coded layer video sequence (CLVS) includes a plurality oftemporal sub-layers and the temporal ID (TemporalId) of the current picture is 0, the value ofthe non-reference picture flag for the current picture may be limited not to be 1.

[236] According to the embodiment proposed in the present disclosure, the semantics of thenon-reference picture flag included in the syntax of Table 1 may be represented, for example,as shown in Table 11 below.

[237] [Table 11]

[238] That is, according to the embodiment, the image information may further includemaximum sub-layer information.

[239] For example, the maximum sub-layer information may be related to a maximumnumber of temporal sub-layers present in the CLVS. The maximum sub-layer informationmay indicate / represent the maximum number of temporal sub-layers present in the CLVS.

[240] For example, the maximum sub-layer information may be expressed in the form of asps_max_sublayers_minus1 syntax element. For example, the value +1 of thesps_max_sublayers_minus1 syntax element may specify a maximum number of temporalsublayers present in the CLVS.

[241] According to the embodiment, when the value of the maximum sub-layer informationis greater than 0 and the temporal ID (TemporalId) of the current picture is 0, the value of thenon-reference picture flag for the current picture may be limited not to be 1.

[242] According to an embodiment proposed in the present disclosure, the semantics of thenon-reference picture flag included in the syntax of Table 1 may be represented, for example,as shown in Table 12 below.

[243] [Table 12]

[244] That is, according to the embodiment, the image information may further include anintra restriction flag.

[245] For example, the intra restriction flag may be related to whether pictures in CLVS arerestricted to intra pictures. That is, the intra restriction flag may indicate / represent whetherpictures in CLVS are restricted to intra pictures.

[246] As an example, the intra restriction flag may be expressed in the form of anintra_only_constraint_flag syntax element. For example, the intra_only_constraint_flagsyntax element may specify whether pictures in CLVS are restricted to intra pictures.

[247] According to the embodiment, when the value of the intra restriction flag is 0 and thetemporal ID (TemporalId) of the current picture is 0, the value of the non-reference picture flagfor the current picture may be restricted not to be 1.

[248] According to the embodiment proposed in the present disclosure, the semantics of thenon-reference picture flag included in the syntax of Table 1 may be represented, for example,as shown in Table 13 below.

[249] [Table 13]

[250] That is, according to the embodiment, when the current CLVS includes a plurality oftemporal sublayers, the value of the intra restriction flag is 0, and the temporal ID (TemporalId)of the current picture is 0, the value of the non-reference picture flag may then be limited notto be 1.

[251] According to an embodiment proposed in the present disclosure, the image informationmay further include temporal ID information.

[252] For example, the temporal ID information may be related to a temporal identifier forthe NAL unit. That is, the temporal ID information may indicate / represent a temporalidentifier for the NAL unit.

[253] For example, the temporal ID information may be expressed in the form of anuh_temporal_id_plus1 syntax element. For example, the value -1 of thenuh_temporal_id_plus1 syntax element may specify a temporal identifier for the NAL unit.

[254] According to the embodiment, the semantics of the temporal ID information may berepresented, for example, as shown in Table 14 below.

[255] [Table 14]

[256] That is, according to the embodiment, the temporal ID (TemporalId) may be derivedbased on the temporal ID information.

[257] According to the embodiment, when the values of the layer ID information are thesame for the first picture and the second picture having a temporal ID (TemporalId) of 0, arenot a RASL picture or a RADL picture, a value of the non-reference picture flag is 0, and thesecond picture is a first picture whose temporal ID that follows the first picture in output orderis 0, a POC difference value between the first picture and the second picture may not be greaterthan half of MaxPicOrderCntLsb which is a maximum value of the predetermined POC LSB.

[258] Alternatively, according to an embodiment proposed in the present disclosure, thesemantics of the temporal ID information may be represented, for example, as shown in Tablebelow.

[259] [Table 15]

[260] Similarly, according to the embodiment, the temporal ID (TemporalId) may be derivedbased on the temporal ID information.

[261] In addition, according to the embodiment, for the first picture and the second picturehaving a temporal ID (TemporalId) of 0, conditions in which the layer ID information may bethe same as each other, the first picture and the second picture are not RASL picture or a RADLpicture, and a value of the non-reference picture flag is 0 may be satisfied.

[262] In this case, according to the embodiment, when a picture satisfying the conditions inwhich the second picture follows the first picture in output order, and follows the first pictureand precedes the second picture in output order does not exist, the POC difference valuebetween the first picture and the second picture may not be greater than a half value ofMaxPicOrderCntLsb, which is the maximum value of the predetermined POC LSB.

[263] That is, according to the embodiments described above, the POC difference valuebetween the continuous first picture and the second picture satisfying the above condition maybe limited to be less than half of MaxPicOrderCntLsb. Through this, an error due to networkcongestion may be prevented and an accurate POC value may be derived.

[264] The following drawings are created to explain a specific example of the presentdisclosure. Since the names of specific devices described in the drawings or the names ofspecific signals / messages / fields are presented by way of example, the technical features of thepresent disclosure are not limited to the specific names used in the following drawings.

[265] FIGS. 10 and 11 schematically show an example of a video / image encoding methodand related components according to embodiment(s) of the present disclosure. The methoddisclosed in FIG. 10 may be performed by the encoding apparatus disclosed in FIG. 2.Specifically, for example, S1000 and S1010 of FIG. 10 may be performed by the predictor 220of the encoding apparatus 200, and S1020 of FIG. 10 may be performed by the entropy encoder240 of the encoding apparatus 200. The method disclosed in FIG. 10 may include theembodiments described above in the present disclosure.

[266] Referring to FIG. 10, the encoding apparatus derives a reference picture list for apicture (S1000). For example, the encoding apparatus may derive a reference picture list forthe current picture. For example, when the reference picture list is derived, the encodingapparatus may derive prediction samples for the current block in the current picture byperforming inter prediction based on the reference picture list. Also, for example, theencoding apparatus may derive residual samples based on the prediction samples. Forexample, the encoding apparatus may derive the residual samples by comparing the originalsamples of the current block with the prediction samples. Also, the encoding apparatus maygenerate residual information based on the residual samples, and may additionally generateresidual samples from the already reconstructed samples.

[267] The encoding apparatus derives a POC value of at least one reference picture and aPOC value of the picture (S1010). For example, the encoding apparatus may derive the POCvalue of the at least one reference picture and the POC value of the current picture based onthe reference picture list. As an example, the encoding apparatus may derive the POC valueof the at least one reference picture constituting the reference picture list, and may derive thePOC value of the current picture. For example, the POC value of the current picture may bederived based on the POC value of a previous picture in decoding order. For example, the atleast one reference picture may include a long-term reference picture. Also, as an example,the reference picture list may include a reference picture list 0 (L0) and a reference picture list1 (L1). Here, the reference picture list 0 may include a reference picture having a smallerPOC value than the POC of the current picture. Also, the reference picture list 1 may includea reference picture having a larger POC value than the POC of the current picture.

[268] For example, the encoding apparatus may generate POC information based on the POCvalue of the at least one reference picture and the POC value of the current picture. Forexample, the POC information may include POC information related to the current picture,POC information related to a previous picture in decoding order for deriving the POC of thecurrent picture, or POC information related to reference picture(s).

[269] The encoding apparatus encodes the video / image information (S1020). For example,the encoding apparatus may encode video / image information including the POC informationand / or a non-reference picture flag related to whether a picture is not used as a reference picture.Also, for example, the encoding apparatus may encode the video / image information furtherincluding layer ID information and / or temporal ID information.

[270] For example, the video / image information may include a high level syntax (HLS), andthe HLS may include the POC information and the non-reference picture flag. Also, the HLSmay include the layer ID information and / or the temporal ID information.

[271] For example, the video / image information may include at least one of the POCinformation, the non-reference picture flag, the layer ID information, and / or the temporal IDinformation. For example, the video / image information may further include a picture headerand / or a NAL unit header. For example, the POC information and the non-reference pictureflag may be included in the picture header, and the layer ID information and the temporal IDinformation may be included in the NAL unit header. For example, the video / imageinformation may include at least one of ph_non_ref_pic_flag, nuh_layer_id, and / ornuh_temporal_id_plus1 syntax elements.

[272] Also, for example, the POC information may include at least one of POC LSBinformation, POC MSB cycle presence flag, delta POC MSB cycle presence flag, and / or deltaPOC MSB cycle LT information. For example, the POC information may be included in thepicture header. For example, the POC information may include at least one ofph_pic_order_cnt_lsb ph_poc_msb_cycle_present_flag, delta_poc_msb_cycle_present_flag,and / or delta_poc_msb_cycle_lt.

[273] Further, the video / image information may include various information according tothe exemplary embodiments of the present disclosure. For example, the video / imageinformation may include the information disclosed in at least one of Tables 2, 4, 6, 7, 8, 14,and / or 15 described above.

[274] Meanwhile, the video / image information may include prediction information andresidual information. The prediction information as information related to the predictionprocedure may include information about prediction mode information (e.g., a skip flag, amerge flag, or a mode index) and motion information. The information about the motioninformation may include candidate selection information (e.g., a merge index, an mvp flag oran mvp index), which is information for deriving a motion vector. Further, the informationabout the motion information may include the aforementioned information about the MVDand / or reference picture index information. Further, the information about the motioninformation may include information representing whether L0 prediction, L1 prediction, or Biprediction is applied. The residual information is information about the residual samples.The residual information may include information about quantized transform coefficients forthe residual samples.

[275] The encoded video / image information may be output in the form of a bitstream. Thebitstream may be transmitted to the decoding apparatus through a network or a storage medium.

[276] Further, as described above, the encoding apparatus may generate a reconstructedpicture (including reconstructed samples and reconstructed block) based on the referencesamples and the residual samples. This is to derive the same prediction result as that obtainedby being performed by the decoding apparatus in the encoding apparatus, and as a result, it ispossible to enhance coding efficiency. Therefore, the encoding apparatus may store thereconstructed picture (or the reconstructed samples and the reconstructed block) in a memoryand use the reconstructed picture as a reference picture for the inter prediction. As describedabove, the in-loop filtering procedure or the like may be further applied to the reconstructedpicture.

[277] Specifically, the POC information may include various information according to anembodiment of the present disclosure.

[278] According to an embodiment proposed in the present disclosure, the POC informationmay include POC information of a previous picture in decoding order with respect to thecurrent picture. In this case, for example, the previous picture in the decoding order forderiving the POC value of the current picture may be limited to a picture in which the value ofthe non-reference picture flag is 0. Also, for example, the POC information of the previouspicture in the decoding order for the current picture may be related to the remainder obtainedby dividing the POC value of the previous picture by MaxPicOrderCntLsb which is themaximum value of the predetermined POC LSB.

[279] Also, according to an embodiment, the POC information may further include a POCMSB cycle presence flag related to the presence of POC MSB cycle information of the currentpicture. At this time, for example, based on the case where the value of the POC MSB cyclepresence flag is 0 and the current picture is not a CLVSS picture, the POC value of the currentpicture may be derived based on the POC value of the previous picture in the decoding order.

[280] In this case, according to an embodiment, the image information may further includelayer ID information related to a layer identifier to which the NAL unit belongs. In this case,for example, the previous picture in the decoding order for deriving the POC value of thecurrent picture may be limited to that the value of the layer ID information is the same as thevalue of the layer ID information of the current picture, and the temporal ID (TemporalId) andthe value of the non-reference picture flag is 0, and the previous picture is not a RASL pictureor a non-RADL picture.

[281] Also, according to an embodiment, the POC difference value between the currentpicture and the previous picture in the decoding order for deriving the POC value of the currentpicture may be less than a half value of MaxPicOrderCntLsb which is the maximum value ofthe predetermined POC LSB.

[282] Also, according to an embodiment, the POC information may further include a deltaPOC MSB cycle presence flag related to the presence of delta POC MSB cycle long term (LT)information for a long-term reference picture. In this case, for example, based on a case inwhich the value of the delta POC MSB cycle presence flag is 1, the POC information mayfurther include the delta POC MSB cycle LT information. For example, the delta POC MSBcycle LT information may be related to the POC MSB of the long-term reference picture.Also, for example, based on a case in which the POC value of the long-term reference picturemay be derived based on at least one of the delta POC MSB cycle presence flag and the deltaPOC MSB cycle LT information and there are more than one specific POC value in which theremainder obtained by dividing MaxPicOrderCntLsb which is the maximum value of the POCLSB predetermined in the previous picture POC set is the same as the POC LSB of the longterm reference picture, the value of the delta POC MSB cycle presence flag may be limited to1. Alternatively, for example, based on a case in which the POC value of the long-termreference picture may be derived based on at least one of the delta POC MSB cycle presenceflag and the delta POC MSB cycle LT information and there are more than one specific POCvalue in which the remainder obtained by dividing MaxPicOrderCntLsb which is the maximumvalue of the POC LSB predetermined in the previous picture POC set is the same as the POCLSB of the long-term reference picture, the value of the delta POC MSB cycle presence flagmay be limited to 1.

[283] At this time, according to the embodiment, the previous picture POC set may includethe POC value of the previous picture in the decoding order for the current picture, the POCvalue of each reference picture having the same layer ID as the current picture in the referencepicture list for the previous picture, and a POC value of each picture that follows the previouspicture and precedes the current picture in decoding order and has the same layer ID as thecurrent picture.

[284] Also, according to an embodiment, the image information may further include layerID information related to a layer identifier to which the NAL unit belongs. In this case, forexample, based on a case in which, with respect to the first picture and the second picture inwhich the temporal ID (TemporalId) is 0, the layer ID information values are the same, theyare not RASL pictures or RADL pictures, the non-reference picture flag value is 0, and thesecond picture is a first picture whose temporal ID that follows the first picture in output orderis 0, the POC difference value between the first picture and the second picture may not begreater than a half value of MaxPicOrderCntLsb which is the maximum value of thepredetermined POC LSB.

[285] Also, according to an embodiment, the image information may further include layerID information related to a layer identifier to which the NAL unit belongs. In this case, forexample, based on a case in which, with respect to the first picture and the second picture inwhich the temporal ID (TemporalId) is 0, there is no picture satisfying a condition in which thelayer ID information values are the same, they are not RASL pictures or RADL pictures, thevalue of the non-reference picture flag is 0 is satisfied and satisfying a condition in which thesecond picture follows the first picture in output order and follows the first picture and precedesthe second picture in output order, the POC difference value between the first picture and thesecond picture may not be greater than a half value of MaxPicOrderCntLsb which is themaximum value of the predetermined POC LSB.

[286] Also, according to an embodiment, based on a case in which a temporal ID(TemporalId) of a specific picture is 0, the value of the non-reference picture flag for thespecific picture may be limited not to be 1.

[287] FIGS. 12 and 13 schematically show an example of a video / image decoding methodand related components according to an embodiment of the present disclosure. The methoddisclosed in FIG. 12 may be performed by the decoding apparatus illustrated in FIG. 3.Specifically, for example, S1200 of FIG. 12 may be performed by the entropy decoder 310 ofthe decoding apparatus 300, and S1210 to S1240 may be performed by the predictor 330 of thedecoding apparatus 300. Also, S1250 may be performed by the adder 340 of the decodingapparatus 300. The method disclosed in FIG. 12 may include the embodiments describedabove in the present disclosure.

[288] Referring to FIG. 12, the decoding apparatus receives / obtains video / image information(S1200). For example, the decoding apparatus may receive / obtain the video / imageinformation through a bitstream. As an example, the decoding apparatus may receive / obtainthe video / image information through a bitstream. For example, the video / image informationmay include POC information and a non-reference picture flag related to whether a picture isnot used as a reference picture. Also, for example, the video / image information may furtherinclude layer ID information and / or temporal ID information.

[289] For example, the video / image information may include a high level syntax (HLS), andthe HLS may include the POC information and the non-reference picture flag. Also, the HLSmay include the layer ID information and / or the temporal ID information.

[290] For example, the video / image information may include at least one of the POCinformation, the non-reference picture flag, the layer ID information, and / or the temporal IDinformation. For example, the video / image information may further include a picture headerand / or a NAL unit header. For example, the POC information and the non-reference pictureflag may be included in the picture header, and the layer ID information and the temporal IDinformation may be included in the NAL unit header. For example, the video / imageinformation may include at least one of ph_non_ref_pic_flag, nuh_layer_id, and / ornuh_temporal_id_plus1 syntax elements.

[291] Also, for example, the POC information may include at least one of POC LSBinformation, POC MSB cycle presence flag, delta POC MSB cycle presence flag, and / or deltaPOC MSB cycle LT information. For example, the POC information may be included in thepicture header. For example, the POC information may include at least one ofph_pic_order_cnt_lsb ph_poc_msb_cycle_present_flag, delta_poc_msb_cycle_present_flag,and / or delta_poc_msb_cycle_lt. Also, for example, the POC information may include POCinformation related to the current picture, POC information related to a previous picture indecoding order for deriving the POC of the current picture, or POC information related toreference picture(s).

[292] Further, the video / image information may include various information according tothe exemplary embodiments of the present disclosure. For example, the video / imageinformation may include information disclosed in at least one of Tables 2, 4, 6, 7, 8, 14, and / ordescribed above.

[293] Meanwhile, for example, the video / image information may include predictioninformation and residual information. The prediction information as information related tothe prediction procedure may include information about prediction mode information (e.g., askip flag, a merge flag, or a mode index) and motion information. The information about themotion information may include candidate selection information (e.g., a merge index, an mvpflag, or an mvp index), which is information for deriving a motion vector. Further, theinformation about the motion information may include the aforementioned information aboutthe MVD and / or reference picture index information. Further, the information about themotion information may include information representing whether L0 prediction, L1 prediction,or Bi prediction is applied. The residual information is information about the residual samples.The residual information may include information about quantized transform coefficients forthe residual samples.

[294] Meanwhile, for example, the video / image information may further include informationrelated to a reference picture list. The information related to the reference picture list mayinclude the ref_pic_lists field, and the information related to the reference picture list may beconstituted / included in a picture header or a slice header and delivered. The informationrelated to the reference picture list may include information used for deriving the referencepicture list. For example, the information related to the reference picture list may include atleast one of the information related to the reference picture list index, the information relatedto the long-term reference picture, and / or the information related to the short-term referencepicture. The information related to the long-term reference picture may include informationabout a picture order count (POC) of the long-term reference picture. The information relatedto the short-term reference picture may include the information about the ith delta POC of theshort-term reference picture, and the delta POC may be derived based on the (i-1)th POC.

[295] The decoding apparatus derives a POC value of the picture (S1210). For example,the decoding apparatus may derive the POC value of the current picture based on the POCinformation. For example, the POC value of the current picture may be derived based on thePOC value of a previous picture in decoding order. For example, the POC value of the currentpicture may be derived based on POC information related to at least one of the current picture,a variable prevPicOrderCntLsb, and a variable prevPicOrderCntMsb.

[296] The decoding apparatus derives a POC value of at least one reference picture (S1220).For example, the decoding apparatus may derive the POC value of the at least one referencepicture based on the POC value of the current picture. For example, a POC value of an ithreference picture, among the POC values of the reference pictures, may be derived based on aPOC difference value indicated by POC information related to the reference pictures. Forexample, if i is 0, the POC information related to the reference pictures may be a POCdifference value between the current picture and the ith reference picture. For example, if i isgreater than 0, the POC information related to the reference pictures may be a POC differencevalue between the ith reference picture and an (i-1)th reference picture. Also, as an example,the at least one reference picture may include a long-term reference picture.

[297] The decoding apparatus derives a reference picture list for the picture (S1230). Forexample, the decoding apparatus may derive the reference picture list for the current picturebased on the POC value of the at least one reference picture. As an example, the referencepicture list may include a reference picture list 0 (L0) and a reference picture list 1 (L1). Here,the reference picture list 0 may include a reference picture having a smaller POC value thanthe POC of the current picture. Reference picture list 1 may include a reference picture havinga larger POC value than the POC of the current picture.

[298] The decoding apparatus performs inter prediction on a picture (S1240). For example,the decoding apparatus may perform inter prediction on the current picture based on thereference picture list. For example, the decoding apparatus may generate prediction samplesfor the current block in the current picture based on the reference picture in the reference picturelist. Also, for example, the decoding apparatus may derive residual samples based on theprediction samples. For example, the decoding apparatus may derive the residual samples bycomparing original samples of the current block with the prediction samples. For example,the decoding apparatus may derive the reference picture index of the current picture. Forexample, a picture indicated by the reference picture index in the reference picture list relatedto the current picture may be derived as a reference picture referenced for inter prediction ofthe current block in the current picture. The reference picture may be derived based on thereference picture index of the current block, and the prediction samples of the current blockmay be derived using samples of the reference block indicated by the motion vector of thecurrent block on the reference picture. In this case, as described above, a prediction samplefiltering procedure for all or some of the prediction samples of the current block may be furtherperformed in some cases.

[299] The decoding apparatus generates a reconstructed picture for the picture (S1250).For example, the decoding apparatus may generate a reconstructed picture for the currentpicture based on a result of the inter prediction. For example, the decoding apparatus maygenerate the reconstructed samples for the current picture based on the prediction samples.Also, for example, the decoding apparatus may generate the reconstructed samples for thecurrent picture based on residual samples and the prediction samples for the current picture.The residual samples for the current block may be generated based on received residualinformation. Also, the decoding apparatus may generate, for example, a reconstructed pictureincluding the reconstructed samples. Thereafter, as described above, an in-loop filteringprocedure may be further applied to the reconstructed picture.

[300] Specifically, the POC information may include various information according to anembodiment of the present disclosure.

[301] According to an embodiment proposed in the present disclosure, the POC informationmay include POC information of a previous picture in a decoding order with respect to thecurrent picture. In this case, for example, the previous picture in the decoding order forderiving the POC value of the current picture may be limited to a picture in which the value ofthe non-reference picture flag is 0. Also, for example, the POC information of the previouspicture in the decoding order for the current picture may be related to the remainder obtainedby dividing the POC value of the previous picture by MaxPicOrderCntLsb which is themaximum value of the predetermined POC LSB.

[302] Also, according to an embodiment, the POC information may further include a POCMSB cycle presence flag related to the presence of POC MSB cycle information of the currentpicture. At this time, for example, based on the case where the value of the POC MSB cyclepresence flag is 0 and the current picture is not a CLVSS picture, the POC value of the currentpicture may be derived based on the POC value of the previous picture in the decoding order.

[303] In this case, according to an embodiment, the image information may further includelayer ID information related to a layer identifier to which the NAL unit belongs. In this case,for example, the previous picture in the decoding order for deriving the POC value of thecurrent picture may be limited to that the value of the layer ID information is the same as thevalue of the layer ID information of the current picture, the temporal ID (TemporalId) and thevalue of the non-reference picture flag is 0, and the previous picture is not a RASL picture ora RADL picture.

[304] Also, according to an embodiment, the POC difference value between the currentpicture and the previous picture in the decoding order for deriving the POC value of the currentpicture may be less than a half value of MaxPicOrderCntLsb which is the maximum value ofthe predetermined POC LSB.

[305] Also, according to an embodiment, the POC information may further include a deltaPOC MSB cycle presence flag related to the presence of delta POC MSB cycle long term (LT)information for a long-term reference picture. In this case, for example, based on a case inwhich the value of the delta POC MSB cycle presence flag is 1, the POC information mayfurther include the delta POC MSB cycle LT information. For example, the delta POC MSBcycle LT information may be related to the POC MSB of the long-term reference picture.Also, for example, based on a case in which the POC value of the long-term reference picturemay be derived based on at least one of the delta POC MSB cycle presence flag and the deltaPOC MSB cycle LT information and there are more than one specific POC value in which theremainder obtained by dividing MaxPicOrderCntLsb which is the maximum value of the POCLSB predetermined in the previous picture POC set is the same as the POC LSB of the longterm reference picture, the value of the delta POC MSB cycle presence flag may be limited to1. Alternatively, for example, based on a case in which the POC value of the long-termreference picture may be derived based on at least one of the delta POC MSB cycle presenceflag and the delta POC MSB cycle LT information and there are more than one specific POCvalue in which the remainder obtained by dividing MaxPicOrderCntLsb which is the maximumvalue of the POC LSB predetermined in the previous picture POC set is the same as the POCLSB of the long-term reference picture, the value of the delta POC MSB cycle presence flagmay be limited to 1.

[306] At this time, according to the embodiment, the previous picture POC set may includethe POC value of the previous picture in the decoding order for the current picture, the POCvalue of each reference picture having the same layer ID as the current picture in the referencepicture list for the previous picture, and a POC value of each picture that follows the previouspicture and precedes the current picture in decoding order and has the same layer ID as thecurrent picture.

[307] Also, according to an embodiment, the image information may further include layerID information related to a layer identifier to which the NAL unit belongs. In this case, forexample, based on a case in which, with respect to the first picture and the second picture inwhich the temporal ID (TemporalId) is 0, the layer ID information values are the same, theyare not RASL pictures or RADL pictures, the non-reference picture flag value is 0, and thesecond picture is a first picture whose temporal ID that follows the first picture in output orderis 0, the POC difference value between the first picture and the second picture may not begreater than a half value of MaxPicOrderCntLsb which is the maximum value of thepredetermined POC LSB.

[308] Also, according to an embodiment, the image information may further include layerID information related to a layer identifier to which the NAL unit belongs. In this case, forexample, based on a case in which, with respect to the first picture and the second picture inwhich the temporal ID (TemporalId) is 0, there is no picture satisfying a condition in which thelayer ID information values are the same, they are not RASL pictures or RADL pictures, thevalue of the non-reference picture flag is 0 is satisfied and satisfying a condition in which thesecond picture follows the first picture in output order and follows the first picture and precedesthe second picture in output order, the POC difference value between the first picture and thesecond picture may not be greater than a half value of MaxPicOrderCntLsb which is themaximum value of the predetermined POC LSB.

[309] Also, according to an embodiment, based on a case in which a temporal ID(TemporalId) of a specific picture is 0, the value of the non-reference picture flag for thespecific picture may be limited not to be 1.

[310] In the above-described embodiment, the methods are described based on the flowcharthaving a series of steps or blocks, but this embodiment is not limited to the order of the abovesteps or blocks and some steps may occur simultaneously or in a different order from othersteps as described above. Further, those skilled in the art will understand that the steps shownin the above flowchart are not exclusive, that further steps may be included, or that one or moresteps in the flowchart may be deleted without affecting the scope of the embodiments of thepresent disclosure.

[311] The method according to the embodiments of the present disclosure described abovemay be implemented in software. The encoding apparatus and / or decoding apparatusaccording to the present disclosure may be included in a device that performs image processing,for example, a TV, a computer, a smartphone, a set-top box, or a display device.

[312] When the embodiments of the present disclosure are implemented in software, theabove-described method may be implemented by modules (processes, functions, and so on)that perform the functions described above. Such modules may be stored in memory andexecuted by a processor. The memory may be internal or external to the processor, and thememory may be coupled to the processor using various well known means. The processormay include an application-specific integrated circuit (ASIC), other chipsets, a logic circuitand / or a data processing device. The memory may include a ROM (read-only memory), aRAM (random access memory), a flash memory, a memory card, a storage medium, and / orother storage device. That is, the embodiments described in the present disclosure may beimplemented and performed on a processor, a microprocessor, a controller, or a chip. Forexample, the functional units shown in each drawing may be implemented and executed on acomputer, a processor, a microprocessor, a controller, or a chip. In this case, information (ex.Information on instructions) for implementation or an algorithm may be stored in a digitalstorage medium.

[313] In addition, the decoding apparatus and the encoding apparatus to which theembodiments of the present disclosure are applied may be applied to multimediacommunication devices such as a multimedia broadcasting transmitting and receiving device,a mobile communication terminal, a home cinema video device, a digital cinema video device,a surveillance camera, a video chatting device, (3D) video devices, video telephony videodevices, and medical video devices, and the like, which may be included in, for example, astorage medium, a camcorder, a video on demand (VoD) service provision device, an OTTvideo (Over the top video), an Internet streamlining service providing device, a 3D videodevice, a virtual reality (VR) device, an augmented reality (AR) device, a video call device, atransportation means terminal (e.g., vehicle (including autonomous vehicle) terminal, airplaneterminal, ship terminal, etc.) and may be used to process video signals or data signals. Forexample, the OTT video (over the top video) device may include a game console, a Blu-rayplayer, an Internet access TV, a home theater system, a smartphone, a tablet PC, a digital videorecorder (DVR).

[314] Further, the processing method to which the embodiments of the present disclosure areapplied may be produced in the form of a computer-executed program, and may be stored in acomputer-readable recording medium. The multimedia data having the data structureaccording to the embodiment(s) of the present disclosure may also be stored in a computerreadable recording medium. The computer-readable recording medium includes all kinds ofstorage devices and distributed storage devices in which computer-readable data is stored.The computer-readable recording medium may be, for example, a Blu-ray Disc (BD), aUniversal Serial Bus (USB), a ROM, a PROM, an EPROM, an EEPROM, a RAM, a CD-ROM,magnetic tape, floppy disk, and optical data storage devices. In addition, the computerreadable recording medium includes media implemented in the form of a carrier wave (forexample, transmission over the Internet). In addition, the bit stream generated by theencoding method may be stored in a computer-readable recording medium or transmitted overa wired or wireless communication network.

[315] Further, an embodiment(s) of the present disclosure may be implemented as acomputer program product by program code, and the program code may be executed in acomputer according to an embodiment(s) of the present disclosure. The program code maybe stored on a carrier readable by a computer.

[316] FIG. 14 is a diagram illustrating a structure of a content streaming system to which theembodiments of the present disclosure are applied.

[317] Referring to FIG. 14, the content streaming system to which the embodiments of thepresent disclosure are applied may largely include an encoding server, a streaming server, aweb server, a media storage, a user device, and a multimedia input device.

[318] The encoding server serves to compress the content input from the multimedia inputdevices such as a smartphone, a camera, and a camcorder into the digital data to generate abitstream and transmit the bitstream to the streaming server. As another example, if themultimedia input devices such as a smartphone, a camera, and a camcorder directly generatethe bitstream, the encoding server may be omitted.

[319] The bitstream may be generated by the encoding method to which the embodiments ofthe present disclosure are applied or the bitstream generation method, and the streaming servermay temporarily store the bitstream in the process of transmitting or receiving the bitstream.

[320] The streaming server serves to transmit the multimedia data to the user device basedon the user request through the web server, and the web server serves as a medium whichinforms the user of what services are available. When the user requests the desired service tothe web server, the web server delivers the user's request to the streaming server, and thestreaming server transmits the multimedia data to the user. At this time, the content streamingsystem may include a separate control server, and in this case, the control server serves tocontrol commands / responses between the devices within the content streaming system.

[321] The streaming server may receive the contents from the media storage and / or theencoding server. For example, when receiving the contents from the encoding server, thestreaming server may receive the contents in real time. In this case, to provide the smoothstreaming service, the streaming server may store the bitstream for a predetermined time.

[322] As an example of the user device, there may be a portable phone, a smartphone, alaptop computer, a digital broadcast terminal, a personal digital assistants (PDA), a portablemultimedia player (PMP), a navigation device, a slate PC, a tablet PC, an ultrabook, a wearabledevice (e.g., a smart watch, a smart glass, a head mounted display (HMD)), a digital TV, adesktop computer, a digital signage, or the like.

[323] The respective servers within the content streaming system may be operated by adistribution server, and in this case, the data received by each server may be distributed andprocessed.

[324] Claims described in the present disclosure may be combined in various methods. Forexample, the technical features of method claims of the present disclosure may be combinedand implemented as a device, and the technical features of device claims of the presentdisclosure may be combined and implemented as a method. Further, the technical features ofthe method claims of the present disclosure and the technical features of the device claimsthereof may be combined and implemented as a device, and the technical features of the methodclaims of the present disclosure and the technical features of the device claims thereof may becombined and implemented as a method.

Claims

1. An image decoding method performed by a decoding apparatus, the method comprising: obtaining image information through a bitstream, wherein the image information includes picture order count (POC) information, and a non-reference picture flag related to whether a picture is not used as a reference picture; deriving a POC value of a current picture based on the POC information; deriving a POC value of at least one reference picture based on the POC value of the current picture; deriving a reference picture list for the current picture based on the POC value of the at least one reference picture; performing an inter prediction on the current picture based on the reference picture list; and generating a reconstructed picture for the current picture based on the result of the inter prediction, wherein the POC information includes POC information of a previous picture in decoding order for the current picture, and the POC value of the current picture is derived based on a POC value of the previous picture in decoding order, wherein the previous picture in decoding order for deriving the POC value of the current picture is limited to a picture in which a value of the non-reference picture flag is 0, and wherein a POC difference value between the current picture and the previous picture in decoding order for deriving the POC value of the current picture is less than half of MaxPicOrderCntLsb, which is a predetermined maximum value of POC LSB.

2. The method as claimed in claim 1, wherein the POC information of the previous picture in decoding order for the current picture is related to the POC value of the previous picture modulo MaxPicOrderCntLsb, which is a predetermined maximum value of POC Least Significant Bit(LSB).

3. The method as claimed in claim 1, wherein the POC information further includes a POC Most Significant Bit(MSB) cycle present flag related to whether POC MSB cycle information of the current picture is present, and Indian Patent Application No. 202217074731 Clean Claims wherein based on a case that a value of the POC MSB cycle present flag is 0 and the current picture is not a coded layer video sequence start (CLVSS) picture, the POC value of the current picture is derived based on the POC value of the previous picture in decoding order.

4. The method as claimed in claim 3, wherein the image information further includes layer ID information related to a identifier of a layer to which a NAL unit belongs, and wherein the previous picture in decoding order for deriving the POC value of the current picture has the layer ID information equal to layer ID information of the current picture, has a temporal ID equal to 0, has the non-reference picture flag of which value is 0, and is not a RASL (random access skipped leading) or RADL (random access decodable leading) picture.

5. The method as claimed in claim 1, wherein the POC information further includes a delta POC MSB cycle present flag related to whether delta POC MSB cycle LT (long term) information for a long-term reference picture is present, whether based on a case that a value of the delta POC MSB cycle present flag is 1, the POC information further includes the delta POC MSB cycle LT information, wherein the delta POC MSB cycle LT information is related to a POC MSB of the long-term reference picture, wherein the at least one reference picture includes the long-term reference picture, wherein a POC value of the long-term reference picture is derived based on at least one of the delta POC MSB cycle present flag or the delta POC MSB cycle LT information, wherein a previous picture POC set is configured based on the previous picture in which the value of the non-reference picture flag is 0, and based on a case that there is more than one specific POC value in the previous picture POC set for which the specific POC value modulo MaxPicOrderCntLsb, which is a predetermined maximum value of POC LSB, is equal to a POC LSB of the long-term reference picture, the value of the delta POC MSB cycle present flag is limited to 1.

6. The method as claimed in claim 5, wherein the previous picture POC set consists of: the POC value of the previous picture in decoding order for the current picture; a POC value of each reference picture having layer ID information the same as the Indian Patent Application No. 202217074731 Clean Claims current picture in the reference picture list for the previous picture; and a POC value of each picture that follows the previous picture in decoding order, has the layer ID information the same as the current picture, and precedes the current picture.

7. The method as claimed in claim 1, wherein the image information further includes layer ID information related to a identifier of a layer to which a NAL unit belongs, and wherein based on a case that values of the layer ID information of a first picture and a second picture with temporal ID equal to 0 are the same, the first picture and the second picture are not RASL picture or RADL picture, values of the non-reference picture flag of the first picture and the second picture are both equal to 0, and the second picture is a first picture with the temporal ID equal to 0 that follows the first picture in output order, a POC difference value between the first picture and the second picture is not greater than half of MaxPicOrderCntLsb, which is a predetermined maximum value of POC LSB.

8. The method as claimed in claim 1, wherein the image information further includes layer ID information related to a identifier of a layer to which a NAL unit belongs, wherein based on a case that values of the layer ID information of a first picture and a second picture with temporal ID equal to 0 are the same, the first picture and the second picture are not RASL picture or RADL picture, values of the non-reference picture flag of the first picture and the second picture are both equal to 0, the second picture follows the first picture in output order, and there is no picture that satisfies a specific condition, a POC difference value between the first picture and the second picture is not greater than half of MaxPicOrderCntLsb, which is a predetermined maximum value of POC LSB, and wherein the picture that satisfies the specific condition is a picture that has a temporal ID equal to 0, has the layer ID information the same as the first picture, is not a RASL picture or a RADL picture, follows the first picture in output order but precedes the second picture in output order.

9. The method as claimed in claim 1, wherein based on a case that a temporal ID of a specific picture is equal to 0, the value of the non-reference picture flag for the specific picture is limited to not be 1.

10. An image encoding method performed by an encoding apparatus, the method comprising: Indian Patent Application No. 202217074731 Clean Claims deriving a reference picture list for a current picture; deriving a picture order count (POC) value of at least one reference picture configuring the reference picture list and a POC value of the current picture; and encoding image information including POC information and a non-reference picture flag related to whether a picture is not used as a reference picture, wherein the POC information includes POC information of a previous picture in decoding order for the current picture, and the POC value of the current picture is derived based on a POC value of the previous picture in decoding order, wherein the previous picture in decoding order for deriving the POC value of the current picture is limited to a picture in which a value of the non-reference picture flag is 0, and wherein a POC difference value between the current picture and the previous picture in decoding order for deriving the POC value of the current picture is less than half of MaxPicOrderCntLsb, which is a predetermined maximum value of POC LSB.

11. The method as claimed in claim 10, wherein the POC information of the previous picture in decoding order for the current picture is related to the POC value of the previous picture modulo MaxPicOrderCntLsb, which is a predetermined maximum value of POC Least Significant Bit(LSB).

12. The method as claimed in claim 10, wherein the POC information further includes a POC Most Significant Bit(MSB) cycle present flag related to whether POC MSB cycle information of the current picture is present, and wherein based on a case that a value of the POC MSB cycle present flag is 0 and the current picture is not a coded layer video sequence start (CLVSS) picture, the POC value of the current picture is derived based on the POC value of the previous picture in decoding order.

13. The method as claimed in claim 12, wherein the image information further includes layer ID information related to a identifier of a layer to which a NAL unit belongs, and wherein the previous picture in decoding order for deriving the POC value of the current picture has the layer ID information equal to layer ID information of the current picture, has a temporal ID equal to 0, has the non-reference picture flag of which value is 0, Indian Patent Application No. 202217074731 Clean Claims and is not a RASL (random access skipped leading) or RADL (random access decodable leading) picture.

14. The method as claimed in claim 10, wherein the POC information further includes a delta POC MSB cycle present flag related to whether delta POC MSB cycle LT (long term) information for a long-term reference picture is present, whether based on a case that a value of the delta POC MSB cycle present flag is 1, the POC information further includes the delta POC MSB cycle LT information, wherein the delta POC MSB cycle LT information is related to a POC MSB of the long-term reference picture, wherein the at least one reference picture includes the long-term reference picture, wherein a POC value of the long-term reference picture is derived based on at least one of the delta POC MSB cycle present flag or the delta POC MSB cycle LT information, wherein a previous picture POC set is configured based on the previous picture in which the value of the non-reference picture flag is 0, and based on a case that there is more than one specific POC value in the previous picture POC set for which the specific POC value modulo MaxPicOrderCntLsb, which is a predetermined maximum value of POC LSB, is equal to a POC LSB of the long-term reference picture, the value of the delta POC MSB cycle present flag is limited to 1.

15. A non-transitory computer-readable digital storage medium for a bitstream generated by the image encoding method of claim 10.

16. A method for transmitting data for image information comprising: deriving a reference picture list for a current picture; deriving a picture order count (POC) value of at least one reference picture configuring the reference picture list and a POC value of the current picture; and encoding the image information including POC information and a non-reference picture flag related to whether a picture is not used as a reference picture, wherein the POC information includes POC information of a previous picture in decoding order for the current picture, and the POC value of the current picture is derived based on a POC value of the previous picture in decoding order, wherein the previous picture in decoding order for deriving the POC value of the current picture is limited to a picture in which a value of the non-reference picture flag is 0, Indian Patent Application No. 202217074731 Clean Claims and wherein a POC difference value between the current picture and the previous picture in decoding order for deriving the POC value of the current picture is less than half of MaxPicOrderCntLsb, which is a predetermined maximum value of POC LSB.