Video information decoding method, video decoding method and device using the same

The method enhances video encoding and decoding by adaptively providing scalability information in bitstreams through packet-level parsing and flag modifications, addressing the challenge of variable network bandwidths and flexible scalability representation.

JP7583890B2Active Publication Date: 2024-11-14ELECTRONICS & TELECOMM RES INST
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023179054
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2013-04-16
Filing Date
2023-10-17
Publication Date
2024-11-14
Estimated Expiration
2033-04-16

AI Technical Summary

Technical Problem

Existing video compression technologies struggle to efficiently adapt to varying network bandwidths and provide flexible scalability information representation in bitstreams, particularly in heterogeneous network environments.

Method used

A method and apparatus for decoding video information in a bitstream that includes parsing and converting scalability information at the packet level, utilizing NAL unit headers and Supplemental Enhancement Information (SEI) messages to adaptively provide extraction and representation of scalability information, and modifying flag indicators to enhance flexibility and efficiency.

Benefits of technology

Enables effective description and flexible representation of scalability information in hierarchical bitstreams, allowing adaptive extraction and decoding to suit diverse network conditions, thereby improving video encoding and decoding performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007583890000024
    Figure 0007583890000024
  • Figure 0007583890000025
    Figure 0007583890000025
  • Figure 0007583890000026
    Figure 0007583890000026
Patent Text Reader

Abstract

To provide a video information decoding method and device that provide adaptive conversion of extraction and scalability information in a hierarchical bitstream at the packet level.SOLUTION: A decoding method includes the steps of receiving a bitstream including a NAL (Network Abstraction Layer) unit including information related to an encoded video, and parsing a NAL unit header of the NAL unit, and the NAL unit header does not include 1-bit flag information indicating whether the entire bitstream is a non-reference picture or a reference picture during encoding.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to video encoding and decoding processes, and more particularly to a method and apparatus for decoding video information in a bitstream. [Background technology]

[0002] Recently, as broadcasting services with HD (High Definition) resolution are expanding not only in Korea but also around the world, many users are becoming accustomed to high-resolution, high-quality images, and as a result, many organizations are spurring the development of next-generation imaging devices. In addition, as interest in UHD (Ultra High Definition), which has four times the resolution of HDTV, is growing along with HDTV, there is a demand for compression techniques for images with higher resolution and quality.

[0003] For video compression, techniques such as inter prediction, which predicts pixel values ​​contained in a current picture from previous and / or subsequent pictures in time, intra prediction, which predicts pixel values ​​contained in a current picture using pixel information within the current picture, and entropy coding, which assigns short codes to symbols that occur frequently and long codes to symbols that occur less frequently, can be used.

[0004] There are video compression technologies that provide a certain network bandwidth under a limited hardware operating environment without considering a dynamic network environment. However, a new compression technology is required to compress video data that is applicable to a network environment where the bandwidth changes from time to time, and a scalable video encoding / decoding method can be used for this purpose. Summary of the Invention [Problem to be solved by the invention]

[0005] A technical problem of the present invention is to provide a method and apparatus for describing abstraction and scalability information in a hierarchical bitstream.

[0006] Another technical object of the present invention is to provide a method and apparatus for expressing scalability information of various kinds of bitstreams in a flexible manner.

[0007] Another technical object of the present invention is to provide a method and apparatus for providing extraction and scalability information in a hierarchical bitstream in a packet-level adaptively transformable manner. [Means for solving the problem]

[0008] A video information decoding method according to one embodiment of the present invention includes a step of receiving a bitstream including a Network Abstraction Layer (NAL) unit including information related to an encoded video, and a step of parsing a NAL unit header of the NAL unit, wherein the NAL unit header does not include 1-bit flag information indicating whether the NAL unit is a non-reference picture or a reference picture in the entire bitstream when the NAL unit is encoded.

[0009] A video decoding method according to one embodiment of the present invention includes the steps of: decoding a received picture; displaying the decoded picture as a reference picture in a decoded picture buffer (DPB); parsing a slice header for a picture next to the decoded picture; and displaying whether the decoded picture is a reference picture or a non-reference picture based on reference picture information included in the slice header.

[0010] In another embodiment of the present invention, a supplemental enhancement information (SEI) message including information on an activated parameter set is received, and the information on the parameter set is parsed. Effect of the Invention

[0011] According to one embodiment of the present invention, a method and apparatus are provided for describing abstraction and scalability information in a hierarchical bitstream.

[0012] According to one embodiment of the present invention, a method and apparatus are provided for representing scalability information for various types of bitstreams in a flexible manner.

[0013] According to another embodiment of the present invention, a method and apparatus are provided for providing packet-level adaptive transformation of extraction and scalability information within a hierarchical bitstream. [Brief description of the drawings]

[0014] [Figure 1] 1 is a block diagram showing a configuration of a video encoding device according to an embodiment. [Diagram 2] FIG. 1 is a block diagram showing a configuration of a video decoding device according to an embodiment. [Diagram 3] 1 is a conceptual diagram illustrating an embodiment of a scalable video coding structure using multiple layers to which the present invention can be applied; [Figure 4] 2 is a control flow diagram illustrating a method for encoding video information according to the present invention; [Diagram 5] 2 is a control flow diagram illustrating a method for decoding video information according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, the embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the embodiments of the present invention, if a detailed description of related known configurations or functions is determined to obscure the gist of the present specification, the detailed description will be omitted.

[0016] When a component is described as being "connected" or "connected" to another component, it should be understood that the component may be directly connected or connected to the other component, but there may be other components in between. Furthermore, in the present invention, when a particular component is described as "including," it does not exclude components other than the component, but means that additional components may be included in the implementation of the present invention or within the scope of the technical idea of ​​the present invention.

[0017] Terms such as "first" and "second" may be used to describe various components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another. For example, a first component may be named a second component, and similarly, a second component may be named a first component, without departing from the scope of the present invention.

[0018] In addition, the components shown in the embodiments of the present invention are illustrated independently to show different characteristic functions, and do not mean that each component is configured as a separate hardware or software unit. That is, each component is included as a list of components for convenience of explanation, and at least two components among the components may be integrated into one component, or one component may be divided into multiple components to perform a function, and such integrated and separated embodiments of each component are included in the scope of the present invention as long as they do not deviate from the essence of the present invention.

[0019] In addition, some components are not essential components for performing essential functions in the present invention, but are optional components merely for improving performance. The present invention may be embodied including only components essential for embodying the essence of the present invention, excluding components merely used for improving performance, and a structure including only essential components, excluding optional components merely used for improving performance, is also included in the scope of the present invention.

[0020] 1 is a block diagram showing a configuration according to an embodiment of a video encoding device. A scalable video encoding / decoding method or device can be implemented by an extension of a general video encoding / decoding method or device that does not provide scalability, and the block diagram of FIG 1 shows an embodiment of a video encoding device that can be the basis of a scalable video encoding device.

[0021] Referring to FIG. 1, the video encoding device 100 includes a motion prediction unit 111, a motion compensation unit 112, an intra prediction unit 120, a switch 115, a subtractor 125, a transform unit 130, a quantization unit 140, an entropy encoding unit 150, an inverse quantization unit 160, an inverse transform unit 170, an adder 175, a filter unit 180, and a reference video buffer 190.

[0022] The video encoding device 100 can output a bit stream by performing encoding on the input video in intra mode or inter mode. Intra prediction means intra-frame prediction, and inter prediction means inter-frame prediction. In the intra mode, the switch 115 is switched to intra, and in the inter mode, the switch 115 is switched to inter. The video encoding device 100 can generate a predicted block for an input block of the input video, and then encode the difference between the input block and the predicted block.

[0023] In the case of the intra mode, the intra prediction unit 120 may generate a prediction block by performing spatial prediction using pixel values ​​of already-encoded blocks surrounding the current block.

[0024] In the case of the inter mode, the motion prediction unit 111 may obtain a motion vector by searching for an area that best matches the input block in a reference image stored in the reference image buffer 190 during the motion prediction process. The motion compensation unit 112 may generate a prediction block by performing motion compensation using the motion vector and the reference image stored in the reference image buffer 190.

[0025] The subtractor 125 may generate a residual block based on the difference between the input block and the generated prediction block. The transform unit 130 may output a transform coefficient by performing a transform on the residual block. The quantization unit 140 may quantize the input transform coefficient based on a quantization parameter and output a quantized coefficient.

[0026] The entropy coding unit 150 can output a bit stream by entropy coding symbols according to a probability distribution based on the value calculated by the quantization unit 140 or the coding parameter value calculated during the coding process. The entropy coding method is a method of receiving input symbols having various values, removing statistical redundancy, and expressing the input symbols as a sequence of decodable binary numbers.

[0027] Here, the symbol means a syntax element to be coded / decoded, a coding parameter, a residual signal value, etc. The coding parameter is a parameter required for coding and decoding, and may include not only information coded by an encoder and transmitted to a decoder like a syntax element, but also information that can be inferred during coding or decoding, and means information required when coding or decoding an image. The coding parameter may include values ​​or statistics such as an intra / inter prediction mode, a motion / motion vector, a reference image index, a coding block pattern, presence or absence of a residual signal, a transform coefficient, a quantized transform coefficient, a quantization parameter, a block size, block division information, etc. In addition, the residual signal means a difference between an original signal and a predicted signal, and also means a signal in which the difference between the original signal and the predicted signal is transformed, or a signal in which the difference between the original signal and the predicted signal is transformed and quantized. The residual signal is called a residual block in block units.

[0028] When entropy coding is applied, a smaller number of bits are assigned to symbols having a higher occurrence probability, and a larger number of bits are assigned to symbols having a lower occurrence probability to represent the symbols, thereby reducing the size of the bit string for the symbol to be coded. Therefore, the compression performance of video coding can be improved through entropy coding.

[0029] For the entropy coding, coding methods such as exponential golomb, CAVLC (Context-Adaptive Variable Length Coding), and CABAC (Context-Adaptive Binary Arithmetic Coding) can be used. For example, a table for performing entropy coding, such as a VLC (Variable Length Coding / Code) table, can be stored in the entropy coding unit 150, and the entropy coding unit 150 can perform entropy coding using the stored VLC table. In addition, the entropy coding unit 150 can derive a binarization method of a target symbol and a probability model of a target symbol / bin, and then perform entropy coding using the derived binarization method or probability model.

[0030] The quantized coefficients may be inverse quantized by an inverse quantization unit 160 and inverse transformed by an inverse transform unit 170. The inverse quantized and inverse transformed coefficients may be added to the prediction block via an adder 175 to generate a reconstructed block.

[0031] The reconstructed block passes through a filter unit 180, which may apply at least one of a deblocking filter, a sample adaptive offset (SAO), and an adaptive loop filter (ALF) to the reconstructed block or the reconstructed picture. The reconstructed block that has passed through the filter unit 180 may be stored in a reference picture buffer 190.

[0032] Fig. 2 is a block diagram showing a configuration according to an embodiment of a video decoding device. As detailed in Fig. 1, a scalable video encoding / decoding method or device can be implemented by extending a general video encoding / decoding method or device that does not provide scalability, and the block diagram of Fig. 2 shows an embodiment of a video decoding device that can be the basis of the scalable video decoding device.

[0033] 2, the video decoding apparatus 200 includes an entropy decoding unit 210, an inverse quantization unit 220, an inverse transform unit 230, an intra prediction unit 240, a motion compensation unit 250, a filter unit 260, and a reference video buffer 270.

[0034] The video decoding apparatus 200 may receive a bitstream output from an encoder and perform decoding in an intra mode or an inter mode to output a reconstructed image, i.e., a restored image. In the intra mode, a switch is switched to intra, and in the inter mode, a switch is switched to inter. The video decoding apparatus 200 may obtain a reconstructed residual block from the input bitstream, generate a predicted block, and then generate a reconstructed block, i.e., a restored block, by adding the reconstructed residual block and the predicted block.

[0035] The entropy decoding unit 210 may entropy decode an input bit stream according to a probability distribution and generate symbols including symbols in the form of quantized coefficients. The entropy decoding method is a method of receiving an input of a binary sequence and generating each symbol. The entropy decoding method is the same as the entropy coding method described above.

[0036] The quantized coefficients are inverse quantized in the inverse quantization unit 220 and inverse transformed in the inverse transform unit 230, and a reconstructed residual block can be generated as a result of the inverse quantization / inverse transformation of the quantized coefficients.

[0037] In the case of the intra mode, the intra prediction unit 240 may generate a prediction block by performing spatial prediction using pixel values ​​of already-encoded blocks surrounding the current block. In the case of the inter mode, the motion compensation unit 250 may generate a prediction block by performing motion compensation using a motion vector and a reference image stored in the reference image buffer 270.

[0038] The reconstructed residual block and the prediction block are added via an adder 255, and the added block passes through a filter unit 260. The filter unit 260 may apply at least one of a deblocking filter, SAO, and ALF to the reconstructed block or the reconstructed picture. The filter unit 260 outputs a reconstructed image, i.e., a reconstructed image. The reconstructed image may be stored in a reference image buffer 270 and used for inter prediction.

[0039] Among the entropy decoding unit 210, inverse quantization unit 220, inverse transform unit 230, intra prediction unit 240, motion compensation unit 250, filter unit 260 and reference image buffer 270 included in the image decoding device 200, components directly related to image decoding, e.g., the entropy decoding unit 210, inverse quantization unit 220, inverse transform unit 230, intra prediction unit 240, motion compensation unit 250, filter unit 260, etc., can be distinguished from other components and represented as a decoding unit or a decoding unit.

[0040] Also, the video decoding apparatus 200 may further include a parsing unit (not shown) that parses information related to the encoded video included in the bitstream. The parsing unit may include the entropy decoding unit 210 or may be included in the entropy decoding unit 210. Also, the parsing unit may be implemented as one component of the decoding unit.

[0041] 3 is a conceptual diagram illustrating an embodiment of a scalable video coding structure using multiple layers to which the present invention can be applied. In FIG. 3, GOP (Group of Pictures) indicates a group of pictures.

[0042] A transmission medium is required to transmit video data, and the performance of the transmission medium varies depending on various network environments. A scalable video coding method can be provided for application to such various transmission media or network environments.

[0043] The scalable video coding method is a coding method that improves encoding / decoding performance by removing inter-layer redundancy using texture information, motion information, residual signals, etc. between layers. The scalable video coding method can provide various scalability in terms of spatial, temporal, and image quality depending on surrounding conditions such as transmission bit rate, transmission error rate, and system resources.

[0044] Scalable video coding can be performed using a multiple layers structure so as to provide a bitstream applicable to various network conditions. For example, the scalable video coding structure may include a base layer that compresses video data using a general video encoding method, and an enhancement layer that compresses video data using both the encoding information of the base layer and the general video encoding method.

[0045] Here, a layer refers to a set of images and bit streams classified based on spatial (e.g., image size), temporal (e.g., encoding order, image output order, frame rate), image quality, complexity, etc. Also, a base layer refers to a reference layer or a base layer, and an enhancement layer refers to an enhancement layer. Also, multiple layers may have dependencies between each other.

[0046] 3, for example, the base layer may be defined as SD (standard definition), a frame rate of 15 Hz, and a bit rate of 1 Mbps, the first enhancement layer may be defined as HD (high definition), a frame rate of 30 Hz, and a bit rate of 3.9 Mbps, and the second enhancement layer may be defined as 4K-UHE (ultra high definition), a frame rate of 60 Hz, and a bit rate of 27.2 Mbps. The above formats, frame rates, bit rates, etc. are merely examples and may be determined differently as necessary. In addition, the number of layers used is not limited to this embodiment and may be determined differently depending on the situation.

[0047] For example, when the transmission bandwidth is 4 Mbps, the frame rate of the first enhancement layer HD can be reduced to 15 Hz or less for transmission. The scalable video coding method can provide temporal, spatial and image quality scalability by the method detailed in the embodiment of FIG.

[0048] Hereinafter, scalable video coding has the same meaning as scalable video encoding from an encoding point of view, and has the same meaning as scalable video decoding from a decoding point of view.

[0049] As mentioned above, due to the heterogeneous communication networks and various terminals, scalability has become an important feature of video formats today. Scalable Video Coding (SVC), an extension standard of Advanced Video Coding (AVC), was developed to generate bitstreams with a diverse range of bit rates while maintaining maximum compression efficiency. To meet the characteristics and changes of various devices and networks, SVC bitstreams can be easily extracted in various ways. That is, the SVC standard provides spatial, temporal, and image quality (SNR) scalability.

[0050] Meanwhile, bitstreams containing multiple layers are composed of Network Abstraction Layer (NAL) units that facilitate adaptive transmission of video over a packet-switching network. As with multiple layers, the relationship between multiple views in multi-view video coding, which includes multiple multi-view views in a bitstream, is similar to the relationship between spatial layers in videos that support multiple layers.

[0051] Bitstream scalability information is very important for effective and efficient conversion of bitstreams at all nodes in the content delivery path. In the current high efficiency video coding standard for a single layer, there are two fields related to layer information in the NAL Unit (NALU) header: temporal_id and reserved_one_5bits. The temporal_id, which has a length of 3 bits, indicates the temporal layer of the video bitstream, and the reserved_one_5bits corresponds to an area for indicating other layer information later.

[0052] A temporal layer refers to a layer of a bitstream that can be temporally scaled and is composed of video coding layer (VCL) NAL units, and the temporal layer has a specific temporal_id value.

[0053] The present invention relates to a method and an apparatus for implementing the same for efficiently describing and signaling video extraction and scalability information within a bitstream that supports multiple layers.

[0054] In the present invention, bitstreams are described by dividing them into two types: a base type that supports only temporal scalability, and an extended type that can have scalability supporting spatial / image quality / viewpoint including time.

[0055] The first type of bitstream is for a bitstream supporting a single layer video, and the second type is for an enhancement layer in HEVC-based hierarchical video coding. Hereinafter, an improved method for expressing scalability information for the two bitstream types is proposed. According to the present invention, in the enhancement type, 5 bits reserved_one_5bits can be used as layer_id indicating an identifier of a scalable layer.

[0056] Remove nal_ref_flag from NALU header

[0057] nal_ref_flag is used to indicate a non-reference picture. This information indicates a rough priority between non-reference pictures and reference pictures, but the use of nal_ref_flag for transmission is somewhat restrictive.

[0058] A reference picture refers to a picture that includes samples that can be used for inter prediction when decoding a subsequent picture in a decoding order.

[0059] A non-reference picture refers to a picture that includes samples that are not used for inter prediction when decoding a subsequent picture in the decoding order.

[0060] nal_ref_flag is a flag indicating information indicating whether the corresponding nal unit is a non-reference picture or a reference picture on the entire bitstream during encoding.

[0061] When nal_ref_flag is 1, it means that the NALU contains a slice of a sequence parameter set (SPS), picture parameter set (PPS), adaptation parameter set (APS) or reference picture, and when nal_ref_flag is 0, it means that the NALU contains a slice that contains some or all of a non-reference picture.

[0062] In this case, a NALU with a nal_ref_flag value of 1 can include a slice of a reference picture, and nal_ref_flag has a value of 1 for NALUs of a video parameter set (VPS), sequence parameter set (SPS), and picture parameter set (PPS). If one of the VCL NALUs of a particular picture has a nal_ref_flag value of 0, nal_ref_flag has a value of 0 for all VCL NALUs of the picture.

[0063] On the other hand, when all non-reference pictures, especially most of the non-reference pictures corresponding to the highest temporal layer, are extracted, the nal_ref_flag of all pictures remaining after the extraction becomes 1.

[0064] However, some pictures of the adaptively transformed (extracted) bitstream, i.e., pictures corresponding to the highest temporal layer in the remaining bitstream, become non-reference pictures even if nal_ref_flag is 1.

[0065] That is, other syntax elements of the NALU header (e.g., temporal_id) are more effective in supporting adaptive conversion (extraction). That is, a bitstream containing a desired temporal layer can be extracted using the total number of temporal layers contained in the bitstream and the temporal_id value of the NALU header.

[0066] In addition, nal_ref_flag can be used to indicate whether the picture will be used as a reference picture in the future when a picture composed of a NALU including nal_ref_flag is decoded and stored in a memory such as a decoded picture buffer (DPB). When nal_ref_flag is 1, it indicates that the picture will be used as a reference picture in the future, and when nal_ref_flag is 0, it indicates that the picture will not be used as a reference picture in the future.

[0067] When a decoded picture is stored in a DPB, it can be displayed as a reference picture without determining whether the corresponding NALU is a non-reference picture or a reference picture via nal_ref_flag. In this case, even if the decoded picture is a non-reference picture but is displayed as a reference picture, no problem occurs because the corresponding picture is not included in the reference picture list transmitted to the next picture's header (slice header) when decoding the next picture of the corresponding picture in the decoding order.

[0068] That is, when decoding a next picture, whether a previously decoded picture is a reference picture or a non-reference picture is indicated by the reference picture list included in the slice header. Therefore, even if a decoded picture is indicated as a reference picture without being determined as a reference picture via nal_ref_flag, there is no problem in determining whether the decoded picture is a reference picture or a non-reference picture.

[0069] In the present invention, it is proposed to delete nal_ref_flag from the NALU header or to change the semantics of nal_ref_flag. An embodiment related to deleting nal_ref_flag is as follows.

[0070] Example 1

[0071] Change nal_ref_flag to slice_ref_flag and move the flag location from the NALU header to the slice header. The syntax of the slice header can be modified as shown in Table 1.

[0072] [Table 1]

[0073] In Table 1, a value of 1 for slice_ref_flag indicates that the slice is part of a reference picture, and a value of 0 indicates that the slice is part of a non-reference picture.

[0074] Example 2

[0075] Change nal_ref_flag to au_ref_flag, and move the flag position from the NALU header to the access unit delimiter. The syntax of the access unit delimiter is shown in Table 2.

[0076] [Table 2]

[0077] In Table 2, au_ref_flag = 1 indicates that the access unit includes a reference picture, and = 0 indicates that the access unit includes a non-reference picture.

[0078] Example 3

[0079] Remove nal_ref_flag from the NALU header without moving nal_ref_flag to another syntax.

[0080] During encoding, if nal_ref_flag, which is 1-bit flag information indicating whether a picture is a non-reference picture or a reference picture in the entire bitstream, is deleted, the determination of whether a picture is a reference picture performed by nal_ref_flag can be performed through another process. After decoding a received picture, the decoded picture is displayed as an unconditional reference picture in a decoded picture buffer (DPB). That is, the decoded picture can be displayed as a reference picture without determining whether it is a reference picture.

[0081] Then, the slice header for the picture next to the decoded picture is parsed, and it is possible to indicate whether the decoded picture is a reference picture or a non-reference picture based on the reference picture information included in the slice header.

[0082] Example 4

[0083] The nal_ref_flag can be removed from the NALU header, and temporal_id can be used to indicate that the NALU is a non-reference picture. The temporal_id can be a preset value other than "7", the maximum number of temporal layers included in the bitstream minus 1 (i.e., max_temporal_layers_minus1), or "0".

[0084] Example 5

[0085] The nal_ref_flag can be removed from the NALU header, and reserved_one_5bits can be used as a priority_id component to indicate information that the NALU is a non-reference picture. Priority_id is an identifier indicating the priority of the corresponding NALU, and is used to provide a bitstream extraction function according to priority regardless of different spatial, temporal, and image quality.

[0086] That is, if temporal_id=Ta is the identifier of the highest temporal layer, a NALU with temporal_id=Ta and priority_id=31 (or other specific value) is used to indicate that it is a NALU of a non-reference picture.

[0087] The 1 bit used to signal nal_ref_flag can be used as one of the following:

[0088] (1) It can be used to indicate nal_unit_type. nal_unit_type can be a 7-bit signal, and the number of NALU types can be increased by a factor of two.

[0089] (2) It can be used to indicate the temporal_id. The temporal_id can be a 4-bit signal, and the maximum number of temporal layers can be increased by a factor of two.

[0090] (3) It can be used to indicate layer_id. layer_id means an identifier of a scalable layer of a hierarchical bitstream and can be signaled by the reserved_one_5bits syntax element. By adding 1 bit used for signaling nal_ref_flag to the 5 bits of reserved_one_5bits used to identify the scalable layer, layer_id can become a 6-bit signal. When 6 bits are used, 64 scalable layers can be identified.

[0091] (4) reserved_one_5bits can be used as a flag to indicate whether it indicates priority.

[0092] (5) Can be used as reserved_bit.

[0093] If the nal_ref_flag is not removed from the NALU header, the meaning of the nal_ref_flag can be modified as follows.

[0094] When nal_ref_flag is 0, it indicates that the NALU contains only slices of non-reference pictures, and when nal_ref_flag is 1, it indicates that the NALU can contain slices of reference pictures or non-reference pictures.

[0095] Video Parameter Set Activation Signaling

[0096] A video parameter set contains the most basic information for decoding video and can include the contents that existed in the existing SPS.

[0097] The video parameter set may include information on a sub-layer indicating a temporal layer that supports temporal scalability, and information on multiple layers that support spatial, quality, and view scalability. That is, the video parameter set may include multiple layer information, i.e., syntax for the HEVC extension.

[0098] A.Video Parameter Set

[0099] The syntax for the video parameter set is shown in Table 3.

[0100] [Table 3]

[0101] In Table 3, most of the syntax has the same meaning as the SPS syntax applied to a bitstream containing a single layer, with the additional parts being as follows:

[0102] -video_parameter_set_id means an identifier of a video parameter set, and can be referenced in an SPS (sequence parameter set), SEI (supplemental enhancement information), and access unit delimiter.

[0103] - When priority_id_flag is 1, it means that reserved_one_5bits is used the same as the priority_id in the SVC standard, and when priority_id_flag is 0, it means that reserved_one_5bits is used as layer_id.

[0104] - When extension_info_flag is 0, it indicates that the bitstream follows the HEVC single layer standard, and when it is 1, it indicates an enhanced layer for scalability support (if HEVC extension is supported), and information related to the layer is provided.

[0105] B. Sequence Parameter Set (SPS) Modification

[0106] As shown in Table 4, some of the existing syntax can be reflected in the VPS and deleted from the SPS. Meanwhile, the vps_id syntax element can be added to the SPS. The SPS syntax with vps_id added is as shown in Table 4. In Table 4, the deleted syntax is represented by drawing a line through the middle of the syntax.

[0107] vps_id indicates an identifier for identifying a video parameter set referenced by an SPS, and may range from 0 to X.

[0108] [Table 4]

[0109] C. Activation Signaling for Video Parameter Set

[0110] The slice header includes index information for a picture parameter set referenced by the corresponding slice, and the picture parameter set includes index information for a sequence parameter set referenced by the corresponding picture. The sequence parameter set includes information for a video parameter set referenced by the corresponding sequence. Parsing information for a parameter set and referring to the parsed parameter set information is called activation.

[0111] To use information for a particular parameter set, i.e., to activate a parameter set, it must be parsed sequentially from the slice header, which means that all slice headers and associated PPSs must be analyzed to know which SPSs are active.

[0112] When extracting a portion of a sublayer (temporal layer) from a bitstream containing a single layer, the extractor needs to parse the NALU header and multiple parameter sets.

[0113] If a video parameter set or sequence parameter set contains information for NALU extraction, the extractor must parse the higher level parameter sets starting from the slice header, which means that the extractor must understand all syntax elements of the parameter sets and slice headers.

[0114] Also, during video decoding, it is possible to search for vps_id or sps_id without a complex parsing process and activate only the required parameter set. In this case, if a video parameter set or sequence parameter set includes parameter index information to be activated, it is possible to reduce the parsing procedure for the complex slice header and the associated PPS.

[0115] However, only a portion of the syntax elements may contain information necessary for bitstream extraction. Nevertheless, it may be a heavy burden for the extractor to analyze all the syntax elements. In order to solve this problem, the following method is proposed.

[0116] In the present invention, activation of a parameter set means signaling so that the extractor knows which parameter set is activated without analyzing the slice header and its associated picture parameter set (PPS).

[0117] According to the present invention, by separately signaling whether any video parameter set, sequence parameter set, or picture parameter set is activated, the extractor can reduce the burden of having to analyze all slice headers and associated PPSs.

[0118] The video parameter set can also be updated in one of the following ways so that the extractor knows the currently active VPS and associated SPS or PPS without parsing the slice header:

[0119] (1) The vps_id, sps_id, and pps_id can be included in the access unit delimiter. The vps_id, sps_id, and pps_id indicate the identifiers of the video parameter set, sequence parameter set, and picture parameter set used for the NALU in the associated AU, respectively.

[0120] In order to indicate whether each identifier is present in the access unit delimiter, vps_id_present_flag, sps_id_present_flag, and pps_id_present_flag are used. The syntax of the proposed access unit delimiter is as shown in Table 5.

[0121] [Table 5]

[0122] (1-1) Another method is to include only the vps_id in the access unit delimiter, excluding the sps_id and pps_id, as shown in Table 6.

[0123] [Table 6]

[0124] (2) Another method for signaling the activation of a video parameter set is to use a new SEI message (parameter_set_reference). The SEI message includes syntax for signaling the presence or absence of vps_id, sps_id, and pps_id, which indicate the identifiers of the video parameter set, sequence parameter set, and picture parameter set used for the NALU in the associated AU.

[0125] To indicate the presence or absence of each identifier, the vps_id_present_flag, sps_id_present_flag, and pps_id_present_flag syntaxes can be used, and the SEI syntax is as shown in Table 7.

[0126] [Table 7]

[0127] (2-1) Also, as shown in Table 8, sps_id and vps_id can be included in the SEI message to notify activation, except for pps_id. The sps_id and vps_id included in the SEI message can include the sps_id and vps_id referenced by the video coding layer NALU of the access unit associated with the corresponding SEI message. Therefore, sps_id and vps_id can indicate information of a parameter set that may be activated.

[0128] [Table 8]

[0129] In Table 8, vps_id indicates the video_parameter_set_id of the currently activated video parameter set. The vps_id value can range from 0 to 15.

[0130] When sps_id_present_flag has a value of 1, it indicates that the sequence_parameter_set_id of the currently activated sequence parameter set is included in the corresponding SEI message, and when sps_id_present_flag has a value of 0, it indicates that the sequence_parameter_set_id of the activated sequence parameter set is not included in the corresponding SEI message.

[0131] sps_id indicates the sequence_parameter_set_id of the currently activated sequence parameter set, and can have a value of 0 to 31, or more specifically, a value of 0 to 15.

[0132] When psr_extension_flag is 0, it means that the parameter set reference SEI message extension syntax element is not included in the parameter set reference SEI message, and when psr_extension_flag is 1, it means that the parameter set reference SEI message extension syntax element is included in the parameter set reference SEI message and is used by extending the syntax.

[0133] psr_extension_length indicates the length of psr_extension_data. psr_extension_length can have a value in the range of 0 to 256, and psr_extension_data_byte can have any value.

[0134] (2-2) Also, as shown in Table 9, one or more sps_ids and vps_ids can be signaled in the SEI message, excluding the pps_id.

[0135] [Table 9]

[0136] In Table 9, vps_id indicates the video_parameter_set_id of the currently active video parameter set. vps_id can have a value of 0 to 15.

[0137] num_reference_sps indicates the number of sequence parameter sets that reference the currently activated vps_id.

[0138] sps_id(i) indicates the sequence_parameter_set_id of the currently activated sequence parameter set, and sps_id can have a value of 0 to 31, or more specifically, a value of 0 to 15.

[0139] (2-3) Also, as shown in Table 10, it is possible to signal only the vps_id by excluding the sps_id and pps_id in the SEI message.

[0140] [Table 10]

[0141] (3) Another method for signaling activation of a video parameter set is to include information informing vps_id, sps_id, and pps_id in the Buffering period SEI message. Table 11 shows syntax including vps_id_present_flag, sps_id_present_flag, and pps_id_present_flag for indicating the presence or absence of vps_id, sps_id, and pps_id identifiers.

[0142] [Table 11]

[0143] (3-1) Also, as shown in Table 12, the activation of the parameter set can be signaled by including only the vps_id in the Buffering period SEI message, excluding the sps_id and pps_id.

[0144] [Table 12]

[0145] (4) Another method for parameter set activation signaling is to include information informing vps_id, sps_id, and pps_id in the Recovery point SEI message. Table 13 shows syntax including vps_id_present_flag, sps_id_present_flag, and pps_id_present_flag for indicating the presence or absence of vps_id, sps_id, and pps_id identifiers.

[0146] [Table 13]

[0147] (4-1) There is also a method of notifying only the vps_id, excluding the sps_id and pps_id, in the Recovery point SEI message, as shown in Table 14.

[0148] [Table 14]

[0149] The message conveying the above-mentioned vps_id or sps_id can be included in an intra random access point (IRAP) access unit.

[0150] When at least one of the above-mentioned information signaling methods is included in and used in an access unit, the extractor can search for vps_id, sps_id, and pps_id values ​​via the signaling methods and manage one or more vps / sps / pps to extract a bitstream.

[0151] Also, a decoding device or a decoding unit performing decoding can search for vps_id, sps_id, and pps_id values ​​through the signaling method, activate a corresponding parameter set, and decode an AU associated with the parameter set.

[0152] Representation of bitstreams in extended types

[0153] Hereinafter, when a bitstream that supports layer extension is included, we propose VPS extension_info() and a new SEI message to indicate and signal information about the scalable layer. In the extended type, the following information can be signaled to represent the bitstream.

[0154] The layer_id signals whether to convey the layer priority value.

[0155] In this case, spatial hierarchy (identified by dependency_id value), image quality hierarchy (identified by quality_id value), viewpoint (identified by view_id value), etc. can be signaled corresponding to each layer_id value, and temporal layer can be identified by temporal_id in the NALU header.

[0156] Additionally, the region of the video associated with the layer_id can be signaled by the region_id.

[0157] In addition, among the scalable layers, dependency information, bitrate information of each scalable layer, and quality information of each scalable layer can be signaled.

[0158] The extension_info() syntax is as shown in Table 15.

[0159] [Table 15] TIFF0007583890000016.tif173150

[0160] The meanings for the syntax in Table 15 are as follows:

[0161] -num_frame_sizes_minus1 plus1 indicates the maximum number of size information of other types of images included in the encoded video sequence (e.g., pic_width_in_luma_samples[i], pic_height_in_luma_samples[i], pic_cropping_flag[i], pic_cropping_flag[i], pic_crop_left_offset[i], pic_crop_right_offsetv[i], pic_crop_top_offset[i], pic_crop_bottom_offset[i]). The value of num_frame_sizes_minus1 may range from 0 to X. Other types of images may include images having different resolutions.

[0162] -num_rep_formats_minus1 plus1 indicates the maximum number of other types of bit depths and chroma formats (e.g., bit_depth_luma_minus8[i], bit_depth_chroma_minus8[i], and chroma_format_idc values[i]) included in the coded video sequence. The num_rep_formats_minus1 value has a range of 0 to X.

[0163] -pic_width_in_luma_samples[i], pic_height_in_luma_samples[i], pic_cropping_flag[i], pic_cropping_flag[i], pic_crop_left_offset[i], pic_crop_right_offsetv[i], pic_crop_top_offset[i], and pic_crop_bottom_offset[i] indicate the i-th pic_width_in_luma_samples, pic_height_in_luma_samples, pic_cropping_flag, pic_cropping_flag, pic_crop_left_offset, pic_crop_right_offsetv, pic_crop_top_offset, and pic_crop_bottom_offset values ​​of the encoded video sequence.

[0164] - bit_depth_luma_minus8[i], bit_depth_chroma_minus8[i], and chroma_format_idc[i] indicate the i-th bit_depth_luma_minus8, bit_depth_chroma_minus8, and chroma_format_idc values ​​of the encoded video sequence.

[0165] -num_layers_minus1 indicates the number of scalable layers possible in the bitstream.

[0166] -dependency_id_flag, when set to 1, indicates that there are one or more dependency_id values ​​associated with the layer_id value.

[0167] -quality_id_flag, when set to 1, indicates that there are one or more quality_id values ​​associated with the layer_id value.

[0168] -view_id_flag, when set to 1, indicates that there are one or more view_id values ​​associated with the layer_id value.

[0169] -region_id_flag equals 1 to indicate that there are one or more region_id values ​​associated with the layer_id value.

[0170] -layer_dependency_info_flag, when set to 1, indicates that dependency information for the scalable layer is provided.

[0171] - frame_size_idx[i] indicates an index for a set of frame sizes applied to a layer with a layer_id value of i. frame_size_idx[i] has a value in the range of 0 to X.

[0172] -rep_format_idx[i] indicates an index for a set of bit depth and chroma format applied to a layer with a layer_id value of i. rep_format_idx[i] has a value in the range of 0 to X.

[0173] -When one_dependency_id_flag[i] is 1, it indicates that there is only one dependency_id associated with the layer_id value i, and when one_dependency_id_flag[i] is 0, it indicates that there are two or more dependency_id values ​​associated with the layer_id value i.

[0174] -dependency_id[i] indicates the dependency_id value associated with layer_id value i.

[0175] - dependency_id_min[i] and dependency_id_max[i] indicate the minimum and maximum dependency_id values, respectively, associated with layer_id value i.

[0176] - When one_quality_id_flag[i] is 1, it indicates that there is only one quality_id associated with the layer_id value i, and when one_quality_id_flag[i] is 0, it indicates that there are two or more quality_id values ​​associated with the layer_id value i.

[0177] -quality_id[i] indicates the quality_id value associated with layer_id value i.

[0178] -quality_id_min[i] and quality_id_max[i] indicate the minimum and maximum quality_id values, respectively, associated with layer_id value i.

[0179] -one_view_id_flag[i], when 1, indicates that there is one view_id associated with layer_id value i, and when 0, indicates that there are two or more view_id values ​​associated with layer_id value i.

[0180] -view_id[i] denotes the view_id value associated with layer_id value i.

[0181] -depth_flag[i] equal to 1 indicates that the current scalable layer with layer_id value i contains depth information for the 3D video bitstream.

[0182] -view_id_min[i] and view_id_max[i] denote the minimum and maximum view_id values, respectively, associated with layer_id value i.

[0183] -num_regions_minus1 plus1 indicates the number of regions associated with layer_id value i.

[0184] -region_id[j] indicates the identifier of the region j associated with layer_id value i.

[0185] -num_directly_dependent_layers[i] indicates the number of scalable layers directly related to the current scalable layer i (layers required for forming a prediction signal during decoding).

[0186] -directly_dependent_layer_id_delta_minus1[i][j] plus 1 indicates the difference between the current scalable layer, layer_id[i], and the layer identifier of the jth scalable layer to which the current scalable layer is directly associated. The layer identifier of the jth directly associated scalable layer is (layer_id[i]-directly_dependent_layer_id_delta_minus1[i][j]-1).

[0187] The extension_info() syntax according to another embodiment is as shown in Table 16.

[0188] [Table 16]

[0189] As shown in Table 16, pic_width_in_luma_samples[i], pic_height_in_luma_samples[i], bit_depth_luma_minus8[i], bit_depth_chroma_minus8[i], and chroma_format_idc[i] can be used to signal information for different representation formats.

[0190] According to another embodiment, pic_width_in_luma_samples[i], pic_height_in_luma_samples[i], bit_depth_luma_minus8[i], bit_depth_chroma_minus8[i], and chroma_format_idc[i] may be signaled to information for different images, i.e., pictures having different resolutions.

[0191] The syntax for the activation SEI message for signaling bit rate and quality information is as shown in Table 17.

[0192] [Table 17]

[0193] The meanings for the syntax in Table 17 are as follows:

[0194] -num_layers_minus1 indicates the number of scalable layers that can be provided in the bitstream.

[0195] -bitrate_info_flag, when set to 1, indicates that bitrate information for each scalable layer is provided.

[0196] -quality_info_flag, when equal to 1, indicates that information on the quality values ​​for each scalable layer is provided.

[0197] -quality_type_flag, when equal to 1, indicates that information on the quality type for each scalable layer is provided.

[0198] -max_bitrate[i] indicates the maximum bitrate of the scalable layer with layer_id value i, and average_bitrate[i] indicates the average bitrate of the scalable layer with layer_id value i.

[0199] -quality_value[i] indicates the quality value of scalable tier i.

[0200] -quality_type_uri[QualityTypeUriIdx] is the QualityTypeUriIdx-th byte of a null-terminated string encoded in UTF-8 characters, and indicates a universal resource identifier (URI) containing a representation for the type of quality value.

[0201] In the following, we propose a method to improve the VPS (video parameter set) as an improvement of the description method for efficient bitstream extraction.

[0202] Layer referencing )

[0203] There can be two ways to indicate the relationship between layer_id and scalability dimension ID in a bitstream that supports multiple hierarchies: a first way that indicates the mapping method between layer_id and scalability dimension ID, and a second way that partitions or splices the bits of layer_id to indicate what dimension type is present in the assigned bits.

[0204] In a bitstream supporting multiple layers, dimension type means a type of scalability such as spatial scalability or quality scalability, and dimension ID means an index for a layer that a particular dimension type can have.

[0205] In a bitstream that supports multiple layers, it is common for a particular layer (to aid in understanding, for example, temporal sub-layer 3 in the case of supporting temporal scalability in a single layer bitstream) to directly reference the next lower layer (e.g., temporal sub-layer) in a particular dimension.

[0206] Also, for example, when supporting spatial scalability, this means that spatial layer 2 directly references the next lower spatial layer 1.

[0207] Therefore, to illustrate such cases, we propose to describe the dimensions with the default direct dependency first.

[0208] Specific dependencies can then be specified in a description loop for a scalable layer.

[0209] A method for signaling a hierarchical reference using the above two methods will be presented below. The improved syntax for vps_extension is shown in Tables 18 to 21.

[0210] [Table 18]

[0211] Table 18 shows the syntax for mapping layer_id and scalability dimension ID using the first method. The meaning of the syntax in Table 18 is as follows:

[0212] -all_default_dependency_flag, when set to 1, indicates that all hierarchy dimensions have a default dependency, i.e., in a particular dimension i, a hierarchy with dimension_id[i]=n directly references other hierarchies with dimension_id[i]=n-1 as the default.

[0213] When all_default_dependency_flag is 0, it indicates that all hierarchical dimensions do not have base references. When all_default_dependency_flag is 0, num_default_dim_minus1 below is signaled.

[0214] -num_default_dim_minus1 indicates the number of dimensions that have a default dependency.

[0215] -dimension[j] specifies the type of hierarchical dimension with default dependency. That is, information on the type of hierarchical dimension with default dependency is signaled while increasing the number of dimensions with default dependency by one. In the corresponding dimension, the upper hierarchy (e.g., dimension_id=n) directly references the next lower hierarchy (e.g., dimension_id=n-1).

[0216] - When specific_dependency_flag[i] is 1, it means that there are direct dependences / references specifically described for the corresponding layer. Therefore, when specific_dependency_flag[i] is 1, the number of layers that the corresponding layer directly references and the ID of the corresponding layer are signaled.

[0217] Layer C directly referring to layer B means that the decoder must use information of layer B (decoded or not decoded) to decode layer C. However, if layer B directly uses information of layer A, layer C is not determined to directly refer to layer A.

[0218] [Table 19]

[0219] Table 19 shows the syntax for assigning bits of layer_id to scalability dimension types using the second method and signaling the length of the assigned dimension type.

[0220] num_dimensions_minus1 in Table 19 indicates the number of hierarchical dimensions in the NALU header. That is, the number of hierarchical dimensions in the NALU header is identified, and the number of bits allocated to the hierarchical type and dimension type for each corresponding hierarchical dimension is identified.

[0221] The descriptions for the syntax elements all_default_dependency_flag, num_default_dim_minus1, dimension[j], and specific_dependency_flag[i] for syntax hierarchy reference in Table 19 have the same meaning as the syntax contained in Table 18.

[0222] Tables 20 and 21 show syntaxes that are different from those in Tables 18 and 19. Table 20 shows another syntax for indicating a default dependency when the first method is used, and Table 21 shows another syntax for indicating a default dependency when the second method is used.

[0223] [Table 20]

[0224] [Table 21]

[0225] Among the syntax in Tables 20 and 21, explanations of the syntax that overlaps with Tables 18 and 19 will be omitted.

[0226] A new syntax element default_dependency_flag[i] included in Tables 20 and 21 indicates whether dimension type i uses base references. In that dimension, higher hierarchies (e.g., dimension_id[i]=n) directly reference lower hierarchies (e.g., dimension_id[i]=n-1).

[0227] That is, when a specific dimension type is specified by num_dimensions_minus1 and dimension_type[i], it signals whether the corresponding dimension type uses a base reference, and if not, it signals information about the layer that the corresponding hierarchy directly references.

[0228] The dimension types according to the present invention are as shown in Table 22.

[0229] [Table 22]

[0230] According to the present invention, dimension types 4 and 5, ie, types indicating priority ID and region ID, are added to the existing dimension types.

[0231] Basically, dimension_type[i][j] can have a value from 0 to 5. Other values ​​can be defined later, and the decoder can ignore the value of dimension_type[i][j] if it is not a value from 0 to 5.

[0232] When dimension_type has a value of 4, the corresponding dimension_id indicates the id of the priority layer of the bitstream in the SVC standard.

[0233] If dimension_type has a value of 5, the corresponding dimension_id indicates the id of a specific region of the bitstream. The specific region can be one or more spatial-temporal segments in the bitstream.

[0234] FIG. 4 is a control flow diagram illustrating a method for encoding video information according to the present invention.

[0235] As shown, the encoding device encodes a Network Abstraction Layer (NAL) unit including information related to a video (S401).

[0236] The NAL unit header of a NAL unit does not contain any information indicating whether the NAL unit contains a slice that contains at least some or all of a non-reference picture.

[0237] On the other hand, the NAL unit header includes layer identification information for identifying a scalable layer in a bitstream that supports scalable layers.

[0238] In this case, the bits used to signal information indicating whether a NAL unit not included in the NAL unit header includes a slice that includes at least a portion or all of a non-reference picture can be used to signal layer identification information.

[0239] In addition, the NAL unit can include information on various parameter sets necessary for decoding an image.

[0240] The encoder can encode a supplemental enhancement information (SEI) message, which includes information on activated parameter sets, into an independent NAL unit.

[0241] The information on the activated parameter set may include at least one of information for indexing an activated video parameter set and information for indexing an activated sequence parameter set.

[0242] In addition, the information on the activated parameter set may include information for indexing the activated video parameter set, information indicating the number of sequence parameter sets that reference the activated video parameter set, and information for indexing the sequence parameter set.

[0243] Information about such parameter sets can be used when a decoder extracts sub-layers that provide temporal scalability.

[0244] In addition, a decoding device or a decoding unit that performs decoding can use information on the parameter set when activating a parameter set required when decoding a video coding layer NALU.

[0245] The encoder sends NAL units containing information related to the encoded video to a bitstream (S402).

[0246] FIG. 5 is a control flow diagram illustrating a method for decoding video information according to the present invention.

[0247] Referring to FIG. 5, a decoding device receives an NAL unit including information related to an encoded video via a bitstream (S501).

[0248] The decoder parses the header and the NAL payload of the NAL unit (S502). Parsing of the video information can be performed by an entropy decoder or a separate parser.

[0249] A decoder can obtain various pieces of information contained in the NAL unit header and the NAL payload through parsing.

[0250] The NAL unit header includes layer identification information for identifying a scalable layer in a bitstream that supports a scalable layer, and does not include 1-bit flag information indicating whether the NAL unit is a non-reference picture or a reference picture in the entire bitstream when encoding the NAL unit.

[0251] In this case, the bits used to signal information indicating whether a NAL unit not included in the NAL unit header includes a slice that includes at least a portion or all of a non-reference picture can be used to signal layer identification information.

[0252] In addition, the decoding device can obtain information on a parameter set required for decoding a NALU associated with a corresponding SEI message contained in the SEI message through parsing.

[0253] The information on the activated parameter set may include at least one of information for indexing an activated video parameter set and information for indexing an activated sequence parameter set.

[0254] In addition, the information on the activated parameter set may include information for indexing the activated video parameter set, information indicating the number of sequence parameter sets that reference the activated video parameter set, and information for indexing the sequence parameter set.

[0255] Information about such parameter sets can be used when a decoder extracts sub-layers that provide temporal scalability.

[0256] Additionally, information about the parameter set can be used when decoding a bitstream or when performing session negotiation (eg, session negotiation in streaming over an IP network).

[0257] In the above embodiments, the method is described based on a flow chart with a series of steps or blocks, but the present invention is not limited to the order of steps, and certain steps can occur in a different order or simultaneously with other steps than those described above. Also, a person having ordinary skill in the art will understand that the steps shown in the flow chart are not exclusive, and other steps can be included, or one or more steps of the flow chart can be deleted without affecting the scope of the present invention.

[0258] The above-described embodiments include examples of various aspects. It is not possible to describe all possible combinations of the various aspects, but a person having ordinary skill in the art can recognize that other combinations are possible. Therefore, the present invention includes all alterations, modifications, and variations that fall within the scope of the claims.

Claims

1. 1. A method for performing video decoding, comprising the steps of: receiving an extension flag indicating whether information for multiple layers is provided; receiving representation format number information indicating a number of representation formats for the plurality of layers when the extension flag indicates that information for the plurality of layers is provided; obtaining the representation format based on the number determined by the representation format number information; and performing the video decoding using the representation format.

2. 1. A method for performing video encoding, comprising the steps of: determining whether information for multiple layers is provided; encoding an extension flag of a video parameter set based on the determination; encoding representation formats for the plurality of layers and representation format number information indicating the number of the representation formats when the extension flag indicates that information for the plurality of layers is provided; and performing the video encoding using the representation format.

3. A bitstream transmission method for transmitting a bitstream encoded by a video encoding method, comprising: The video encoding method comprises: determining whether information for multiple layers is provided; encoding an extension flag of a video parameter set based on the determination; encoding representation formats for the plurality of layers and representation format number information indicating the number of the representation formats when the extension flag indicates that information for the plurality of layers is provided; and performing the video encoding using the representation format.

Citation Information

Patent Citations

  • Packet format of network abstraction layer unit, and algorithm and apparatus for video encoding and decoding using the format, QOS control algorithm and apparatus for IPV6 label switching using the format

    WO2008085013A1

  • Coding parameter sets and NAL unit headers for video coding

    WO2013106705A2

  • Scalable data stream and network entity

    WO2013153227A2