Video information decoding method, video decoding method and device using the same

Abstract

To provide a method and apparatus for describing extraction and scalability information within layered bit streams.SOLUTION: An image information decoding method includes receiving a bit stream including a Network Abstraction Layer (NAL) unit that includes information related to encoded image, and parsing a NAL unit header of the NAL unit. The NAL unit header does not include 1 bit flag information that represents whether a picture is a non-reference picture or a reference picture in the entire bit stream during encoding.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to video encoding and decoding processes, and more particularly to The present invention relates to a method and apparatus for decoding video information. [Background technology]

[0002] Recently, HD (High Definition) resolution broadcasting services have been available in Korea. As the Internet expands worldwide, many users are becoming accustomed to high-resolution, high-quality images. This has spurred many organizations to accelerate their development of next-generation imaging equipment. In addition to HDTV, there is also UHD (Ultra High Definition), which has a resolution four times that of HDTV. As interest in HD (High Definition) grows, higher resolution and higher quality images are required. Compression techniques for

[0003] For video compression, the data included in the current picture from previous and / or subsequent pictures is Inter prediction technology predicts pixel values ​​in the current picture. Intra prediction technology, which predicts pixel values ​​contained in the current picture using the A short code is assigned to the symbol that occurs frequently, and a short code is assigned to the symbol that occurs less frequently. For example, an entropy coding technique that assigns a long code to .

[0004] Video compression technology is subject to the limitations of hardware without considering the dynamic network environment. There are technologies that provide a constant network bandwidth in the operating environment. However, the bandwidth may change from time to time. In order to compress video data to be applicable to the network environment, new compression technology is required. For this purpose, a scalable video encoding / decoding method is used. It is possible. Summary of the Invention [Problem to be solved by the invention]

[0005] The technical problem of the present invention is to extract and store scalability information in a hierarchical bitstream. The present invention provides a method and apparatus for performing the method.

[0006] Another technical object of the present invention is to provide a method for scalability of various kinds of bitstreams in a flexible manner. The present invention provides a method and apparatus for representing quality information.

[0007] Another technical object of the present invention is to provide a method for extracting and scalability information in a hierarchical bitstream. To provide a method and apparatus for adaptively providing information at a packet level in a transformable manner. . [Means for solving the problem]

[0008] According to an embodiment of the present invention, a video information decoding method includes: NAL (Network Abstraction Layer) unit containing information related to receiving a bitstream including NAL units; and parsing the NAL unit header, When encoding a unit, whether it is a non-reference picture in the entire bitstream or does not include 1-bit flag information indicating whether it is a reference picture.

[0009] According to an embodiment of the present invention, a video decoding method includes: decoding a received picture; and a step of converting the decoded picture into a DPB (decoded picture block). and displaying the decoded image as a reference picture in a buffer. parsing a slice header for a picture following the picture; The decoded picture is based on reference picture information included in the device header. and indicating whether the picture is a reference picture or a non-reference picture. .

[0010] In another embodiment of the present invention, the SEI includes information on the activated parameter set. (Supplemental enhancement information) Message The parameter set is then parsed for the received message. Effect of the Invention

[0011] According to one embodiment of the present invention, extraction and scalability information in a hierarchical bitstream is A method and apparatus for describing information is provided.

[0012] According to one embodiment of the present invention, a method for scalability of various types of bitstreams in a flexible manner is provided. A method and apparatus for representing quality information is provided.

[0013] According to another embodiment of the present invention, extraction and scalability in hierarchical bitstreams A method and apparatus are provided for providing packet-level adaptively transformable information. [Brief description of the drawings]

[0014] [Figure 1] 1 is a block diagram showing a configuration of a video encoding device according to an embodiment. [Diagram 2]FIG. 1 is a block diagram showing a configuration of a video decoding device according to an embodiment. [Diagram 3] 1 is a conceptual diagram illustrating an embodiment of a scalable video coding structure using multiple layers to which the present invention can be applied; [Figure 4] 2 is a control flow diagram illustrating a method for encoding video information according to the present invention; [Diagram 5] 2 is a control flow diagram illustrating a method for decoding video information according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, a detailed description of related known configurations or functions is provided in the present specification. If it is determined that a detailed explanation would make the gist of the content unclear, it will be omitted.

[0016] When an element is referred to as being "coupled" or "connected" to another element, may be directly connected to or connected to the other components. However, it should be understood that there may be other components in between. In the above, the content that describes a specific configuration as "including" does not exclude configurations other than the applicable configuration. However, additional configurations may be included within the scope of the present invention or the technical concept of the present invention. It means you can.

[0017] The terms "first," "second," etc. may be used to describe various components. The elements should not be limited by the terms. The terms should not be used to translate one component into another. For example, the first element may be used without departing from the scope of the present invention. The component can be named the second component, and similarly, the second component can be named the first component. The components can be named as constituent elements.

[0018] In addition, the components shown in the embodiments of the present invention are independent in order to exhibit different characteristic functions. The components are shown in the figure, and each component is separate hardware or a single software configuration. That is, for the sake of convenience, each component is referred to as a separate component. At least two of the components are combined to form one A component is composed of a number of components, or one component is divided into a number of components to perform a function. The present invention also includes both integrated and separated embodiments of the respective components. As long as it does not deviate from the above, it is within the scope of the present invention.

[0019] In addition, some components are not essential components for performing essential functions in the present invention, It is merely an optional component for improving performance. The present invention does not The present invention is embodied by including only the essential components for embodying the essence of the present invention, excluding the components described below. Only essential components are included, excluding optional components that are used solely for performance enhancement. Also included within the scope of the present invention is a structure including

[0020] FIG. 1 is a block diagram showing a configuration of a video encoding device according to an embodiment of the present invention. A video encoding / decoding method or apparatus has scalability. Extensions (extensions) of general video encoding / decoding methods or devices that do not provide the ability The block diagram of FIG. 1 shows a scalable video 1 shows an embodiment of a video encoding device on which the encoding device can be based.

[0021] Referring to FIG. 1, the video encoding device 100 includes a motion prediction unit 111, a motion compensation unit 112, and a motion estimation unit 113. 2, intra prediction unit 120, switch 115, subtractor 125, transform unit 130, quantization unit 1 40, entropy coding unit 150, inverse quantization unit 160, inverse transform unit 170, adder 175 , a filter unit 180 and a reference image buffer 190 .

[0022] The video encoding device 100 performs intra mode or inter mode for the input video. By encoding in inter mode, the bit stream m) can be output. Intra prediction means prediction within a picture, and inter prediction means prediction within a picture. If it is in intra mode, the switch 115 is switched to intra. If the video signal is in the inter mode, the switch 115 is switched to the inter mode. The image-encoding device 100 generates a predicted block for an input block of an input image, and then The difference between the block and the prediction block can be coded.

[0023] In the case of the intra mode, the intra prediction unit 120 predicts the already encoded data of the current block. A predicted block is generated by performing spatial prediction using pixel values ​​of the block. It is possible.

[0024] In the case of the inter mode, the motion prediction unit 111 uses the reference image buffer 1 Searches for the area that best matches the input block in the reference image stored in The motion compensation unit 112 calculates the motion vector and the reference video buffer. 190, a prediction block is generated by performing motion compensation using the reference image stored in the It is possible to generate a check.

[0025] The subtractor 125 subtracts the residual block from the difference between the input block and the generated predicted block. The conversion unit 130 can generate a residual block. By performing a transform on the The quantization unit 140 can output the input coefficient. The quantized transform coefficients are quantized by the quantization parameter. ed coefficient) can be output.

[0026] The entropy coding unit 150 uses the value calculated by the quantization unit 140 or the value calculated during the coding process. Based on the coding parameter values, etc., the symbols are assigned according to a probability distribution. By entropy coding, a bit stream is output. The entropy coding method receives input of symbols having various values ​​and performs statistical It is a method to eliminate redundant data and represent it as a sequence of binary numbers that can be decoded.

[0027] Here, a symbol is a syntax element to be encoded / decoded and and coding parameters, residual signal The coding parameters are the media required for coding and decoding. It is an intermediate variable, and like syntax elements, it is information that is encoded by the encoder and transmitted to the decoder. In addition, it can include information that can be inferred during the encoding or decoding process. The coding parameters refer to the information required to encode or decode an image. Intra / Inter prediction mode, motion vector, reference image index, coding block pattern The number of blocks, the presence or absence of residual signals, the transform coefficients, the quantized transform coefficients, the quantization parameters, The residual signal may include values ​​or statistics such as magnitude, block division information, etc. It means the difference between the original signal and the predicted signal, and the difference between the original signal and the predicted signal is called the transform. orm) form, or the difference between the original signal and the predicted signal is transformed and quantized The residual signal is called a residual block in block units.

[0028] When entropy coding is applied, symbols with high occurrence probability are assigned a small number of binarizations. symbols with low probability of occurrence are assigned a large number of bits. By representing the symbol, the size of the bit string for the symbol to be encoded is reduced. Therefore, the compression performance of video coding through entropy coding can be reduced. can be increased.

[0029] For entropy coding, exponential golomb, CAVLC(Context-Adaptive Variable Length Cod ing), CABAC (Context-Adaptive Binary Arithme Entropy coding (entropic coding) can be used. The encoding unit 150 includes a variable length coding (VLC) Entropy coding tables such as the Entropy Coding / Code table are used to perform entropy coding. The entropy coding unit 150 can store the variable length coding (V Entropy coding can be performed using the LC table. The P encoder 150 performs binarization of the target symbol and After deriving the probability model for the symbols / bins , performing entropy coding using the derived binarization method or probability model; It is also possible.

[0030] The quantized coefficients are inversely quantized by the inverse quantization unit 160 and inversely transformed by the inverse transformation unit 170. The inverse quantized and inverse transformed coefficients are added to the prediction block via an adder 175. can be added together to generate a reconstruction block.

[0031] The reconstructed block is passed through a filter unit 180, which performs a deblocking filter. (deblocking filter), SAO (Sample Adaptive O ffset), ALF (Adaptive Loop Filter) The above can be applied to the reconstructed block or the reconstructed picture. The reconstructed block can be stored in the reference picture buffer 190 .

[0032] FIG. 2 is a block diagram showing a configuration of a video decoding device according to an embodiment of the present invention. As described above, the scalable video encoding / decoding method or apparatus provides scalability. It can be realized by extending a general image encoding / decoding method or device that is not provided in the present invention. The block diagram of FIG. 2 shows a video decoder that can be used as a basis for a scalable video decoding device. 1 shows an embodiment of a decoding device.

[0033] Referring to FIG. 2, the video decoding apparatus 200 includes an entropy decoding unit 210, an inverse 2. A decoder 220, an inverse transformer 230, an intra-predictor 240, a motion compensation unit 250, and a filter unit 260 and a reference image buffer 270.

[0034] The video decoding device 200 receives the bit stream output from the encoder and By performing decoding in intra-mode or inter-mode, the reconstructed image, i.e. When the camera is in intra mode, the switch is set to intra. If the video is switched to inter mode, the switch is switched to inter. The decoding device 200 decodes a residual block (res) reconstructed from an input bitstream. After obtaining the dual block, the predicted block is generated, and the reconstructed residual block is The predicted block can be added to generate a reconstructed block, i.e., a reconstructed block. do.

[0035] The entropy decoding unit 210 decodes the input bit stream according to a probability distribution. Trope decoding and quantized coefficient form The entropy decoding method can generate symbols including symbols of different states. The entropy decoding method is a method of generating each symbol by taking a sequence of numbers as input. This is similar to the entropy coding method described above.

[0036] The quantized coefficients are inversely quantized in the inverse quantization unit 220 and inversely transformed in the inverse transformation unit 230. , the quantized coefficients are inversely quantized / inversely transformed to obtain the restored residual block (resid A virtual block can be generated.

[0037] In the case of the intra mode, the intra prediction unit 240 predicts the already encoded data of the current block. A predicted block is generated by performing spatial prediction using pixel values ​​of the block. In the case of the inter mode, the motion compensation unit 250 calculates the motion vector and the reference By performing motion compensation using the reference image stored in the reference image buffer 270, Thus, a prediction block can be generated.

[0038] The reconstructed residual block and the predicted block are added via an adder 255. The resulting block is passed through the filter unit 260. The filter unit 260 uses a deblocking filter , SAO, and ALF are applied to the reconstructed block or the reconstructed picture. The filter unit 260 outputs a reconstructed image, that is, a restored image. The reconstructed image can be stored in a reference image buffer 270 and used for inter-picture prediction.

[0039] The image decoding device 200 includes an entropy decoding unit 210 and an inverse quantization unit 2 20, an inverse transform unit 230, an intra prediction unit 240, a motion compensation unit 250, a filter unit 260, and and reference picture buffer 270, components directly related to decoding of pictures, such as An entropy decoding unit 210, an inverse quantization unit 220, an inverse transformation unit 230, and an intra prediction unit 24 0, the motion compensation unit 250, the filter unit 260, etc. are separated from other components and are referred to as a decoding unit or It can be represented in the decoding section.

[0040] In addition, the video decoding device 200 receives the encoded data included in the bitstream. The image processing device may further include a parsing unit (not shown) for parsing information related to the image. The parsing unit may include an entropy decoding unit 210. The parsing unit may be included in the decoding unit 210. Alternatively, the above-mentioned configuration may be realized as a single component of the block.

[0041] FIG. 3 shows a scalable video codec using multiple layers to which the present invention can be applied. FIG. 3 is a conceptual diagram showing an example of a loading structure. A group of pictures is called a picture group.

[0042] A transmission medium is required to transmit video data, and its performance varies depending on the network. The transmission media varies depending on the network environment. A scalable video coding method may be provided for application to.

[0043] The scalable video coding method uses texture information, motion information, and It is a coder that improves the coding / decoding performance by removing redundancy between layers using information, residual signals, etc. The scalable video coding method is a coding method that reduces the transmission bit rate, transmission error, and Depending on the surrounding conditions such as image quality, image rate, and system resources, This provides excellent scalability.

[0044] Scalable video coding is a bitstream coding technique that can be applied to various network conditions. Multiple layers construction to provide a For example, the scalable video coding structure may be implemented using It may include a base layer that compresses video data using a common video encoding method. The image data is compressed using the base layer coding information and a general image coding method. It may include an enhancement layer that manages

[0045] Here, layers are spatial (e.g., image size), temporal ( temporal (e.g., encoding order, video output order, frame rate), image quality, complexity A collection of images and bit streams classified based on the quality, etc. The base layer means the reference layer or base layer, and the improved layer means Layer means enhancement layer. Also, multiple hierarchies are mutually It can also have dependencies.

[0046] Referring to FIG. 3, for example, the basic hierarchy is SD (standard definition n), 15Hz frame rate, 1Mbps bit rate, can be defined as the first improvement The hierarchy is HD (high definition), 30Hz frame rate, 3.9Mbps The second improvement tier is 4K-UHE (ultra high-efficiency). h definition), 60Hz frame rate, 27.2Mbps bit rate The format, frame rate, bit rate, etc. can be The above is merely an example, and may be changed as needed. The number of the elements is not limited to this embodiment, and may be determined differently depending on the situation. do.

[0047] For example, when the transmission bandwidth is 4 Mbps, the frame rate of the first enhancement layer HD is The scalable video coding method can be used to reduce the bit rate to 15 Hz or less. The method detailed in the embodiment of FIG. 3 provides temporal, spatial and image quality scalability. It can be provided.

[0048] Hereinafter, scalable video coding refers to a scalable video coding method in terms of coding. It has the same meaning as encoding, and in terms of decoding, it has the same meaning as scalable video decoding. Yes.

[0049] As mentioned above, scalability is currently limited by the heterogeneous communication networks and various terminals. AVC (Advanced Video Codec) has become an important feature of the video format. SVC (Scalable Video Coding), an extension standard of SVC, is a compression It produces bitstreams with a wide range of bit rates while maintaining maximum efficiency. It was developed to be able to create a wide variety of devices and network characteristics and changes. To meet this requirement, the SVC bitstream can be easily extracted in various ways. That is, the SVC standard is a standard that combines spatial, temporal, and image quality. Provides NR scalability.

[0050] On the other hand, bit streams containing multiple layers are transmitted over a packet switching network (P Facilitating adaptive transmission of video over an Acket-Switching Network NAL (Network Abstraction Layer) units Multi-view video, which includes multiple multi-view images in a bitstream as well as multiple layers, Multiple view inter-view video coding The relationship between the spatial hierarchy and the video supports multiple layers. The relationship between r and r is similar.

[0051] All nodes in the content delivery path In order to convert bitstreams effectively and efficiently, the bitstream scale must be The current video coding standard for a single layer ( In high efficiency video coding, NAL Unit (hereafter referred to as NAL Unit) The NALU header contains two fields related to hierarchical information: There are 3 bits of length for the partial_id and reserved_one_5 bits. The temporal_id with reserved_one_5bits indicates other layer information. This corresponds to an area for showing information.

[0052] The temporal layer is a video coding layer. A time-scalable bitstream composed of VCL (NAL units) temporal_id means a layer of a stream, a temporal layer has a specific temporal_id value.

[0053] The present invention provides a method for extracting video information (extension information) in a bitstream that supports multiple layers. raction and scalability information Patent application title: METHOD FOR COMPREHENSIVELY DESCRIBING AND SIGNALING THE SAME AND APPARATUS FOR EMBODIMENT THEREOF It is.

[0054] In this invention, we classify bitstreams into two types: temporal scalability base types, which only support scalability, and An extension table that can have scalability to support space / image quality / viewpoint including time. I will explain it by dividing it into two types:

[0055] The first type of bitstream is a bitstream that supports single-layer video. The second type is for HEVC-based hierarchical video coding. The following shows the scalability information for the two bitstream types: According to the present invention, in the extended type, 5-bit r reserved_one_5bits is the layer_i identifier of the scalable layer. It can be used as d.

[0056] Remove nal_ref_flag from NALU header

[0057] nal_ref_flag is the flag for non-reference pictures. This information is used to indicate non-reference and reference pictures. nce picture), but the nal_re The use of f_flag is somewhat restrictive.

[0058] A reference picture is a picture that follows in the decoding order. Inter prediction when decoding subsequent pictures means a picture that contains samples that can be used for

[0059] Non-reference pictures are in decoding order. First, when decoding the subsequent picture, the sample is included that is not used for inter prediction. This means a picture that includes

[0060] nal_ref_flag indicates whether the corresponding nal unit is the entire bitstream during encoding. A frame indicating information on whether a picture is a non-reference picture or a reference picture in the stream. It's a rug.

[0061] If nal_ref_flag is 1, the NALU is meter set), PPS(picture parameter set), APS(a daptation parameter set) or a slice of a reference picture If nal_ref_flag is 0, the NALU is not part of a non-reference picture. Or includes a slice that includes the whole.

[0062] In this case, the NALU with the nal_ref_flag value of 1 is a slice of a reference picture. nal_ref_flag can contain VPS(video parameter set), SPS(sequence parameter set), PPS(pictu re parameter set) has a value of 1 for the NALU of a particular picture. If one of the VCL NALUs has a nal_ref_flag value of 0, For all VCL NALUs nal_ref_flag has a value of 0.

[0063] On the other hand, all non-reference pictures, especially When most of the non-reference pictures corresponding to the highest temporal layer are extracted, all the remaining The nal_ref_flag of all pictures will be set to 1.

[0064] However, some pictures in the adaptively transformed (extracted) bitstream, i.e., the remaining A picture that corresponds to the highest temporal layer in the bitstream is marked with nal_ref_flag. Even if the picture is 1, it is a non-reference picture.

[0065] That is, other syntax elements in the NALU header (e.g., temporal_id) are appropriate. It is more effective in supporting adaptive conversion (extraction) of the entire bitstream. The desired time is selected using the number of temporal layers and the temporal_id value of the NALU header. The bitstream containing the desired layer can then be extracted.

[0066] Also, nal_ref_flag is composed of NALUs that contain nal_ref_flag. After decoding the picture, the DPB (decoded picture block) is When storing a picture in a memory such as a buffer, the picture is used as a reference picture in the future. It can also be used to indicate whether to use the If nal_ref_flag is 0, it indicates that the picture will be used as a reference picture. It can be displayed that it will not be used as a reference picture in the future.

[0067] Indicates whether the NALU is a non-reference picture or a reference picture via nal_ref_flag. When storing a decoded picture in the DPB without determining whether it is a picture, In this case, the decoded picture can be displayed as a non-reference picture. Even if it is displayed as a reference picture, the picture is not displayed in the decoding order. When decoding the next picture of the slice, the header of the next picture (slice The picture is not included in the reference picture list transmitted in the header. No problems occur.

[0068] That is, when decoding the next picture, the reference picture included in the slice header A picture previously decoded by the criterion is a reference picture, or is a non-reference picture. Therefore, via nal_ref_flag It is not determined whether the decoded picture is a reference picture, but Even if the decoded picture is displayed in the same frame, it is possible to distinguish between reference and non-reference pictures. There is no problem in determining whether it is a

[0069] In the present invention, the nal_ref_flag is removed from the NALU header, or the nal_r We propose to change the semantics of ef_flag. An embodiment related to flag deletion is as follows.

[0070] Example 1

[0071] Change nal_ref_flag to slice_ref_flag and set the flag position to NA Move from LU header to slice header. The syntax can be modified as shown in Table 1.

[0072] [Table 1]

[0073] In Table 1, if the value of slice_ref_flag is 1, the slice is a reference picture. If 0, the slice is part of a non-reference picture. Show.

[0074] Example 2

[0075] Change nal_ref_flag to au_ref_flag and move the flag location to NALU. from the header to the access unit delimiter The syntax of the access unit delimiter is shown in Table 2.

[0076] [Table 2]

[0077] In Table 2, if au_ref_flag is 1, the access unit does not have a reference picture. If 0, indicates that the access unit contains a non-reference picture. .

[0078] Example 3

[0079] Do not move nal_ref_flag to another syntax, but use nal_ref_flag from the NALU header.

[0080] During encoding, the entire bitstream is either a non-reference picture or a reference picture. The 1-bit flag nal_ref_flag indicating whether the ref is a texture is deleted. and whether the picture specified by nal_ref_flag is a reference picture. The determination of whether the received picture is decoded can be performed through other processes. After loading, the decoded picture is stored as DPB (decoded picture block). The decoded picture is displayed as an unconditional reference picture in the rebuffer. A picture can be displayed in a reference picture without determining whether it is a reference picture. do.

[0081] Then, the slice header for the next picture of the decoded picture is parsed. The slice header is used to decode the image based on the reference picture information. It is possible to indicate whether a given picture is a reference picture or a non-reference picture. can.

[0082] Example 4

[0083] Remove nal_ref_flag from the NALU header and call it a non-reference picture NALU. The temporal_id can be used to indicate information about the The id is either "7" or the maximum number of temporal layers contained in the bitstream minus 1 (i.e. max_temporal_layers_minus1) or the existing layer except "0". It can be a fixed value.

[0084] Example 5

[0085] Remove nal_ref_flag from the NALU header and call it a non-reference picture NALU. Reserved_one_5bits is configured as priority_id to indicate the information It can be used as an element. priority_id is the priority of the corresponding NALU ( Priority) is an identifier that indicates the priority regardless of different space, time and image quality. It is used to provide bitstream extraction functionality by position.

[0086] That is, if temporal_id=Ta is the identifier of the top temporal layer , temporal_id=Ta and priority_id=31 (or other special This is used to indicate that a NALU that is a non-reference picture is a NALU.

[0087] The 1 bit used to signal nal_ref_flag is one of the following: It can be used as either one.

[0088] (1) Can be used to indicate nal_unit_type. pe can be a 7-bit signal, and the number of NALU types can be increased by a factor of two. This can be done.

[0089] (2) It can be used to indicate a temporal_id. , the signal can be 4 bits, and the maximum number of temporal layers can be increased by a factor of two. do.

[0090] (3) can be used to indicate the layer_id. reserved_one_ means the identifier of the scalable layer of a layered bitstream It can be signaled by a 5-bit syntax element. The 5 bits of reserved_one_5bits used to identify the layer are The 1 bit used for signaling ref_flag is added to the lay er_id can be a 6-bit signal. If 6 bits are used, 64 A number of scalable hierarchies can be identified.

[0091] (4) Indicate whether reserved_one_5bits indicates priority. This can be used as a flag.

[0092] (5) Can be used as reserved_bit.

[0093] If you do not remove the nal_ref_flag from the NALU header, The meaning of the flag can be modified as follows:

[0094] If nal_ref_flag is 0, the NALU contains only slices of non-reference pictures. If nal_ref_flag is set to 1, the NALU is a reference picture or Indicates that slices of non-reference pictures may be included.

[0095] Video Parameter Set Activation Signaling

[0096] The video parameter set is used to decode the video. It contains the most basic information for a SPS and can include content that was already in the existing SPS. Cut.

[0097] The video parameter set includes a temporal layer that supports temporal scalability. The information for the sub-layer to be displayed and the spatial, Multiple tiers supporting quality and view scalability That is, a video parameter set can include information on multiple hierarchical layers. It may also include information about the HEVC standard, i.e., syntax for HEVC extensions.

[0098] A.Video Parameter Set

[0099] The syntax for the video parameter set is shown in Table 3.

[0100] [Table 3]

[0101] In Table 3, most of the syntax applies to bitstreams containing a single layer. The following additional parts have the same meaning as in the SPS syntax:

[0102] -video_parameter_set_id is the name of the video parameter set o parameter set) identifier, and SPS (sequence parameter set) identifier. meter set), SEI(supplemental enhancement in access unit delimiter ter).

[0103] - reserved_one_5bits if priority_id_flag is 1 This means that the priority_id is used in the same way as the SVC standard priority_id. If y_id_flag is 0, reserved_one_5bits is layer_id It is meant to be used as.

[0104] If -extension_info_flag is 0, the bitstream is HEVC Directs adherence to single-tier standards and, in the case of 1, improves support for scalability Indicates the layer (if HEVC extension is supported) and related information Provided.

[0105] B. Sequence Parameter Set (S PS) Fixed

[0106] As shown in Table 4, some of the existing syntax has been reflected in VPS and deleted from SPS. On the other hand, the vps_id syntax element may be added to the SPS. The SPS syntax with vps_id added is as shown in Table 4. In this case, deleted syntax is represented by a line drawn through the middle of the syntax.

[0107] vps_id is the name of the video parameter set referenced by the SPS. vps_id is a number between 0 and X. may have the following structure:

[0108] [Table 4]

[0109] C. Activation for Video Parameter Set (Activation) Signaling

[0110] The slice header contains the index for the picture parameter set that the slice refers to. The picture parameter set contains index information for the picture referenced by the picture. It contains index information for the sequence parameter set. The meter set contains information about the video parameter set that the sequence refers to. In this way, the information for the parameter set is parsed and Referencing the corresponding parameter set information is called activation.

[0111] To use information for a particular parameter set, i.e., to activate the parameter set To convert the slice header to a slice, it must be parsed sequentially. To know if the PS is active, all slice headers are This means that the PPS header and associated PPS must be analysed.

[0112] Extracting a portion of a sublayer (temporal layer) from a bitstream containing a single layer When outputting, the extractor extracts the NALU header and multiple parameter sets ( It is necessary to analyze (parse) the parameter set.

[0113] If the video parameter set or sequence parameter set includes NALU extraction, If the slice header contains information for This means that the extractor must parse the parameter set (param All syntax requirements for the slice set and slice header This means that you have to understand the elements.

[0114] In addition, during the video decoding process, vps_id or You can search for sps_id and activate only the parameter set you need. In this case , the parameters for which a video parameter set or a sequence parameter set is activated If index information is included, complex slice headers and related This reduces the parsing steps for consecutive PPSs.

[0115] However, only a small portion of these syntax elements is available for bitstream extraction. Nevertheless, the extractor cannot extract all the syntax requirements. Analyzing the elements can be a big burden. In this regard, the following method is proposed.

[0116] In the present invention, the activation of a parameter set is performed when the extractor is Slice header and associated PPS (picture picture sequence) Know which parameter sets are activated without analyzing the This means signaling so that

[0117] According to the present invention, any video parameter set, sequence parameter set or By separately signaling whether a picture parameter set is activated, The extractor analyzes all slice headers and associated PPSs. This can reduce the burden that has to be placed on the

[0118] The video parameter set can also be updated. You can know the currently activated VPS and associated SPS or PPS without analyzing the database. To do this, one of the following methods can be used:

[0119] (1) vps_id, sps_id, pps_id are treated as access unit delimiters. s unit delimiter). vps_id, sps_id , pps_id are the video parameters used for the NALU in the associated AU, respectively. This indicates the identifiers of the parameter set, sequence parameter set, and picture parameter set.

[0120] Each identifier is included in the access unit delimiter. vps_id_present_flag, sps_id_pre Use sent_flag and pps_id_present_flag to indicate the access The syntax of the unit delimiter is as shown in Table 5.

[0121] [Table 5]

[0122] (1-1) Other methods are as shown in Table 6, except for sps_id and pps_id, vps_i Only d is included in the access unit delimiter. It is possible to do so.

[0123] [Table 6]

[0124] (2) Another method for signaling the activation of a video parameter set is to use a new SEI The way to do this is to use the message (parameter_set_reference). The EI message returns the video parameter set used for the NALUs in the associated AU. vps_id indicates the identifier of the sequence parameter set or picture parameter set , sps_id, and pps_id are included.

[0125] vps_id_present_flag, sps_i d_present_flag, pps_id_present_flag syntax is available. The SEI syntax is as shown in Table 7.

[0126] [Table 7]

[0127] (2-1) Also, as shown in Table 8, pps_id is excluded, and sps_id and vps_id are set to SEI It can also be included in a message to indicate activation. It is included in the SEI message. sps_id and vps_id are the access unit (ac The sps_id and vp referenced by the video coding layer NALU of the Therefore, the sps_id and vps_id are activated. Information on possible parameter sets can be given.

[0128] [Table 8]

[0129] In Table 8, vps_id is the video parameter set of the currently active video parameter set. vps_id value can have a value between 0 and 15. This can be done.

[0130] If sps_id_present_flag has a value of 1, the currently active sequence The sequence parameter set sequence_parameter_set_id is It indicates that it is included in the EI message, and sps_id_present_flag is 0. If the value of sequence_parameter of the activated sequence parameter set is Indicates that the parameter_set_id is not included in the corresponding SEI message.

[0131] sps_id is the sequence_p of the currently active sequence parameter set. sps_id is a value between 0 and 31, more specifically , can have a value from 0 to 15.

[0132] If psr_extension_flag is 0, parameter set ref erence SEI message extension syntax element is para This means that the meter set reference is not included in the SEI message. If psr_extension_flag is 1, the parameter set re ference SEI message extension syntax element to par The ameter set reference SEI message contains the syntax It means to use it in an expanded way.

[0133] psr_extension_length is the length of psr_extension_data. The psr_extension_length has a value in the range of 0 to 256. and psr_extension_data_byte can have any value. It is possible.

[0134] (2-2) Also, as shown in Table 9, if you specify one or more sps_id and vps_id other than pps_id, The id can also be signaled in the SEI message.

[0135] [Table 9]

[0136] In Table 9, vps_id is the video parameter set of the currently active video parameter set. Indicates o_parameter_set_id. vps_id has a value between 0 and 15. can be done.

[0137] num_reference_sps is the number of sequences that refer to the currently active vps_id. This indicates the number of sequence parameter sets.

[0138] sps_id(i) is the sequence ID of the currently active sequence parameter set. e_parameter_set_id, sps_id is a value between 0 and 31, more specific can have a value from 0 to 15.

[0139] (2-3) Also, as shown in Table 10, the vps_id is Alternatively, only the QoS policy can be signaled in the SEI message.

[0140] [Table 10]

[0141] (3) Another method for signaling activation of a video parameter set is the Buffer ing period SEI message contains vps_id, sps_id, and pps_id. Table 11 shows the vps_id, sps_id, pps_id vps_id_present_flag, sps_id_p to indicate whether the identifier exists Syntax including resent_flag, pps_id_present_flag Indicates the service.

[0142] [Table 11]

[0143] (3-1) Also, as shown in Table 12, the vps_id is Buffering period SEI message contains only the parameter set It can also signal activation.

[0144] [Table 12]

[0145] (4) Another method for parameter set activation signaling is Recovery. Point Information that informs the SEI message of vps_id, sps_id, and pps_id Table 13 shows the existence of vps_id, sps_id and pps_id identifiers. vps_id_present_flag, sps_id_present to indicate whether This shows the syntax including t_flag and pps_id_present_flag.

[0146] [Table 13]

[0147] (4-1) Also, as shown in Table 14, the vps_id is Alternatively, the recovery point SEI message can be included to notify the user of the recovery point.

[0148] [Table 14]

[0149] The message that conveys the vps_id or sps_id mentioned above is IRAP(intr The IEEE 802.11a / b / g / n protocol may be included in a random access point (RAP) access unit.

[0150] At least one of the above-mentioned information signaling methods is included in the access unit and used. In the latter case, the extractor receives the signal via the signaling method in order to extract the bitstream. to find the vps_id, sps_id, and pps_id values, and s can be managed.

[0151] Also, the decoding device or the decoding unit that performs the decoding may be Find the vps_id, sps_id, and pps_id values ​​through the signaling method and set the corresponding parameters. Activating a parameter set and decoding the AU associated with the parameter set can.

[0152] Representation of bitstreams in extended types

[0153] In the following, when a bitstream that supports layer extension is included, the following applies to the scalable layer: The extension_info( ) and a new SEI message. To represent the bitstream, the following information must be signaled: can.

[0154] layer_id indicates whether to convey the layer priority value. Signaling what is happening.

[0155] At this time, the spatial hierarchy (dependency_id value) is assigned to each layer_id value. (identified by quality_id value), image quality hierarchy (identified by quality_id value), viewpoint (identified by view_id value) The temporal layer can signal the temp It can be identified by oral_id.

[0156] Also, the region of the video associated with the layer_id is signaled by the region_id. can be searched.

[0157] In addition, the dependency information and the b of each scalable hierarchy are Itrate information and quality information of each scalable layer can be signaled.

[0158] The extension_info() syntax is as shown in Table 15.

[0159] [Table 15] JPEG0007641416000016.jpg172150

[0160] The meanings for the syntax in Table 15 are as follows:

[0161] -num_frame_sizes_minus1 plus1 is the number of frames that are encoded Other types of image size information included in the sequence (e.g. pic_width_i n_luma_samples[i], pic_height_in_luma_samples [i], pic_cropping_flag[i], pic_cropping_flag[i] , pic_crop_left_offset[i], pic_crop_right_offs etv[i], pic_crop_top_offset[i], pic_crop_botto m_offset[i]) The value can range from 0 to X. Other types of images have different resolutions. It may include video.

[0162] -num_rep_formats_minus1 plus1 is the number of encoded video sequences Other bit depths and chrominance formats included in the sequence chroma format (e.g. bit_depth_luma_minus8[i ], bit_depth_chroma_minus8[i], and chroma_forma num_rep_formats_min (t_idc values[i]) The us1 value has a range of 0 to X.

[0163] -pic_width_in_luma_samples[i], pic_height_in _luma_samples[i], pic_cropping_flag[i], pic_cr opping_flag[i], pic_crop_left_offset[i], pic_c rop_right_offsetv[i], pic_crop_top_offset[i], pic_crop_bottom_offset[i] is the bottom offset of the encoded video sequence. i-th pic_width_in_luma_samples, pic_height_in _luma_samples, pic_cropping_flag, pic_croppi ng_flag, pic_crop_left_offset, pic_crop_right _offsetv, pic_crop_top_offset, pic_crop_botto Indicates the m_offset value.

[0164] -bit_depth_luma_minus8[i], bit_depth_chroma_ minus8[i] and chroma_format_idc[i] are the encoded video bit_depth_luma_minus8, bit_depth_ of the i-th sequence chroma_minus8, and chroma_format_idc values ​​are indicated.

[0165] -num_layers_minus1 is the number of scalable layers possible in the bitstream Indicates the number of.

[0166] -If dependency_id_flag is 1, the layer_id value and the associated This indicates that there are one or more dependency_id values.

[0167] -If quality_id_flag is 1, one or more associated with the layer_id value Indicates that there is a quality_id value of

[0168] -If view_id_flag is 1, one or more views associated with the layer_id value are displayed. Indicates that the ew_id value is present.

[0169] -If region_id_flag is 1, one or more Indicates that a region_id value is present.

[0170] - If layer_dependency_info_flag is 1, scalable layers Indicates that layer dependency information is provided.

[0171] -frame_size_idx[i] applies to the layer with layer_id value i frame_size_i indicates an index into the set of frame sizes. dx[i] has a value in the range of 0 to X.

[0172] -rep_format_idx[i] applies to the layer with layer_id value i The bit depth and chroma format rep_format_idx[i] is a value in the range 0 to X. has.

[0173] - If one_dependency_id_flag[i] is 1, the layer_id value indicates that there is only one dependency_id associated with i, If pendency_id_flag[i] is 0, the layer_id value is the Indicates the presence of one or more dependency_id values.

[0174] -dependency_id[i] is the dependency ID associated with layer_id value i. Indicates the ency_id value.

[0175] -dependency_id_min[i] and dependency_id_max[i] The minimum and maximum dependency_id values ​​associated with layer_id value i. Each indicates an ndency_id value.

[0176] -If one_quality_id_flag[i] is 1, the layer_id value is related to i. indicates that only one quality_id exists in the same sequence, If d_flag[i] is 0, then two or more q Indicates that a reality_id value is present.

[0177] -quality_id[i] is the quality_i associated with layer_id value i The d value is shown.

[0178] -quality_id_min[i] and quality_id_max[i] are the layout The minimum and maximum quality_id values ​​associated with r_id value i are Shown below.

[0179] - If one_view_id_flag[i] is 1, the layer_id value associated with i Indicates that one view_id exists, and if 0, the layer_id value associated with i. This indicates that two or more view_id values ​​exist.

[0180] -view_id[i] denotes the view_id value associated with layer_id value i.

[0181] - If depth_flag[i] is 1, the current scalable layer whose layer_id value is i Indicates that this layer contains depth information for a 3D video bitstream.

[0182] -view_id_min[i] and view_id_max[i] are the values ​​of the layer_id , i, denote the minimum and maximum view_id values ​​associated with i, respectively.

[0183] -num_regions_minus1 plus1 is the number of layers with the layer_id value associated with i The number of areas that have been identified is shown.

[0184] -region_id[j] indicates the identifier of region j associated with layer_id value i .

[0185] -num_directly_dependent_layers[i] is the current scaler The scalable layer i is directly related to the scalable layer (during decoding, the prediction signal is formed). Indicates the number of layers required.

[0186] -directly_dependent_layer_id_delta_minus1[ i][j] plus1 is the current scalable layer, layer_id[i], and the current The difference between the hierarchical identifier of the jth scalable hierarchy and the hierarchical identifier of the jth directly related scalable hierarchy is shown. The hierarchical id of the jth directly associated scalable tier is (layer_id[i] -directly_dependent_layer_id_delta_minus1[i ][j]-1).

[0187] The extension_info() syntax according to another embodiment is as shown in Table 16. do.

[0188] [Table 16]

[0189] As shown in Table 16, pic_width_in_luma_samples[i] and pi c_height_in_luma_samples[i], bit_depth_luma_m inus8[i], bit_depth_chroma_minus8[i], and chrom a_format_idc[i] is the information for the different representation formats. can be signaled to

[0190] According to another embodiment, pic_width_in_luma_samples[i], pic _height_in_luma_samples[i], bit_depth_luma_mi nus8[i], bit_depth_chroma_minus8[i], and chroma_ format_idc[i] is a format for different images, i.e. pictures with different resolutions. The information can be signaled.

[0191] For Activation SEI Message for Signaling Bit Rate and Quality Information The syntax is as shown in Table 17.

[0192] [Table 17]

[0193] The meanings for the syntax in Table 17 are as follows:

[0194] -num_layers_minus1 is the number of scalable layers available in the bitstream. Indicates the number of layers.

[0195] -If bitrate_info_flag is 1, the bitrate for each scalable layer is Indicates that bit rate information is provided.

[0196] If -quality_info_flag is 1, the query for each scalable tier is Indicates that information on the quality value is provided.

[0197] If -quality_type_flag is 1, the queue size for each scalable tier is Indicates that information for the quality type is provided.

[0198] -max_bitrate[i] is the maximum bitrate for the scalable layer with layer_id value i. average_bitrate[i] is the bitrate for layer_id value i. where scalable layer average bitrate is the average bitrate of the scalable layer.

[0199] -quality_value[i] indicates the quality value of scalable tier i.

[0200] -quality_type_uri[QualityTypeUriIdx] is UTF -8 character encoded null0 terminated string The QualityTypeUriIdx-th byte of the quality value. A URI (universal resource identifier) ​​that contains a representation for the type. fier).

[0201] Below, we will introduce an improved description method for efficient bitstream extraction, called VPS (video bitstream extraction method). We propose a method to improve the eo parameter set.

[0202] Layer referencing )

[0203] Layer_id and scalability for bitstreams that support multiple layers How to indicate the relationship between the scalability dimension ID As a result, layer_id and scalability dimension ID (scalability dim The first method tells us how to map between the layer_id and the extension ID. The bits are allocated by partitioning or splicing. There can be a second way of telling the bits what dimension type is present.

[0204] Dimension type in bitstreams that support multiple hierarchies e) refers to scalability such as spatial scalability and quality scalability. The dimension ID indicates the type of dimension that a particular dimension type is This refers to the index to the layers that can be included.

[0205] A bitstream that supports multiple layers, with special consideration given to the For ease of understanding, for example, a single-layer bitstream with temporal scalability is If the temporal layer (sub-layer) 3) supports the next lower layer (e.g. For example, it is common to directly reference a temporal sub-layer.

[0206] Also, for example, if you want to support spatial scalability, the spatial layer 2 should be the next lowest This means directly referencing spatial hierarchy 1.

[0207] Therefore, to indicate such cases, we use the default direct reference. We propose to describe the dimension with the dependency first.

[0208] Then, we divide the specific dependencies into scalable layers. The description loop can be used to describe the .

[0209] Below, we propose a method for signaling hierarchical references using the above two methods. The improved syntax for vps_extension is shown in Tables 18 through 19. The answer is number 21.

[0210] [Table 18]

[0211] Table 18 shows the layer_id and scalability dimension ID (scalability_dimension_id) using the first method. The syntax for mapping the metric to the metric dimension ID is shown below. The meaning of the syntax in Table 18 is as follows:

[0212] -all_default_dependency_flag is set to 1, all hierarchical levels Indicates that the element has a default dependency. That is, For a particular dimension i, the hierarchy with dimension_id[i]=n is the default. This means that the dimension_id[i]=n-1 directly references another hierarchy with dimension_id[i]=n-1. Taste.

[0213] If all_default_dependency_flag is 0, all hierarchical dimensions indicates that all_default_dependen If cy_flag is 0, the num_default_dim_minus1 below is the signal It will be processed.

[0214] -num_default_dim_minus1 is the base reference (default dep Indicates the number of dimensions that have an endency.

[0215] -dimension[j] has a default dependency Specifies the type of hierarchy dimension to be referenced. y) one by one, and the type of hierarchical dimension with base references In the relevant dimension, information on the upper hierarchy (e.g., dimensions ion_id=n) directly accesses the next lower level (e.g. dimension_id=n-1). Refer to the following information.

[0216] -If specific_dependency_flag[i] is 1, Direct references specifically stated in ces). Therefore, If flag[i] is 1, the number of layers that the corresponding layer directly references and the ID of the corresponding layer are It is gunned down.

[0217] Layer C directly references layer B, which means that in order to decode layer C, The data carrier must use the information in layer B (decoded or not). However, if layer B directly uses information from layer A, If C is a direct reference to A, then C is not considered to be a direct reference to A.

[0218] [Table 19]

[0219] Table 19 shows how the bits of layer_id are sorted into scalability dimension tags using the second method. This section provides a syntax for assigning dimension types to a data type and signaling the length of the assigned dimension type. is doing.

[0220] The num_dimensions_minus1 in Table 19 is the NALU header This indicates the number of hierarchical dimensions present in the NALU header. Then, identify the hierarchy type and the number of bits assigned to the dimension type for each hierarchy dimension. do.

[0221] Table 19 Syntax for hierarchical references all_default_depe ndency_flag, num_default_dim_minus1, dimensi The explanation for on[j] and specific_dependency_flag[i] is given in Table 18.

[0222] Tables 20 and 21 show syntax that differs from Tables 18 and 19. Table 20 shows If you use the first method, indicate the default dependency. The alternative syntax is shown in Table 21. If you use the second method, you must use the default reference. lt dependency).

[0223] [Table 20]

[0224] [Table 21]

[0225] Among the syntax in Tables 20 and 21, the syntax overlaps with Tables 18 and 19. The corresponding explanation will be omitted.

[0226] The new syntax default_depende included in Tables 20 and 21 ncy_flag[i] indicates whether dimension type i uses base references. In the above, the higher level (e.g., dimension_id[i]=n) is the By directly referencing the dimension_id[i]=n-1).

[0227] That is, num_dimensions_minus1 and dimension_type[i If a particular dimension type is specified by ], whether that dimension type uses a base reference If not, the layer directly references the layer. Signals information.

[0228] In order to indicate the dimension type according to the present invention, the following is shown in Table 22. It is.

[0229] [Table 22]

[0230] According to the present invention, the existing dimension types 4 and 5, namely priority Added types to indicate ID and region ID.

[0231] dimension_type[i][j] can basically have values ​​from 0 to 5 Other values ​​can be defined later, and the decoder will use dim if it is not a value between 0 and 5. The values ​​of ension_type[i][j] can be ignored.

[0232] If dimension_type has a value of 4, the corresponding dimension_id is , indicates the id of the priority hierarchy of the bitstream in the SVC standard.

[0233] If dimension_type has a value of 5, the corresponding dimension_id is , indicates the id of a particular region of the bitstream. A particular region can be one or more The spatial-temporal segment can be done.

[0234] FIG. 4 is a control flow diagram illustrating a method for encoding video information according to the present invention. be.

[0235] As shown in the figure, the encoding device includes a NAL (Network Access Label) that contains information related to the video. Encoding the rk Abstraction Layer (S401) unit .

[0236] The NAL unit header of a NAL unit indicates that the NAL unit contains at least one non-reference picture. It does not contain any information indicating whether it contains a slice that contains part or all of either.

[0237] On the other hand, NAL unit headers are used in bitstreams that support scalable layers. It includes hierarchical identification information for identifying a scalable hierarchical layer.

[0238] In this case, the NAL units not included in the NAL unit header are those with few non-reference pictures. To signal whether the slice contains at least some or all of The bits used for can be used to signal layer identification information.

[0239] In addition, the NAL unit stores various parameters necessary for decoding the image. It may contain information for a set.

[0240] The encoder receives the SEI (Supplementary Information Identifier) ​​which contains information on the activated parameter set. (mental enhancement information) message The NAL unit can then be encoded into the encoded NAL unit.

[0241] The information on the activated parameter set is the activated video parameter set. The information for indexing the sequence parameter set to be activated is The information may include at least one of the following:

[0242] Also, information on the activated parameter set is stored in the activated video parameter set. information for indexing the set, a sequence that references the video parameter set to be activated; Information indicating the number of sequence parameter sets and indexing the sequence parameter sets. The information to be sent may include information to be sent.

[0243] The information on such a parameter set is used by the decoder to realize temporal scalability. This can be used when extracting the sublayers to provide.

[0244] Also, the decoding device or the decoding unit that performs the decoding is Activates the parameter set required for decoding the encoding layer NALU. When the parameter set is generated, information about the parameter set can be used.

[0245] The encoder generates NAL units that contain information related to the encoded video. The received signal is then sent to the data stream (S402).

[0246] FIG. 5 is a control flow diagram illustrating a method for decoding video information according to the present invention. do.

[0247] Referring to FIG. 5, the decoding device receives the encoded data via a bitstream. An NAL unit including information related to a video is received (S501).

[0248] The decoder parses the header and the NAL payload of the NAL unit. Parsing of the image information is performed by an entropy decoding unit or another This can be performed in the parsing section of the process.

[0249] The decoder parses the NAL unit header and the NAL payload. It is possible to obtain a variety of information that is available.

[0250] The NAL unit header is used to denote scalable layers in bitstreams that support scalable layers. It contains layer identification information for identifying the error layer when encoding the NAL unit. , indicates whether it is a non-reference picture or a reference picture in the entire bitstream It does not contain 1-bit flag information.

[0251] In this case, the NAL units not included in the NAL unit header are those with few non-reference pictures. To signal whether the slice contains at least some or all of The bits used for can be used to signal layer identification information.

[0252] In addition, the decoder parses the corresponding SEI included in the SEI message through parsing. For the set of parameters needed to decode the message and associated NALUs. You can obtain information related to the above.

[0253] The information on the activated parameter set is the activated video parameter set. The information for indexing the sequence parameter set to be activated is The information may include at least one of the following:

[0254] Also, information on the activated parameter set is stored in the activated video parameter set. information for indexing the set, a sequence that references the video parameter set to be activated; Information indicating the number of sequence parameter sets and indexing the sequence parameter sets. The information to be sent may include information to be sent.

[0255] The information on such a parameter set is used by the decoder to realize temporal scalability. This can be used when extracting the sublayers to provide.

[0256] Additionally, information about the parameter set is stored when decoding the bitstream or when Session negotiation (e.g., when streaming on an IP network, session n It can be used when conducting a negotiation (egotiation).

[0257] In the above-described embodiments, the method is described in terms of a flow chart as a series of steps or blocks. Although the present invention is not limited to the order of steps, certain steps may be , different steps may occur in different orders or simultaneously than those described above. In the above, a person having ordinary skill in the art would understand that the steps shown in the flow chart are not exclusive, Other steps may be included, or one or more steps of the flow chart may be within the scope of the present invention. It can be seen that it can be removed without any impact.

[0258] The above-described embodiments include examples of various aspects. All possible combinations showing the various aspects are not intended to be limiting. Although it is not possible to describe it, other combinations are possible that would be obvious to one of ordinary skill in the art. It can be appreciated that the present invention is therefore within the scope of the claims. This document includes all replacements, modifications and alterations herein.

Claims

1. 1. A method of performing video decoding, comprising: receiving, if the extension flag indicates that information for a plurality of layers is provided, representation format number information indicating a number of representation formats for the plurality of layers; obtaining representation format information for each of the representation formats based on the representation format number information, the representation format information including at least one of width information and height information; performing video decoding using the representation format information; A method for providing the above.

2. 1. A method for performing video encoding, comprising the steps of: - encoding an extension flag of the video parameters if information for multiple layers is provided; encoding representation format information of the plurality of layers and representation format number information indicating a number of representation formats of the plurality of layers when information for the plurality of layers is provided, the representation format information including at least one of width information and height information; performing video encoding using the representation format information; A method for providing the above.

3. A bitstream transmission method for transmitting a bitstream encoded by a video encoding method, comprising: The video encoding method comprises: - encoding an extension flag of the video parameters if information for multiple layers is provided; encoding representation format information of the plurality of layers and representation format number information indicating a number of representation formats of the plurality of layers when information for the plurality of layers is provided, the representation format information including at least one of width information and height information; performing video encoding using the representation format information; A method for providing the above.

Images