Use of access unit separators and adaptive parameter sets

By using in-loop filter control information and parameter sets in video decoder, the problem of difficulty in using in-loop filters and difficult to determine the availability of parameter sets in low-latency environments is solved, and lower decoding delay and higher decoding efficiency are achieved .

CN119071483APending Publication Date: 2024-12-03FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411220404.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2020-08-18
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In a low-latency environment, the video encoder fails to use the in-loop filter optimally before sending the processed portion of the picture, resulting in an increase in decoding delay and the decoder has difficulty determining whether all necessary parameter sets are available to decode the picture.

Method used

By introducing a parameterizer in the video decoder, using the in-loop filter control information and parameter set from the access unit, following the video encoding unit along the data stream order, the in-loop filter control information is derived in advance to reduce the decoding delay, And efficiently indicate the required parameter set with the help of the access unit separator.

Benefits of technology

Reducing decoding delay in low-latency environments is achieved and ensuring that the decoder can start decoding slices of pictures before obtaining all parameter sets, improving decoding speed and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071483A_ABST
    Figure CN119071483A_ABST
Patent Text Reader

Abstract

A video decoder comprises a decoding core (94) configured to reconstruct a decoded picture using motion compensated prediction and transform-based residual decoding from one or more video coding units (100) within an access unit (AU) of a video data stream to obtain a reconstructed version (46a) of the decoded picture; an in-loop filter (90) configured to filter the reconstructed version of the decoded picture to obtain a decoded picture version (46b) to be inserted in a decoded picture buffer (92), DPB, of the video decoder; and a parameterizer configured to parameterize the in-loop filter by reading in-loop filter control information for parameterizing the in-loop filter from: one or more parameter sets (102, 104) located within an access unit (AU) that decodes a picture, which follow one or more video coding units (100) along a data stream order, and / or a portion (106) of the one or more video coding units (100) that follows data (108) comprised by the one or more video coding units (100) along a data stream order, the data (108) carrying block-based prediction parameter data and prediction residual data; and parameterizing the in-loop filter to filter the reconstructed version of the decoded picture in a manner dependent on the in-loop filter control information.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This case is a divisional application. The invention name of the parent case is "Use of access unit delimiter and adaptive parameter set", the application date is August 18, 2020, and the application number is 202080073262.4.

[0002] The present application relates to the use of access delimiters and adaptation parameter sets for signaling coding parameters.

[0003] Modern video coding standards utilize in-loop filters such as adaptive loop filter (ALF), sample adaptive offset (SAO) and deblocking filter.

[0004] The in-loop filter is located in the decoding loop of the encoder. During all video encoding stages, and especially in the lossy compression performed in the quantization stage, the subjective quality of the video sequence may be reduced, resulting in block artifacts, ringing artifacts or blurring artifacts. In order to remove these artifacts and improve the subjective and objective quality of the reconstructed sequence, a set of in-loop filters is used. The in-loop filter in the encoder estimates the best filter parameters that maximize the objective quality of the frame. These parameters are then transmitted to the decoder so that the decoder's in-loop filter can use these parameters to optimally filter the reconstructed frame and achieve the same quality improvement as the reconstructed frame in the encoder.

[0005] The deblocking filter aims to remove blocking artifacts that appear at the edges of CUs (coding units), and specifically PUs (prediction units) and TUs (transform units), since the block structure is used in every stage of processing in the encoder.

[0006] The SAO filter aims to reduce undesirable visible artifacts, such as ringing. The key idea of ​​SAO is to reduce sample distortion by first classifying the reconstructed samples into different categories, obtaining an offset for each category, and then adding the offset to each sample of that category.

[0007] The key idea of ​​ALF is to use Wiener-based adaptive filter coefficients to minimize the mean square error between original and decoded pixels. ALF is located at the last processing stage of each picture and can be seen as a tool that tries to capture and repair artifacts from previous stages. The appropriate filter coefficients are determined by the encoder and explicitly signaled to the decoder. That is, ALF requires a parameter set (i.e., appropriate filter coefficients) to be sent to the decoder. These parameters are sent in a high-level syntax structure, such as an adaptive parameter set (APS). APS is a parameter set sent in the bitstream before the video coding layer (VCL) NAL (network abstraction layer) unit (i.e., a slice of a picture). ALF is applied to the complete picture after reconstruction. In addition, at the encoder, ALF estimation is one of the last steps in the encoding process.

[0008] In low-latency environments, this causes a problem because the encoder wants to start sending the processed parts of the picture as soon as possible, especially before the encoding process of the picture is completed. ALF cannot be optimally used in these environments because the AP with the filter parameters estimated for the encoded picture must be sent before the first slice of the picture.

[0009] Furthermore, a set of NAL units of a specified form is called an access unit AU, and decoding of each AU produces a decoded picture. Each AU contains a set of VCL NAL units, which together constitute the primary coded picture. It can also be prefixed with an access unit delimiter (AUD) to help locate the start of the AU.

[0010] AUD is used to separate AUs in the bitstream. It can optionally contain information about the following pictures, such as the allowed slice types (I, P, B).

[0011] In general video coding VVC, a picture can reference several different parameter sets: video parameter set (VPS), decoder parameter set (DPS), sequence parameter set (SPS), multiple picture parameter sets (PPS) and different types of adaptive parameter sets (APS), or more than one picture. The decoder needs to have all available parameter sets to be able to decode the picture.

[0012] Different slices of a picture may reference different PPS and APS. Therefore, it may be difficult for a decoder to determine whether all required parameter sets are available, as it needs to parse all slice headers of the picture and decode which parameters are referenced.

[0013] The object of the subject matter of the application is to provide a decoder that derives the necessary parameters from the access unit.

[0014] This object is achieved by the subject matter of the claims of the present application.

[0015] According to an embodiment of the present application, a video decoder includes: a decoding core (94), configured to reconstruct a decoded picture (e.g., a current decoded picture or a subsequent decoded picture) using motion compensation prediction and transform-based residual decoding from one or more video coding units (100) (e.g., VCL NAL units) within an access unit AU of a video data stream to obtain a reconstructed version (46a) of the decoded picture; an in-loop filter (90), for example, including an ALF, configured to filter the reconstructed version of the decoded picture to obtain a version (46b) of the decoded picture to be inserted into a decoded picture buffer (92) DPB of the video decoder; and a parameterizer, configured to parameterize the in-loop filter by reading in-loop filter control information, such as ALF coefficients (or parameters) and an ALF flag of each CTU (coding tree unit), so as to parameterize the in-loop filter according to: one or more parameter sets (102, 104) located in the access unit AU of the decoded picture, such as an ALF APS and an ALF flag of each CTU. APS, the one or more parameter sets (102, 104) follow one or more video coding units (100) along the data stream order, i.e., follow the VCL NALU individually or follow them all; and / or a part (106) of one or more video coding units (100), such as ALF data for each CTU, which follows the data (108) included by the one or more video coding units (100) along the data stream order, the data (108) carrying block-based prediction parameter data and prediction residual data, and parameterizing the in-loop filter so as to filter the reconstructed version of the decoded picture in a manner dependent on the in-loop filter control information. That is, the in-loop filter control information is derived for one or more video coding units, and therefore, it is possible to start decoding before receiving all video coding units of the picture. Therefore, in a low-delay environment, the decoding delay is reduced.

[0016] According to an embodiment of the present application, the in-loop filter control information includes one or more filter coefficients for parameterizing the in-loop filter according to a transfer function. That is, the ALF is a filter coefficient FIR or IIR coefficient of a transfer function such as a FIR (finite impulse response) or IIR (infinite impulse response) filter and a control filter.

[0017] According to an embodiment of the present application, the in-loop filter control information includes spatially selective in-loop filter control information for spatially varying filtering of a reconstructed version of a decoded picture (eg, a current decoded picture or a subsequent decoded picture) by the in-loop filter.

[0018] According to an embodiment of the present application, across the data to the end of the portion (106) (i.e., ALF), each video coding unit (100) is continuously arithmetically coded along the data stream order. A predetermined parameter set (102) of one or more parameter sets follows each of the one or more video coding units (100) in the data stream order and includes one or more filter coefficients for parameterizing an in-loop filter according to a transfer function.

[0019] According to an embodiment of the present application, one or more parameter sets (104) include an additional predetermined parameter set for each of one or more video encoding units (100), which follows the corresponding video encoding unit (100) in data stream order and includes spatially selective in-loop filter control information for spatially varying filtering of a reconstructed version of a decoded picture (e.g., a current decoded picture or a subsequent decoded picture) by an in-loop filter within a portion of a picture encoded into the corresponding video encoding unit (100).

[0020] According to an embodiment of the present application, each of one or more video encoding units (100) includes a filter information portion (106) that follows a data portion (108) of the corresponding video encoding unit (100) in a data stream order, wherein the filter information portion includes spatially selective in-loop filter control information for spatially varying filtering of a reconstructed version of a decoded picture (e.g., a current decoded picture or a subsequent decoded picture) by an in-loop filter within a portion of a picture for which block-based prediction parameter data and prediction residual data are encoded into the data portion of the corresponding video encoding unit (100).

[0021] According to an embodiment of the present application, the parameterizer can be configured to position one or more parameter sets (102, 104), such as the ALF APS and the ALF APS of each CTU, at a position within an access unit AU of a decoded picture (e.g., a current decoded picture or a subsequent decoded picture) in a case where a predetermined indication in a video data stream assumes a first state, and the position follows one or more video coding units (100) in the data stream order, that is, follows the VCL individually or follows all of them, and when a predetermined indication in the video data stream assumes a second state, the position is at a different position within an access unit before all one or more video coding units (100).

[0022] According to an embodiment of the present application, a portion (106) of one or more video coding units (100), such as ALF data of each CTU, is located at a position following data (108) included by the one or more video coding units (100) along the data stream order when a predetermined indication in the video data stream assumes a first state, and the data (108) carries block-based prediction parameter data and prediction residual data, and is located at a different position within the one or more video coding units interspersed with block-based prediction parameter data and prediction residual data when a predetermined indication in the video data stream assumes a second state.

[0023] According to an embodiment of the present application, a video decoder is configured to read a predetermined indication from one or more video encoding units (100). In the case of assuming a first state, the predetermined indication indicates one or more parameter sets by one or more identifiers, and in the case of assuming a second state, indicates different one or more in-loop filter control information parameter sets. The video decoder is configured to respond to the predetermined indication on a per-access-unit basis so as to perform different positioning for different access units of a video data stream when the predetermined indication is different for different access units. The parameterizer is configured to reconstruct a decoded picture using the in-loop filter control information included in the access unit AU previously signaled.

[0024] According to an embodiment of the present application, a video decoder is configured to, when detecting a boundary of an access unit AU, interpret a video coding unit carrying in-loop filter control information (e.g., ALF filter data) in the form of one or more parameter sets (102, 104) (e.g., a suffix APS) as an access unit AU not starting from, for example, ignoring them in AU boundary detection, and thereby detecting that there is no AU boundary, and interpret a video coding unit carrying in-loop filter control information not in the form of one or more parameter sets (102, 104) (e.g., a prefix APS) as an access unit starting from, for example, detecting an AU boundary from such a video coding unit.

[0025] According to an embodiment of the present application, a video decoder is configured to decode a video from a video data stream by decoding a decoded picture (e.g., a current decoded picture or a subsequent decoded picture) of one or more video coding units (100) within an access unit AU of the video data stream in a parameterized manner using one or more predetermined coding parameters; deriving the predetermined coding parameters (122) from a plurality of parameter sets (120) dispersed in the video data stream, and reading an identifier (200) from a predetermined unit (124) of the access unit AU, the identifier (200) identifying the predetermined parameter set including the predetermined coding parameters from the plurality of parameter sets. That is, the presence or absence of the coding parameter is indicated by the identifier, and therefore, it is efficiently identified which parameter set is derivable from the received video coding unit. Furthermore, the identifier is included in the predetermined unit of the AU, and therefore, it is easy to include different parameter sets for different video coding units.

[0026] According to an embodiment of the present application, the predetermined unit of the AU includes a flag (204) indicating whether the identifier (200) exists in the predetermined unit. That is, it is possible to indicate which identifiers are included in the predetermined unit of the AU, such as an access unit delimiter, by a flag.

[0027] According to an embodiment of the present application, a plurality of parameter sets (120) have different levels, wherein one or more video coding units include, for example, in a slice header, an identifier referencing a first predetermined parameter set (126) within one or more first predetermined levels, wherein the first predetermined parameter set (126) within one or more first predetermined levels includes an identifier referencing a second predetermined parameter set (128) within one or more second predetermined levels, and the first and second predetermined parameter sets are included by the predetermined parameter set (122). The identifier read from the predetermined unit (124) of the access unit AU identifies all predetermined parameter sets directly or indirectly referenced by one or more video coding units of the access unit, so that if all predetermined parameter sets identified by the identifier are available, the access unit is decodable.

[0028] According to an embodiment of the present application, the predetermined unit of the AU includes a flag (204) indicating (205) whether a predetermined identifier in an identifier (200) referencing a specific predetermined parameter set (126b) (e.g., a specific APS) exists in the predetermined unit (124), or whether a predetermined identifier referencing a specific predetermined parameter set (126b) exists in one or more video encoding units (100).

[0029] According to an embodiment of the present application, the first predetermined parameter set (126) includes a third predetermined parameter set (126a) referenced by an identifier in one or more video encoding units (100), and a fourth predetermined parameter set (126b) referenced by an identifier (200) present in the predetermined unit (124) but neither referenced by any identifier in the one or more video encoding units (100) nor referenced by any of the predetermined parameter sets.

[0030] According to an embodiment of the present application, the predetermined unit of the AU includes one or more identifiers of one or more adaptive parameter sets APS, one or more identifiers of one or more picture parameter sets PPS, an identifier of a video parameter set VPS, an identifier of a decoder parameter set DPS, and one or more identifiers of one or more sequence parameter sets SPS. The multiple parameter sets include a video parameter set VPS, a decoder parameter set DPS, a sequence parameter set SPS, one or more picture parameter sets PPS, and one or more adaptive parameter sets APS.

[0031] According to an embodiment of the present application, a video decoder is configured to decode a video from a video data stream by decoding pictures of one or more video coding units (100) of an access unit AU of the video data stream; read one or more parameters from an access unit delimiter AUD, the access unit delimiter AUD being arranged in the data stream so as to form the beginning of the access unit AU, the one or more parameters controlling (300) whether to define a delimited access unit in the video data stream for pictures related to a moment but different layer of the video data stream, or whether to encode pictures related to a moment but different layer of the video data stream into one of the access units, and / or indicating (302) the video coding type of the video coding unit included in the access unit to be allocated to the video coding unit in the access unit when the video coding type indications of the video coding units included in the access unit are different from each other, and / or indicating (304) a picture whose access unit is not referenced by any other picture, and / or indicating (306) a picture not to be output. That is, the parameters required for decoding the picture are indicated by the AUD, and therefore, it is possible to start decoding a slice of the picture included in the AU before obtaining all parameter sets for decoding the complete picture. In other words, a parameter set required for each slice is efficiently indicated by the AUD, and therefore, it is possible to improve the decoding speed.

[0032] According to an embodiment of the present application, one or more parameters form a deviation from the parameters defined by the previous AUD. The AUD includes an indication of whether the parameters defined by the previous AUD are to be adopted. The AUD includes an indication of whether the one or more parameters are applied to all layers of the video data stream or only to a single layer thereof. The video coding type of the video coding unit is indicated by describing the random access attributes of multiple pictures.

[0033] According to an embodiment of the present application, a video decoder is configured to decode a video from a video data stream by decoding pictures of one or more video coding units (100) of an access unit AU from the video data stream; read one or more parameters (308) from an access unit delimiter AUD, wherein the access unit delimiter AUD is arranged in the data stream to form the beginning of the access unit AU, wherein the one or more parameters indicate characteristics of the access unit; and read an indication from the access unit delimiter AUD whether the characteristic is applied to all layers of the video data stream or only to a single layer thereof.

[0034] According to an embodiment of the present application, a method includes: reconstructing a decoded picture (e.g., a current decoded picture or a subsequent decoded picture) using motion compensated prediction and transform-based residual decoding from one or more video coding units (100) within an access unit AU of a video data stream (e.g., a VCL NAL unit) to obtain a reconstructed version of the decoded picture; filtering the reconstructed version of the decoded picture using an in-loop filter to obtain a version of the decoded picture to be inserted into a decoded picture buffer DPB of a video decoder; and parameterizing the in-loop filter by reading in-loop filter control information to parameterize the in-loop filter according to: one or more parameter sets (102, 104) located within the access unit AU of the decoded picture, for example, ALF APS and ALF of each CTU APS, the one or more parameter sets (102, 104) following one or more video coding units (100) along a data stream order; and / or a portion (104) of one or more video coding units (100), such as ALF data for each CTU, which follows data included by the one or more video coding units (100) along a data stream order, the data carrying block-based prediction parameter data and prediction residual data for filtering a reconstructed version of a decoded picture in a manner dependent on in-loop filter control information.

[0035] According to an embodiment of the present application, a method includes: decoding a video from a video data stream by decoding a decoded picture (e.g., a current decoded picture or a subsequent decoded picture) of one or more video coding units (100) within an access unit AU of the video data stream in a parameterized manner using one or more predetermined coding parameters; deriving the predetermined coding parameters from a plurality of parameter sets distributed into the video data stream, and reading an identifier (200) from a predetermined unit of the access unit AU, the identifier identifying a predetermined parameter set including the predetermined coding parameters from the plurality of parameter sets.

[0036] According to an embodiment of the present application, a method includes: decoding a video from a video data stream by decoding pictures of one or more video coding units (100) of an access unit AU of the video data stream; reading one or more parameters from an access unit delimiter AUD, wherein the access unit delimiter AUD is arranged in the data stream so as to form the beginning of the access unit AU, wherein the one or more parameters control (300) whether to define a separated access unit in the video data stream for pictures related to a moment but a different layer of the video data stream, or whether to encode pictures related to a moment but a different layer of the video data stream into one of the access units, and in the case where the video coding type indications of the video coding units included in an access unit are different from each other, indicating (302) the video coding type of the video coding units included in the access unit to be assigned to the video coding units within the access unit, and / or indicating (304) pictures whose access units are not referenced by any other pictures, and / or indicating (306) pictures that are not output.

[0037] According to an embodiment of the present application, a method includes: decoding a video from a video data stream by decoding pictures of one or more video coding units (100) of an access unit AU from the video data stream; reading one or more parameters (308) from an access unit delimiter AUD, wherein the access unit delimiter AUD is arranged in the data stream to form the beginning of the access unit AU, wherein the one or more parameters indicate characteristics of the access unit; and reading an indication from the access unit delimiter AUD whether the characteristic is applied to all layers of the video data stream or only to a single layer thereof.

[0038] The preferred embodiments of the present application are described below with reference to the drawings, in which: Figure 1 A block diagram of an apparatus for predictive encoding of a video as an example of a video encoder is shown, wherein a layered video data stream according to an embodiment of the present application can be encoded; Figure 2 As an example of a video decoder suitable for Figure 1A block diagram of an apparatus for predictive decoding of a video, wherein a layered video data stream according to an embodiment of the present application can be decoded; Figure 3 A schematic diagram illustrating an example of a relationship between a prediction residual signal, a prediction signal and a reconstruction signal is shown in order to illustrate the possibilities of arrangements for defining a prediction signal, handling a subdivision of the prediction residual signal and the like, respectively; Figure 4 A schematic diagram showing an example of an encoding process according to the prior art is shown; Figure 5 A schematic diagram showing an example of an encoding process of sending a picture signal to a decoder according to an embodiment of the present application; Figure 6a , 6b A schematic diagram of an example of an access unit AU according to an embodiment of the present application is shown; Figure 7 A schematic diagram showing an example of another AU according to an embodiment of the present application is shown; Figure 8 A diagram showing an example of indicating information about a parameter set identifier ID included in an access unit delimiter AUD according to an embodiment of the present application; Fig. 9 A diagram showing an example of indicating information about a predetermined parameter set included in an AUD according to an embodiment of the present application; Fig.10 A diagram showing an example of indicating information about a predetermined parameter set included in an AUD according to an embodiment of the present application; Fig.11a A schematic diagram showing an example of indicating a relationship between predetermined encoding parameter sets according to an embodiment of the present application; Fig.11b A schematic diagram showing an example of indicating which part of an AU indicates which identifier of which parameter set according to an embodiment of the present application; Fig.11c A schematic diagram showing another example of indicating which part of an AU indicates which identifier of which parameter set according to an embodiment of the present application; Fig.12a , 12b A diagram showing an example of indicating parameters included in an AUD according to an embodiment of the present application; and Fig.13 A diagram is shown indicating another example of parameters included in an AUD according to an embodiment of the present application.

[0039] In the following description, the same or equivalent elements or elements having the same or equivalent functions are denoted by the same or equivalent reference numerals.

[0040] In the following description, a plurality of details are set forth to provide a more thorough explanation of the embodiments of the present application. However, it will be apparent to those skilled in the art that the embodiments of the present application can be put into practice without these specific details. In other examples, in order to avoid blurring the embodiments of the present application, well-known structures and devices are shown in block diagram form, rather than being shown in detail. In addition, the features of the different embodiments described hereinafter may be combined with each other, unless specifically noted otherwise.

[0041] introduction In the following, it should be noted that the various aspects described herein can be used alone or in combination. Therefore, details can be added to each of the various aspects without adding details to another aspect of the aspects.

[0042] It should also be noted that the present disclosure explicitly or implicitly describes features that can be used in a video decoder (an apparatus for providing a decoded representation of a video signal based on an encoded representation). Therefore, any feature described herein can be used in the context of a video decoder.

[0043] In addition, the features and functions related to the method disclosed herein may also be used in a device (configured to perform such functions). Further, any features and functions disclosed herein regarding the device may also be used in the corresponding method. In other words, the method disclosed herein may be supplemented by any features and functions described regarding the device.

[0044] The following description of the figures begins with the presentation of a description of a video encoder and a video decoder of a block-based predictive codec for encoding video pictures to form an example of a coding framework within which an embodiment of a layered video data stream codec may be built. Figures 1 to 3 A video encoder and a video decoder are described. In the following, a description of embodiments of the concept of a layered video data stream codec of the present application is provided together with information on how such a concept can be constructed into Figure 1 and Figure 2 The description of the video encoder and decoder is presented together, although the embodiments described later can also be used to form a video encoder and decoder not based on Figure 1 and Figure 2 The video encoder and video decoder are the underlying coding frameworks that operate the video encoder and video decoder.

[0045] Figure 1 A block diagram of an apparatus for predictive encoding of a video as an example of a video decoder is shown, in which motion compensation prediction of an inter-frame prediction block according to an embodiment of the present application can be implemented. That is, Figure 1An apparatus for predictive coding a video 11 consisting of a sequence of pictures 12 into a data stream 14 is shown. For this purpose, block-by-block predictive coding is used. In addition, transform-based residual coding is used exemplarily. The apparatus or encoder is indicated using reference numeral 10.

[0046] Figure 2 A block diagram of an apparatus for predictive decoding of a video as an example of a video decoder is shown, in which motion compensation prediction of an inter-frame prediction block according to an embodiment of the present application can be implemented. That is, Figure 2 A corresponding decoder 20 is shown, i.e. a device 20 configured to perform predictive decoding of a video 11' consisting of a picture 12' from picture blocks from a data stream 14, where transform-based residual decoding is also exemplarily used, wherein a prime sign has been used to indicate that the picture 12' and the video 11' reconstructed by the decoder 20 deviate from the picture 12 originally encoded by the device 10 in terms of coding losses introduced by quantization of the prediction residual signal. Figure 1 and Figure 2 Transform-based prediction residual coding is used illustratively, although the embodiments of the present application are not limited to such prediction residual coding. Figure 1 and Figure 2 The same is true for the other details of the description, as will be outlined below.

[0047] The encoder 10 is configured to subject the prediction residual signal to a spatial to spectral transform and to encode the prediction residual signal thus obtained into the data stream 14. Likewise, the decoder 20 is configured to decode the prediction residual signal from the data stream 14 and to subject the prediction residual signal thus obtained to a spectral to spatial transform.

[0048] Internally, the encoder 10 may include a prediction residual signal former 22, which generates a prediction residual 24 in order to measure the deviation of the prediction signal 26 from the original signal (i.e., the video 11 or the current picture 12). The prediction residual signal former 22 may, for example, be a subtractor that subtracts the prediction signal from the original signal (i.e., the current picture 12). The encoder 10 further includes a transformer 28, which subjects the prediction residual signal 24 to a spatial to spectral transform to obtain a spectral domain prediction residual signal 24', which is then subjected to quantization by a quantizer 32 (also included by the encoder 10). The quantized prediction residual signal 24" is thus encoded into the data stream 14. To this end, the encoder 10 may optionally include an entropy encoder 34, which entropy encodes the prediction residual signal as transformed and quantized into the data stream 14. The prediction residual 26 is generated by the prediction stage 36 of the encoder 10 based on the prediction residual signal 24" decoded into the data stream 14 and decodable from the data stream 14. To this end, the prediction stage 36 may internally comprise: a dequantizer 38 which dequantizes the prediction residual signal 24" in order to obtain a spectral domain prediction residual signal 24"' which corresponds to the signal 24' except for the quantization losses; followed by an inverse transformer 40 which subjects the latter prediction residual signal 24"' to an inverse transform, i.e. a spectral to spatial transform, in order to obtain a prediction residual signal 24"", which corresponds to the original prediction residual signal 24 except for the quantization losses. The combiner 42 of the prediction stage 36 then recombines the prediction signal 26 and the prediction residual signal 24"", such as by addition, in order to obtain a reconstructed signal 46a, i.e. a reconstruction (reconstructed version) of the original signal 12. The reconstructed signal 46a may correspond to the signal 12'.

[0049] The in-loop filter 90 filters the reconstructed signal 46a to obtain a decoded signal 46b, which is a version of a decoded picture (eg, a current decoded picture or a subsequent decoded picture) to be inserted into a decoded picture buffer DPB 92.

[0050] The prediction module 44 of the prediction stage 36 then generates the prediction signal 26 based on the signal 46b by using, for example, spatial prediction (ie, intra prediction) and / or temporal prediction (ie, inter prediction). Details of this are described below.

[0051] The decoder 20 includes a decoding core 94 including the entropy decoder 50 , the dequantizer 52 , the inverse transformer 54 , the combiner 56 , and the prediction module 58 , as well as the in-loop filter 90 and the DPB 94 .

[0052] Likewise, the decoder 20 may be internally composed of components corresponding to the prediction stage 36 and interconnected in a manner corresponding to the prediction stage 36. In particular, the entropy decoder 50 of the decoder 20 may entropy decode the quantized spectral domain prediction residual signal 24″ from the data stream, whereupon the dequantizer 52, the inverse transformer 54, the combiner 56 and the prediction module 58 interconnected and cooperating in the manner described above with respect to the modules of the prediction stage 36 recover the reconstructed signal based on the prediction residual signal 24″, such that Figure 3 As shown in , the output of the combiner 56 produces a reconstructed signal, ie its video 11 ′ or its current picture 12 ′.

[0053] Although not specifically described above, it is easy to understand that the encoder 10 can set some encoding parameters, including, for example, prediction modes, motion parameters, and the like, according to some optimization schemes, such as, for example, in a manner to optimize some rate and distortion related criteria (i.e., coding cost) and / or use some rate control. As described in more detail below, the encoder 10 and the decoder 20 and the corresponding modules 44, 58 support different prediction modes, such as intra-frame coding mode and inter-frame coding mode, which form a set or pool of primitive prediction modes, based on which predictions of picture blocks are composed in a manner described in more detail below. The granularity at which the encoder and the decoder switch between these prediction compositions can correspond to the subdivision of the pictures 12 and 12' into blocks, respectively. Note that some of these blocks can be blocks that are individually intra-coded, and some blocks can be blocks that are individually inter-coded, and optionally, even other blocks can be blocks obtained using both intra-frame coding and inter-frame coding, but the details are explained below. According to the intra-frame coding mode, the prediction signal of the block is obtained based on the spatial, already encoded / decoded neighborhood of the corresponding block. Several intra-coding sub-modes may be selected, where "quasi" denotes an intra-prediction parameter. There may be directional or angular intra-coding sub-modes, according to which the prediction signal of the corresponding block is filled by extrapolating the sample values ​​of the neighborhood into the corresponding block along a certain direction that is specific to the corresponding directional intra-coding sub-mode. For example, the intra-coding sub-mode may also include one or more additional sub-modes, such as: a DC coding mode, according to which the prediction signal of the corresponding block assigns a DC value to all samples within the corresponding block; and / or a plane intra-coding mode, according to which the prediction signal of the corresponding block is approximated or determined as a spatial distribution of sample values ​​described by a two-dimensional linear function at the sample positions of the corresponding block, wherein the tilt and offset of the plane defined by the two-dimensional linear function are derived based on neighboring samples. In contrast, according to the inter-prediction mode, the prediction signal of the block can be obtained, for example, by temporal prediction inside the block. For parameterization of the inter-frame prediction mode, a motion vector may be signaled within the data stream, the motion vector indicating a spatial displacement of a previously encoded picture portion of the video 11 at which the previously encoded / decoded picture was sampled in order to obtain a prediction signal for the corresponding block. This means that, in addition to the residual signal encoding comprised by the data stream 14 (such as entropy coded transform coefficient levels representing a quantized spectral domain prediction residual signal 24″), the data stream 14 may also encode therein prediction related parameters for assigning a prediction mode to a block, prediction parameters for the assigned prediction mode (such as motion parameters for the inter-frame prediction mode) and, optionally, other parameters for controlling the synthesis of a final prediction signal for the block using the assigned prediction mode and prediction parameters, as will be outlined in more detail below.Furthermore, the data stream may include parameters for controlling and signaling the subdivision of pictures 12 and 12' into blocks, respectively. Decoder 20 uses these parameters to subdivide pictures in the same manner as the encoder, assign the same prediction modes and parameters to blocks, and perform the same prediction to produce the same prediction signal.

[0054] Figure 3 A schematic diagram illustrating an example of the relationship between the prediction residual signal, the prediction signal and the reconstruction signal is shown in order to illustrate the possibility of setting a definition prediction signal, handling a subdivision of the prediction residual signal and the like, respectively. That is, Figure 3 The diagram illustrates the relationship between a reconstruction signal, i.e. a reconstructed picture 12', on the one hand, and a combination of a prediction residual signal 24'" and a prediction signal 26 as signaled in a data stream, on the other hand. As already indicated above, the combination may be additive. The prediction signal 26 is a subdivision of the picture area into blocks 80 of varying sizes, although this is merely an example. The subdivision may be any subdivision, such as a regular subdivision of the picture area into rows and columns of blocks, or a multi-tree subdivision of the picture 12 into leaf blocks of varying sizes, such as a quadtree subdivision or the like, wherein a mixture thereof, wherein the picture area is first subdivided into rows and columns of tree root blocks, which are then further subdivided according to a recursive multi-tree subdivision to produce blocks 80.

[0055] In the following, each aspect of the invention of the present application is explained.

[0056] Suffix-APS According to one aspect of the present invention of the present application, it enables the encoder to start sending parts of a picture (e.g., slices) before completing the encoding process of the entire picture, while still using the slices. This is achieved by allowing the adaptive parameter set (APS) to be sent after the coded slice of the picture moves the ALF parameters of each CTU (coding tree unit) behind the actual slice data.

[0057] Figure 4 A diagram of a prior art encoder is shown. First, the entire picture is encoded (intra-frame prediction, motion estimation, residual coding, etc.), and then the ALF estimation process begins. The ALF filter coefficients are written to the AP, and then the slice data can be written, including the ALF parameters for each CTU (which are interspersed with other parameters). Only after the ALF encoding is completed can the picture be sent.

[0058] Figure 5 An example of a low-delay encoder envisioned by the present invention is shown. The slice can be sent out before the picture encoding process is completed. In particular, the APS carrying coefficients is moved after the slice data (VCL NAL unit).

[0059] In this process, the encoder can first send out the coded slices of the picture while collecting the estimated ALF parameters (filter coefficients, filter control information), and then the APS containing the ALF parameters after the coded picture. Once the picture slices arrive, the decoder can start parsing and decoding the picture slices. Because ALF is one of the last decoding steps, the ALF parameters can arrive after the coded picture to be applied after other decoding steps.

[0060] The present invention includes the following aspects: -APS type, which indicates that the APS belongs to the previous picture -APS type is encoded in syntax element. Examples are: o New NAL unit types encoded in the NAL unit header (e.g. suffix APS) o New APS types encoded in APS (e.g. suffix ALF APS) o Flag indicating whether APS is applied to the previous picture or the subsequent picture - Changes in the decoding process, which only assumes that the start of a new access unit AU is signaled by a prefix APS instead of a suffix APS - Alternatively, the APS type (prefix or suffix) can be determined by the relative position in the bitstream with respect to the surrounding access unit delimiters (AUDs) and coded picture slices: o If the APS is located between the AUD and the last VCL NAL unit of a picture, it is applied to the previous picture o If the APS is located between the AUD and the first VCL NAL unit of a picture, it is applied to subsequent pictures - in this case, the decoder should determine the start of a new access unit only by the position of the AUD - in one embodiment, the slice header indicates the use of a suffix APS instead of a prefix APS, so that the dependency is resolved at the end of the decoding process of the picture, for example by: o The APS identifier is signaled somewhere in the slice header, depending on the prefix or suffix attribute of the APS identifier o Signals a flag indicating that the referenced APS will follow the coded slice in bitstream order.

[0061] Typically, not only the derivation of ALF parameters (filter coefficients) is performed near the end of the encoding process (based on reconstructed sample values), but also ALF control information (information about whether and how the coding tree unit CTU is filtered) is further derived at this stage. The ALF control information is carried in several syntax elements per coding_tree_unit in the slice payload, in conjunction with the block partitioning (e.g. Figure 6b), transform coefficients, etc. are interspersed together. For example, the following syntax elements may exist: alf_ctb_flag: Specifies whether the adaptive loop filter is applied to the coding tree block (CTB). alf_ctb_use_first_aps_flag: Specifies whether to use the filter information in the APS where adaptive_parameter_set_id is equal to slice_alf_aps_id_luma[0] alf_use_aps_flag: specifies whether the filter set from APS is applied to the luma CTB ·wait.

[0062] All this ALF control information depends on the derivation of ALF filter parameters near the end of the picture encoding process.

[0063] In one embodiment, ALF control information is signaled in a separate loop through the CTU of the slice at the end of the corresponding slice payload so that the encoder can finalize the first part of the slice payload (transform coefficients, block structure, etc.) before applying ALF. Figure 6a and 6b Medium picture.

[0064] like Figure 6a As indicated in , a video coding unit (VCL NAL unit) 100 includes a slice header, slice data 108 and a portion (ALF APS for each CUT) 106, and one or more parameter sets (ALF coefficients) 102 are signaled separately, i.e., as a suffix APS (in a non-VCL-NAL unit). That is, across the data to the end of the portion, each video coding unit 100 is continuously arithmetically coded along the data stream order.

[0065] Figure 6b The portion 106 is shown interspersed with slice data 108. That is, the ALF APS for each CUT is interspersed with blocks, and one or more parameter sets 102 are signaled separately as suffix APSs.

[0066] In another embodiment, the slice header will indicate that the ALF control information is not indicated in the syntax elements within the coded slice payload (i.e., in the CTU loop described above), but the ALF control information is included in the suffix APS, for example by mentioning that the APS is a suffix APS type, i.e., in a separate loop on all CTUs in the corresponding suffix APS.

[0067] In another embodiment, the slice header will indicate that the ALF control information is not indicated in the syntax elements within the coded slice payload (i.e., in the CTU loop described above), but the ALF control information is included in a new type of suffix APS, i.e., in a separate loop on all CTUs in the corresponding suffix APS, e.g., by mentioning that the APS is a suffix APS type, and the new type of suffix APS is different from the suffix APS carrying the ALF coefficients. Optionally, CABAC encoding can be performed on each CTU data. This embodiment Figure 7 Medium picture.

[0068] like Figure 7 As indicated in , the data units are signaled in a data stream order, a video coding unit (VCL NAL unit) 100 includes a slice header and slice data 108, a parameter set 104 (suffix ALF CTU-data APS: non-VCL NAL unit), another video coding unit 100, another parameter set 104 and a parameter set (filter control information) 102 (suffix ALF coefficient APS: non-VCL NAL unit). That is, with Figure 6a and 6b In contrast to the data flow indicated in , the filter coefficients do not have to be signaled after each video coding unit. In other words, the filter coefficients can be sent together for more than one video coding unit 100 following it in bitstream order, or further used by another video coding unit following the filter coefficients in bitstream order.

[0069] In another embodiment, the slice header referencing the suffix APS and all CTUs are inferred to have an adaptive loop filter that applies the filter parameters signaled in the suffix APS and the default values ​​of the ALF control information.

[0070] Signal a reference to the parameter set ID in the AUD In the following, another aspect of the invention of the present application is described, namely a method for easier access to a list of all parameter sets referenced in a picture.

[0071] According to this aspect of the invention of the present application, before starting decoding, the decoder can easily determine whether all necessary parameter sets are available: - A list of all used parameter sets is included in the high-level syntax structure -The list consists of the following oA VPS (Video Parameter Set) oA DPS (Decoder Parameter Set) oOne or more SPS (Sequence Parameter Sets) oOne or more PPS (Picture Parameter Sets) oOne or more APSs (Adaptive Parameter Sets), sorted by APS type - Optionally, there are one or more syntax elements before each list indicating which parameter set types are lists (including prohibitions). The syntax structure for preserving information is included in the access unit delimiter (AUD).

[0072] Figure 8 , that is, in a predetermined unit (ie, AUD), a plurality of identifiers 200 are included, for example, an identifier "aud_vps_id" of a VPS, an identifier "aud_dps_id" of a DPS, an identifier "aud_sps_id" of a SPS, an identifier "aud_pps_id" of a PPS, and the like.

[0073] Signaling APSs only in AUD APSs are referenced by each slice of a picture. When combining bitstreams, different APSs may need to be rewritten and / or combined.

[0074] To avoid rewriting of the slice header, the APS ID is signaled in the access unit delimiter instead of the slice header. Thus, in case of a change, the slice header does not have to be rewritten. Rewriting the access unit delimiter is a much easier operation.

[0075] Fig. 9 Example syntax is shown in .

[0076] In another embodiment, the APS ID is only sent in the AUD conditional on another syntax element. If the syntax element indicates that the APS ID is not present in the AUD, then the APS ID is present in the slice header. Fig.10 Example syntax is shown in . That is, Fig.10 As depicted in , the AUD includes a flag 204 , such as with the syntax “aps_ids_in_aud_enabled_flag”.

[0077] Figures 11a to 11c Shown according to Figures 8 to 10 A schematic illustration of an example of the above-mentioned embodiment shown in is an illustration indicating a relationship between predetermined encoding parameters and AUs.

[0078] like Fig.11a As depicted in FIG. 1 , the plurality of parameter sets 120 include one or more first predetermined parameter sets 126, such as APA and PPS, and one or more second predetermined parameter sets 128, such as SPS, DPS, and VPS. The second predetermined parameter set 128 belongs to a higher level than the first predetermined parameter set 126. Fig.11aAs shown in , an AU includes a plurality of slice data, such as VCL 0 to VCL n, and a first and a second predetermined parameter set are included by a predetermined parameter set 122, such as a parameter set of VCL 0. The plurality of parameter sets 120 are stored in an AUD of the AU and signaled to a decoder.

[0079] In such Fig.11b In the case where the AUD indicated in 200 includes a flag 204, the flag 204 indicates 205 whether the predetermined identifier in the identifier 200 that refers to the specific predetermined parameter set 126b exists in the predetermined unit 124, or whether the predetermined identifier that refers to the specific predetermined parameter set 126b exists in one or more video encoding units 100. That is, the flag 204 indicates (such as Fig.11b (depicted by the arrow in ) APS126b is in AUD or in VLC.

[0080] like Fig.11c As depicted in FIG. 1 , the first predetermined parameter set 126 includes: a third predetermined parameter set 126a (e.g., PPS), which is referenced by an identifier (e.g., AU) in one or more video encoding units 100; and a fourth predetermined parameter set 126b (e.g., APS), which is referenced by an identifier 200 (e.g., AUD) present in the predetermined unit 124 (e.g., AUD). Figure 8 and 9 ), but is referenced neither by any identifier in one or more video encoding units 100 (AUD) nor by any pre-determined parameter set.

[0081] Signal access unit attributes to AUD Currently, the AUD indicates whether the following slice is of type I, B or P. In most systems, this feature is not very useful, since an I picture does not necessarily imply the presence of a random access point. If some AUs need to be discarded, the prioritization of AUs can typically be done by other means, such as parsing the temporal IDs, parsing whether they are discardable pictures (not referenced by any other pictures), etc.

[0082] Instead of indicating the picture type, one could indicate the NAL unit type and the fact whether they are discardable pictures, etc. Also, in the case of multiple layers, the properties may be more difficult to describe: The random access properties of a picture, which are specified by the overall NAL unit type (e.g., IDR, CRA, etc.) to be used for all VCL NAL units in the access unit, rather than by the NAL unit type specified in the NAL unit header A picture in one layer may be discardable in one layer, but not collocated in another layer • A picture in one layer may be marked as not output (pic_output_flag) in one layer, but not be a collocated picture in another layer.

[0083] Therefore, in Fig.12a In the embodiment depicted in , the AUD indicates whether the information applies to a single layer or all layers. That is, in the AUD, the flag refers to information about AU attributes, as indicated below, for example: "layer_specific_aud_flag" 300: controls whether a separate access unit is defined in the video data stream for a picture associated with one moment in the video data stream but a different layer, or whether a picture associated with one moment in the video data stream but a different layer is coded into one of the access units, and / or "nal_unit_type_present_flag" 302: indicates the video coding type of the video coding unit included in the access unit, in the case where the video coding type indications of the video coding units included in one access unit are different from each other, the video coding type is to be assigned to the video coding units in one access unit, that is, the nal unit type is indicated by the presence of the syntax element indicating the nal unit type, and / or "discardable_flag" 304: indicates a picture whose access unit is not referenced by any other picture, and / or "pic_output_flag" 306: indicates a picture that is not output. In another embodiment, the AUD may indicate that it is a dependent AUD, which means: It inherits the parameters of the previous AUD from the subordinate layer, but adds some layer-specific information and / or No new AU is started.

[0084] Figure 12b The indication in the AUD is depicted, that is, indicating the video coding type of the video coding unit by describing the random access attributes of multiple pictures. That is, the syntax "random_access_info_present_flag" indicates the random access attributes of the picture, for example, Figure 12b , is specified by the overall NAL unit type (e.g., IDR, CRA, etc.) to be used for all VCL NAL units in the access unit, rather than by the NAL unit type specified in the NAL unit header.

[0085] According to an embodiment of the present invention, Fig.13 Example syntax is shown in .

[0086] In this example, parameter set 308, namely, implementation "layer_specific_aud_flag" indicates whether the information in the AUD applies to all layers, and "dependent_aud_flag" indicates whether the AUD starts a new global access unit, or only a "layer access unit". In a dependent AUD, inheritance from the base layer AUD is indicated by "aud_inheritance_flag".

[0087] Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent descriptions of corresponding methods, where blocks or devices correspond to method steps or features of method steps. Similarly, the aspects described in the context of method steps also represent descriptions of corresponding blocks or items or features of corresponding apparatus. Some or all of the method steps may be performed by (or using) hardware devices, such as, for example, microprocessors, programmable computers, or electronic circuits. In some embodiments, one or more of the most important method steps may be performed by such devices.

[0088] The data stream of the present invention may be stored on a digital storage medium or may be transmitted on a transmission medium such as a wireless transmission medium or a wired transmission medium such as the Internet.

[0089] Depending on certain implementation requirements, embodiments of the present application may be implemented in hardware or software. The implementation may be performed using a digital storage medium (e.g., a floppy disk, DVD, Blu-ray, CD, ROM, PROM, EPROM, EEPROM, or flash memory) on which electronically readable control signals are stored, which cooperates (or can cooperate) with a programmable computer system to perform the corresponding method. Therefore, the digital storage medium may be computer readable.

[0090] Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.

[0091] Generally speaking, the embodiments of the present application can be implemented as a computer program product with a program code, which is operable to perform one of the methods when the computer program product runs on a computer. For example, the program code can be stored on a machine-readable carrier.

[0092] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

[0093] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0094] A further embodiment of the inventive method is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the computer program for performing one of the methods described herein. The data carrier, the digital storage medium, or the recorded medium are typically tangible and / or non-transitory.

[0095] A further embodiment of the inventive method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein.The data stream or the sequence of signals may, for example, be configured to be transferred via a data communication connection, for example via the Internet.

[0096] A further embodiment comprises a processing means, for example a computer or a programmable logic device, configured to or adapted to perform one of the methods described herein.

[0097] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

[0098] Another embodiment according to the invention comprises an apparatus or system configured to deliver (e.g., electronically or optically) a computer program for performing one of the methods described herein to a receiver. For example, the receiver may be a computer, a mobile device, a memory device, or the like. The apparatus or system may, for example, comprise a file server for delivering the computer program to the receiver.

[0099] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array may collaborate with a microprocessor to perform one of the methods described herein. In general, these methods are preferably performed by any hardware device.

[0100] The devices described herein may be implemented using hardware devices, or using computers, or using a combination of hardware devices and computers.

[0101] The apparatus described herein or any component of an apparatus described herein may be implemented at least partially in hardware and / or software.

Claims

1. A video decoding device, include: At least one processor and a memory, the at least one processor working together with the memory, configured to perform operations including: reading, from a video stream, filter coefficients located in a suffix unit corresponding to a first picture of the video stream, wherein the filter coefficients are for a second picture following the first picture; reading, from video data corresponding to a second picture of the video stream, a flag specifying that an adaptive filter is applied to a particular portion of the second picture; and An adaptive filter having filter coefficients is applied to a specific portion of the second picture. 2 . The video decoding device according to claim 1 , wherein the suffix unit is a last unit of an access unit (AU) of a first picture. 3 . The video decoding device according to claim 1 , wherein the video data corresponding to the second picture includes a video coding layer (VCL) network abstraction layer (NAL) unit representing one or more slices. 4 . The video decoding device of claim 1 , wherein the suffix unit corresponding to the first picture comprises a non-VCL NAL unit following all VCL NAL units corresponding to the first picture. 5 . The video decoding device according to claim 1 , wherein the specific portion of the second picture includes a coding tree block (CTB) of the second picture. 6 . The video decoding device of claim 1 , wherein the filter coefficients comprise adaptive loop filter (ALF) parameters, and wherein the flag comprises an ALF CTB flag.

7. A method for decoding a video, include: reading, from a video stream, filter coefficients located in a suffix unit corresponding to a first picture of the video stream, wherein the filter coefficients are for a second picture following the first picture; reading, from video data corresponding to a second picture of the video stream, a flag specifying that an adaptive filter is applied to a particular portion of the second picture; as well as An adaptive filter having filter coefficients is applied to a specific portion of the second picture. 8 . The method according to claim 7 , wherein the suffix unit is a last unit of an access unit (AU) of a first picture.

9. The method of claim 7, wherein the video data corresponding to the second picture comprises a Video Coding Layer (VCL) Network Abstraction Layer (NAL) unit representing one or more slices.

10. The method of claim 7, wherein the suffix units corresponding to the first picture include non-VCL NAL units following all VCL NAL units corresponding to the first picture. The method of claim 7 , wherein the specific portion of the second picture comprises a coding tree block (CTB) of the second picture.

12. The method of claim 7, wherein the filter coefficients comprise adaptive loop filter (ALF) parameters, and wherein the flag comprises an ALF CTB flag.

13. A non-transitory computer readable medium storing instructions which, when executed, cause a computer to perform the method according to claim 7.

14. A video encoding device, include: At least one processor and a memory, the at least one processor working with the memory and configured to perform operations including: encoding filter coefficients located in suffix units corresponding to a first picture of the video stream into the video stream, wherein the filter coefficients are for a second picture following the first picture; and A flag specifying that an adaptive filter is applied to a specific portion of the second picture is encoded from video data corresponding to a second picture of the video stream, wherein the adaptive filter having filter coefficients is applied to the specific portion of the second picture. 15 . The video encoding device according to claim 14 , wherein the suffix unit is a last unit of an access unit (AU) of a first picture. 16 . The video encoding apparatus according to claim 14 , wherein the video data corresponding to the second picture includes a Video Coding Layer (VCL) Network Abstraction Layer (NAL) unit representing one or more slices. 17 . The video encoding device of claim 14 , wherein the suffix unit corresponding to the first picture comprises a non-VCL NAL unit following all VCL NAL units corresponding to the first picture. 18 . The video encoding apparatus of claim 14 , wherein the specific portion of the second picture comprises a coding tree block (CTB) of the second picture.

19. The video encoding device of claim 14, wherein the filter coefficients comprise adaptive loop filter (ALF) parameters, and wherein the flag comprises an ALF CTB flag.

20. A method for encoding a video, include: encoding filter coefficients located in suffix units corresponding to a first picture of the video stream into the video stream, wherein the filter coefficients are for a second picture following the first picture; and A flag specifying that an adaptive filter is applied to a specific portion of the second picture is encoded from video data corresponding to a second picture of the video stream, wherein the adaptive filter having filter coefficients is applied to the specific portion of the second picture.

21. The method according to claim 20, wherein the suffix unit is a last unit of an access unit (AU) of a first picture.

22. The method of claim 20, wherein the video data corresponding to the second picture comprises a Video Coding Layer (VCL) Network Abstraction Layer (NAL) unit representing one or more slices.

23. The method of claim 20, wherein the suffix units corresponding to the first picture include non-VCL NAL units following all VCL NAL units corresponding to the first picture.

24. The method of claim 20, wherein the specific portion of the second picture comprises a coding tree block (CTB) of the second picture.

25. The method of claim 20, wherein the filter coefficients comprise adaptive loop filter (ALF) parameters, and wherein the flag comprises an ALF CTB flag.

26. A non-transitory computer readable medium storing instructions which, when executed, cause a computer to perform the method of claim 20.