Encoder, decoder, method and video bitstream and computer program for hybrid video coding

By selecting appropriate interpolation filters and motion vector accuracy based on certain attributes of the video sequence, the video encoding processing scheme is dynamically adjusted, solving the trade-off between encoding efficiency and quality in existing technologies and achieving more efficient video encoding and decoding.

CN118945340APending Publication Date: 2024-11-12FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411204156.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2019-03-12
Filing Date
2020-03-12
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing video coding standards use fixed interpolation filters in motion compensation prediction, making it difficult to optimize the trade-off between coding efficiency and quality, especially in terms of adaptability to different video content.

Method used

By selecting appropriate interpolation filters based on partial attributes of the video sequence, dynamically choosing processing schemes using motion vector accuracy and other syntactic elements, and encoding indices in the bitstream to adapt to the characteristics of the video content, flexible processing scheme selection is achieved.

Benefits of technology

It improves the overall efficiency and quality of video encoding, reduces the size of the bitstream, and maintains high-efficiency encoding and decoding performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945340A_ABST
    Figure CN118945340A_ABST
Patent Text Reader

Abstract

The invention relates to an encoder, a decoder, a method and a video bitstream for hybrid video encoding and a computer program. An encoder for hybrid video encoding is provided, the encoder for providing an encoded representation of a video sequence based on input video content, and the encoder is configured to: determine one or more syntax elements related to a portion of the video sequence; selecting a processing scheme to be applied to the portion of the video sequence based on the attributes described by the one or more syntactic elements, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; encoding an index indicating the selected processing scheme such that a given encoded index value represents a different processing scheme according to attributes described by one or more syntactic elements; and providing a bitstream as an encoded representation of the video sequence, the bitstream comprising the one or more syntax elements and the encoded index.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application is a divisional application of application number: 202080035664.5, and the invention name is: Encoder, decoder, method, video bitstream and computer program for hybrid video coding. An embodiment of the present invention relates to an encoder and a decoder for hybrid video coding. Another embodiment of the present invention relates to a method for hybrid video coding. Another embodiment of the present invention relates to a video bitstream for hybrid video coding. Background Art

[0002] All modern video coding standards employ motion compensated prediction (MCP) with fractional sample accuracy using motion vectors (MVs).To obtain sample values ​​of a reference picture at fractional sample positions, interpolation filtering is used.

[0003] In the High Efficiency Video Coding (HEVC) standard, which uses motion vector accuracy of quarter luma samples, there are 15 fractional luma sample positions that are calculated using various one-dimensional finite impulse response (FIR) filters. However, for each fractional sample position, the interpolation filter is fixed.

[0004] Instead of having a fixed interpolation filter for each fractional sample position, an interpolation filter can be selected for each fractional sample position from a set of interpolation filters. Methods that allow switching between different interpolation filters on a slice level include the non-separable adaptive interpolation filter (AIF) [1], the separable adaptive interpolation filter (SAIF) [2], the switched interpolation filter with offset (SIFO) [3], and the enhanced adaptive interpolation filter (EAIF) [4]. The interpolation filter coefficients are explicitly signaled per slice (e.g. in AIF, SAIF, EAIF), or an indication is given as to which interpolation filter from a set of predetermined interpolation filters to use (e.g. in SIFO).

[0005] The current draft of the upcoming Versatile Video Coding (VVC) standard [5] supports so-called Adaptive Motion Vector Resolution (AMVR). Using AMVR, the accuracy of the motion vector predictor (MVP) and the motion vector difference (MVD) can be jointly selected among the following possibilities:

[0006] - Quarter Sample (QPEL): Motion vector accuracy of one quarter luma sample;

[0007] - Full Samples (FPEL): Motion vector accuracy of luma samples;

[0008] -4 Samples (4PEL): Motion vector accuracy of four luma samples.

[0009] To select the desired accuracy, an additional syntax element is transmitted in the bitstream. In case of bidirectional prediction, the indicated accuracy applies to both list0 and list1. AMVR is not available in skip and merge modes. Furthermore, if all MVDs are equal to zero, AMVR is not available. In case any other accuracy than QPEL is used, the MVP is first rounded to the specified accuracy before adding the MVD to obtain the MV.

[0010] Some embodiments of the present disclosure may implement one or more of the above concepts, or may be used in the context thereof. For example, an embodiment may implement the HEVC or VVC standard, and may use AMVR with the above MV accuracy.

[0011] It is desirable to have a concept for encoding, decoding and transmitting video data which provides an improved tradeoff between bit rate, complexity and achievable quality for hybrid video coding. Summary of the invention

[0012] Aspects of the present disclosure relate to an encoder for hybrid video coding (e.g., video coding using prediction and transform coding with prediction errors), the encoder for providing an encoded representation of a video sequence based on input video content, and the encoder being configured to: determine one or more syntax elements (e.g., a motion vector accuracy syntax element) associated with a portion (e.g., a block) of the video sequence; select a processing to be applied (e.g., by a decoder) to the portion of the video sequence based on properties described by the one or more syntax elements (e.g., decoder settings signaled by the one or more syntax elements or characteristics of the portion of the video sequence signaled by the one or more syntax elements); a processing scheme (e.g., an interpolation filter) for obtaining samples for motion compensated prediction at integer and / or fractional positions within a portion of a video sequence (e.g., with respect to the video sequence, e.g., samples, e.g., fractional samples); encoding (e.g., according to one or more syntax elements) an index indicating the selected processing scheme such that a given encoded index value represents (e.g., is associated with) a different processing scheme according to properties described by the one or more syntax elements (e.g., according to values ​​of the one or more syntax elements); and providing (e.g., transmitting, uploading, storing as a file) a bitstream as an encoded representation of the video sequence, the bitstream comprising the one or more syntax elements and the encoded index.

[0013] Selecting a processing scheme to be applied to a portion based on the properties of the portion allows, for example, the applied processing scheme to be adapted to the portion according to the characteristics of the portion. For example, different processing schemes can be selected for different portions of a video sequence. For example, a particular processing scheme may be particularly beneficial for encoding a portion with a given property because the particular processing scheme may be suitable for facilitating particularly efficient encoding and / or facilitating a particularly high quality encoded representation of a portion with a given property. Therefore, selecting a processing scheme based on the properties of the portion (e.g., where a set of possible processing schemes can be adapted to the properties of the portion) can simultaneously improve the overall efficiency and encoding quality of the video sequence. The efficiency of encoding can refer to the low computational effort of encoding, or it can refer to the high compression rate of the encoded information.

[0014] By providing the encoded index indicating the selected processing scheme, the appropriate decoding of the part can be ensured.Because the given value of the encoded index can represent different processing schemes according to the attribute of the part, the encoder can adapt the coding of the index according to the attribute.For example, the quantity of the possible values ​​of the encoded index can be limited to the quantity of the processing scheme applicable to the part with attribute.Therefore, even if the total number of optional processing schemes (such as being associated with different attributes) is very large, the encoded index may also need a small amount of bits (such as, it can be adapted to the quantity of the optional processing schemes of the actual attributes of the part currently considered).Therefore, the encoder can utilize the knowledge about the attribute of the part, by determining one or more syntactic elements, and this knowledge is available for the encoder, so that the index is encoded effectively.Although the selected processing scheme can be indicated in the bitstream, the combination of selecting the processing scheme according to the attribute (wherein compared with the total number of available different processing schemes, the attribute can reduce the quantity of the possible processing scheme of the part currently considered) and encoding the index according to the attribute can therefore improve the overall efficiency of encoding.

[0015] According to an embodiment, the encoder is configured to adapt a mapping rule that maps an index value to an encoded index value according to the attributes described by one or more syntax elements. Adapting the mapping rule according to the attributes can ensure that the index can be encoded so that a given encoded index value represents different processing schemes according to the attributes.

[0016] According to an embodiment, the encoder is configured to adapt the number of binary codes (bins) for providing a coded index according to the attribute described by one or more syntactic elements, and the coded index indicates the selected processing scheme. Therefore, the encoder can adapt the number of binary codes to the number of processing schemes allowed for the attribute, so that if a small number of processing schemes is allowed for the attribute, the encoder can use a small number of binary codes, thereby reducing the size of the bitstream.

[0017] According to an embodiment, encoder is configured to determine the set of processing schemes allowed in view of the described attribute of one or more syntactic elements and select processing scheme from determined set.By determining the set of processing schemes allowed in view of the attribute, encoder can infer information about optional processing scheme from one or more syntactic elements.Therefore, encoder uses to select processing scheme from determining the available information of one or more syntactic elements, therefore improves the efficiency of coding.In addition, relying on the set of processing scheme to select processing scheme can limit the quantity of processing schemes allowed to the set of processing scheme, thereby index coding can be become the encoded index of smaller size.

[0018] According to an embodiment, the encoder is configured to determine whether a single processing scheme is allowed for a portion of the video sequence, and selectively omit the inclusion of the encoded index in response to finding that only a single processing scheme (e.g., a spatial filter or an interpolation filter) is allowed for a portion of the video sequence. Therefore, the encoder can, for example, infer from the properties of the portion that a single processing scheme is allowed for the portion, and select the single processing scheme as the processing scheme to be applied to the portion. Omitting the inclusion of the encoded index in the bitstream can reduce the size of the bitstream.

[0019] According to an embodiment, the encoder is configured to select a mapping rule for mapping index values ​​to encoded index values ​​such that the number of binary codes representing the encoded index values ​​is adapted to the number of processing schemes allowed for the portion of the video sequence. Thus, the encoder can adapt the number of binary codes to the number of processing schemes allowed for the portion, such that if a small number of processing schemes are allowed for the portion, the encoded index can have a small number of binary codes, thereby reducing the size of the bitstream.

[0020] According to an embodiment, in the encoder, the processing scheme is a filter (eg, an interpolation filter) or a set of filters (eg, interpolation filters) (eg, parameterized by the fractional part of the motion vector).

[0021] According to an embodiment, in an encoder, filters in a set of filters may be applied to portions of a video sequence separately (e.g., one-dimensional filters that may be applied sequentially in a spatial direction, such as an x-direction and / or a y-direction). Therefore, filters may be selected individually, increasing the flexibility of selecting filters so that a set of filters may be very accurately adapted to the properties of a portion.

[0022] According to an embodiment, the encoder is configured to select different processing schemes (e.g., different interpolation filters) for different blocks (e.g., different prediction units PU and / or coding units CU and / or coding tree units CTU) within a video frame or picture (different interpolation filters are used for the same fractional sample positions in different parts of a video sequence or in different parts of a single video frame or picture). Therefore, the selection of the processing scheme can take into account the various properties of different blocks, thereby facilitating enhanced coding or coding efficiency of the blocks, or reducing the size of the bitstream.

[0023] According to an embodiment, the encoder is configured to encode an index indicating a selected processing scheme (e.g., according to one or more syntax elements) such that a given encoded index value represents (e.g., is associated with) different processing schemes depending on the motion vector accuracy (e.g., which can be signaled using a syntax element in the bitstream and can, for example, be selected from one of the following values: QPEL, HPEL, FPEL, 4PEL). Therefore, the encoding of the index can depend on the MV accuracy, for example, on the number of processing schemes allowed for the MV accuracy. Due to some settings for the MV accuracy, the number of allowed processing schemes can be smaller than the number of allowed processing schemes for other settings, which is an effective way to reduce the size of the bitstream.

[0024] According to an embodiment, in the encoder, the one or more syntax elements include at least one of motion vector accuracy (e.g., quarter sample, half sample, full sample), fractional sample position, block size, block shape, number of prediction hypotheses (e.g., one hypothesis for single prediction, two hypotheses for bi-prediction), prediction mode (e.g., translational inter, affine inter, translational merge, affine merge, combined inter / intra), availability of a coded residual signal (e.g., a coded block flag), spectral properties of the coded residual signal, a reference picture signal (e.g., a reference block defined by motion data, block edges from collocated prediction units PUs within the reference block, high or low frequency characteristics of the reference signal), loop filter data (e.g., edge offset or band offset classification from a sample adaptive offset filter SAO, deblocking filter decision and boundary strength), motion vector length (e.g., enabling additional smoothing filters only for long motion vectors or specific directions), or an adaptive motion vector resolution mode.

[0025] According to an embodiment, the encoder is configured to encode an index indicating a selected processing scheme (e.g., according to one or more syntax elements) such that a given encoded index value represents (e.g., is associated with) different processing schemes depending on the fractional part (or multiple fractional parts) of the motion vector (e.g., where different encoding schemes are used depending on whether all motion vectors of the considered portion point to integer sample positions, such as luma sample positions). Thus, the encoder can adapt the encoding of the index to the multiple processing schemes allowed for the fractional part of the motion vector. Since the fractional part of the motion vector can be determined from the portion, this is an efficient way to reduce the size of the bitstream.

[0026] According to an embodiment, the encoder is configured to selectively determine a set of processing schemes (e.g., "multiple possibility coding") for a motion vector accuracy (e.g., sub-sample motion vector accuracy, such as HPEL) between a maximum motion vector accuracy (e.g., a sub-sample motion vector resolution better than the previously mentioned motion vector accuracy, such as QPEL) and a minimum motion vector accuracy (e.g., 4PEL), or for a motion vector accuracy (e.g., HPEL) between a maximum motion vector accuracy (e.g., QPEL) and a full sample motion vector accuracy (e.g., FPEL), and select a processing scheme from the determined set. For example, for maximum MV accuracy, there may be a particularly efficient processing scheme, so it may be beneficial to determine the set of processing schemes, while for maximum or full sample MV accuracy, selection of a processing scheme may be unnecessary because there may be no optional processing schemes that can be applied. In contrast, for MV accuracy between maximum MV accuracy and full sample or minimum MV accuracy, it may be particularly beneficial to adapt the processing scheme to the properties of the portion.

[0027] According to an embodiment, the encoder is configured to encode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering), a second FIR filtering, and a third FIR filtering.

[0028] According to an embodiment, the encoder is configured to encode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering) and a second FIR filtering.

[0029] According to an embodiment, the encoder is configured to select (e.g., switch) between processing schemes (e.g., interpolation filters) having different characteristics (e.g., stronger low-pass characteristics versus weaker low-pass characteristics). For example, a processing scheme or filter having a strong low-pass characteristic can attenuate high-frequency noise components, so that the quality of the encoded representation of the video sequence can be enhanced.

[0030] According to an embodiment, the encoder is configured to select a mapping rule based on the motion vector accuracy and the fractional sample position or fractional part (or multiple fractional parts) of the motion vector. Therefore, the encoder can adapt the encoding of the index to multiple processing schemes allowed for the MV accuracy and the fractional part of the motion vector. Since the MV accuracy and the fractional part of the motion vector can be determined from one or more syntax elements, it can be very efficient to use these attributes to determine multiple allowed processing schemes and select the mapping rule accordingly.

[0031] According to an embodiment, the encoder is configured to decide the available set of processing schemes (eg, interpolation filters) according to the motion vector accuracy.

[0032] According to an embodiment, the encoder is configured to select between quarter sample motion vector resolution, half sample motion vector resolution, full sample motion vector resolution, and four sample motion vector resolution (e.g., wherein in the case of selecting half sample motion vector resolution, an index element describing a processing scheme or an interpolation filter is selectively included, and wherein in other cases, for example, the index element describing the processing scheme is omitted).

[0033] According to an embodiment, in the encoder, the processing scheme comprises one or more FIR filters. FIR filters are particularly stable filters for processing video sequences.

[0034] Another aspect of the present disclosure relates to an encoder for hybrid video coding (e.g., video coding using prediction and transform coding of prediction errors), the encoder being configured to provide an encoded representation of a video sequence based on input video content. The encoder is configured to: determine one or more syntax elements (e.g., a motion vector accuracy syntax element) associated with a portion (e.g., a block) of the video sequence; select a processing scheme (e.g., an interpolation filter) to be applied (e.g., by a decoder) to the portion of the video sequence based on properties described by the one or more syntax elements (e.g., decoder settings signaled by the one or more syntax elements or characteristics of the portion of the video sequence signaled by the one or more syntax elements), the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence (e.g., samples related to the video sequence); , such as samples, such as fractional samples); selecting an entropy coding scheme for providing an encoded index indicating a selected processing scheme according to properties described by one or more syntax elements (e.g., according to the values ​​of the one or more syntax elements) (where, for example, if only one processing scheme is allowed in view of one or more considered syntax elements, the number of binary codes specified by the entropy coding scheme can be equal to zero); and providing (e.g., transmitting, uploading, storing as a file) a bitstream as an encoded representation of a video sequence, the bitstream comprising the one or more syntax elements and comprising the encoded index (e.g., if the number of selected binary codes is greater than zero).

[0035] Based on the property of the part, the processing scheme to be applied to the part is selected, and the equivalent functions and advantages described in the previous aspects are provided. In addition, selecting the entropy coding scheme according to the property can make the provision of the encoded index adapted to the property. For example, the number of possible values ​​of the encoded index can be limited to the number of processing schemes applicable to the part with the property. Therefore, even if the total number of optional processing schemes for different parts is very large, the encoded index may also need a small amount of bits in the bitstream or even do not need bits. Therefore, based on the knowledge about the property of the part, the entropy coding scheme is selected (by determining one or more syntactic elements, this knowledge is available for the encoder), and the effective provision of the encoded index can be provided. Therefore, although the selected processing scheme can be indicated in the bitstream, selecting the processing scheme and the entropy coding scheme according to the property can therefore improve the overall efficiency of coding.

[0036] According to an embodiment, in the encoder, the entropy coding scheme includes a binarization scheme for providing the encoded index. Since the entropy coding scheme is selected according to the property, the binarization scheme can be adapted according to the property so that the binarization scheme can provide a particularly short representation of the encoded index.

[0037] According to an embodiment, in the encoder, the binarization scheme includes the number of binary codes to be used to provide the encoded index. Therefore, the number of binary codes to be used to provide the encoded index can be adapted according to the attribute, so that the encoder can select a small amount of binary codes or even no binary codes to provide the encoded index, thereby providing efficient encoding.

[0038] According to an embodiment, the encoder is configured to adapt a mapping rule for mapping index values ​​to encoded index values ​​according to properties described by one or more syntax elements.

[0039] According to an embodiment, the encoder is configured to adapt the number of binary codes used to provide an encoded index indicating the selected processing scheme according to the properties described by the one or more syntax elements.

[0040] According to an embodiment, the encoder is configured to determine a set of allowed processing schemes in view of the properties described by the one or more syntax elements, and to select a processing scheme from the determined set.

[0041] According to an embodiment, the encoder is configured to determine whether a single processing scheme is allowed for a portion of the video sequence, and in response to finding that only a single processing scheme (e.g., a spatial filter or an interpolation filter) is allowed for a portion of the video sequence, selectively omit inclusion of the encoded index.

[0042] According to an embodiment, the encoder is configured to select a mapping rule for mapping index values ​​to encoded index values ​​such that the number of binary codes representing the encoded index values ​​is adapted to the number of allowed processing schemes for the part of the video sequence.

[0043] According to an embodiment, in the encoder, the processing scheme is a filter (eg, an interpolation filter) or a set of filters (eg, interpolation filters) (eg, parameterized by the fractional part of the motion vector).

[0044] According to an embodiment, in an encoder, filters in a set of filters may be applied separately (eg, one-dimensional filters sequentially applicable in spatial directions, such as x-direction and / or y-direction) to parts of a video sequence.

[0045] According to an embodiment, the encoder is configured to select different processing schemes (e.g., different interpolation filters) for different blocks (e.g., different prediction units PU and / or coding units CU and / or coding tree units CTU) within a video frame or picture (different interpolation filters are used for the same fractional sample positions in different parts of a video sequence or in different parts of a single video frame or "picture").

[0046] According to an embodiment, the encoder is configured to encode an index indicating a selected processing scheme (e.g., based on one or more syntax elements) such that a given encoded index value represents (e.g., is associated with) different processing schemes depending on the motion vector accuracy (e.g., which can be signaled using a syntax element in the bitstream and can, for example, be selected from one of the following values: QPEL, HPEL, FPEL, 4PEL).

[0047] According to an embodiment, in the encoder, the one or more syntax elements include at least one of motion vector accuracy (e.g., quarter sample, half sample, full sample), fractional sample position, block size, block shape, number of prediction hypotheses (e.g., one hypothesis for single prediction, two hypotheses for dual prediction), prediction mode (e.g., shifted inter, affine inter, shifted merge, affine merge, combined inter / intra), availability of a coded residual signal (e.g., a coded block flag), spectral properties of the coded residual signal, a reference picture signal (e.g., a reference block defined by motion data, block edges from collocated prediction units PUs within the reference block, high or low frequency characteristics of the reference signal), loop filter data (e.g., edge offset or band offset classification from a sample adaptive offset filter SAO, deblocking filter decision and boundary strength), motion vector length (e.g., enabling additional smoothing filters only for long motion vectors or specific directions), or an adaptive motion vector resolution mode.

[0048] According to an embodiment, the encoder is configured to encode an index indicating the selected processing scheme (e.g., according to one or more syntax elements) such that a given encoded index value represents (e.g., is associated with) different processing schemes depending on the fractional part (or multiple fractional parts) of the motion vector (wherein, for example, different encoding schemes are used depending on whether all motion vectors of the considered part point to integer sample positions, such as luma sample positions).

[0049] According to an embodiment, the encoder is configured to selectively determine a set of processing schemes (e.g., "multi-possibility encoding") for a motion vector accuracy (e.g., sub-sample motion vector accuracy, such as HPEL) between a maximum motion vector accuracy (e.g., a sub-sample motion vector resolution that is better than the previously mentioned motion vector accuracy) and a minimum motion vector accuracy (e.g., 4PEL) or for a motion vector accuracy (e.g., HPEL) between a maximum motion vector accuracy (e.g., QPEL) and a full sample motion vector accuracy (e.g., FPEL), and select a processing scheme from the determined set.

[0050] According to an embodiment, the encoder is configured to encode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering), a second FIR filtering, and a third FIR filtering.

[0051] According to an embodiment, the encoder is configured to encode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering) and a second FIR filtering.

[0052] According to an embodiment, the encoder is configured to select (eg switch) between processing schemes (eg interpolation filters) having different characteristics (eg stronger low-pass characteristics versus weaker low-pass characteristics).

[0053] According to an embodiment, the encoder is configured to select a mapping rule depending on the motion vector accuracy and the fractional sample position or fractional part(s) of the motion vector.

[0054] According to an embodiment, the encoder is configured to decide the available set of processing schemes (eg, interpolation filters) according to the motion vector accuracy.

[0055] According to an embodiment, the encoder is configured to select between quarter sample motion vector resolution, half sample motion vector resolution, full sample motion vector resolution, and four sample motion vector resolution (e.g., wherein in the case of selecting half sample motion vector resolution, an index element describing a processing scheme or an interpolation filter is selectively included, and wherein in other cases, for example, an index element describing a processing scheme is omitted).

[0056] According to an embodiment, in the encoder, the processing scheme comprises one or more FIR filters.

[0057] Another aspect of the present disclosure relates to a decoder for hybrid video decoding (e.g., video decoding using prediction and transform decoding of prediction errors), the decoder being configured to provide output video content based on an encoded representation of a video sequence, the decoder being configured to: obtain (e.g., receive, download, open from a file) a bitstream as an encoded representation of the video sequence; identify from the bitstream one or more syntax elements (e.g., a motion vector accuracy syntax element) (and an encoded index) associated with a portion (e.g., a block) of the video sequence; identify, based on the one or more syntax elements and the index (which may be included in an encoded form in the bitstream), a processing scheme (e.g., an interpolation filter, e.g., selected by an encoder) for the portion of the video sequence, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence (e.g., with respect to the video sequence, e.g., samples, e.g., fractional samples), wherein the decoder is configured to assign different processing schemes to given encoded index values ​​according to the one or more syntax elements (e.g., according to the values ​​of the one or more syntax elements); and apply the identified processing scheme to the portion of the video sequence.

[0058] Decoder is based on this idea, based on syntax elements and index to identify the processing scheme for part, although the given encoded index value representing the value of the index can be associated with various processing schemes. The identification of the processing scheme can be realized by assigning the processing scheme to the encoded index value according to the syntax elements. Therefore, the decoder can use the information provided by the syntax elements to identify the processing scheme from the different processing schemes that may be associated with the encoded index value. Because the given encoded index value can be assigned to several processing schemes, the information density of the bit stream may be particularly high, but the decoder can still identify the processing scheme.

[0059] According to an embodiment, in the decoder, the processing scheme is a filter (eg, an interpolation filter) or a set of filters (eg, a plurality of interpolation filters) (eg, parameterized by the fractional part of the motion vector).

[0060] According to an embodiment, in a decoder, filters in a set of filters may be applied separately (eg, one-dimensional filters sequentially applicable in spatial directions, such as x-direction and / or y-direction) to parts of a video sequence.

[0061] According to an embodiment, the decoder is configured to select (e.g., apply) a filter (e.g., an interpolation filter) based on the fractional part (multiple fractional parts) of the motion vector (e.g., based on the fractional parts of one or more motion vectors) (e.g., by selecting, e.g., applying, a first filter if the motion vector endpoint is located at a full sample position or at a full sample position in the considered direction, and by selecting, e.g., applying, a second filter different from the first filter if the motion vector endpoint is located between full samples or between full samples in the considered direction).

[0062] According to an embodiment, the decoder is configured to select (e.g., apply) different filters (e.g., interpolation filters) for filtering in a first direction (e.g., x) and in a second direction (e.g., y) based on a fractional part (or multiple fractional parts) of a motion vector.

[0063] According to an embodiment, the decoder is configured to select (e.g. apply) different filters (e.g. interpolation filters) for filtering in a first direction and for filtering in a second direction such that a stronger low-pass filter is applied for filtering in a direction where (one or more or all) fractional parts (or multiple fractional parts) of a motion vector are located on a full sample (e.g. if (multiple) half-sample accurate motion vectors point to (multiple) full sample locations) (when compared to filtering applied in a direction where the fractional part (or multiple fractional parts) of a motion vector are located between full samples).

[0064] According to an embodiment, the decoder is configured to select (e.g. apply; e.g. separately per filtering direction) a filter (e.g. an interpolation filter) signaled via a syntax element (e.g. an interpolation filter index if_idx) or a predetermined filter based on one or more fractional parts (or multiple fractional parts) of a motion vector (wherein, for example, when considering the position coordinates in a first direction, if one or more fractional parts (or multiple fractional parts) of the motion vector are located between full samples, the filter signaled via the syntax element is selected for filtering in the first direction, and wherein, for example, when considering the position coordinates in a second direction, if all fractional parts (or multiple fractional parts) of the motion vector are located on full samples, the predetermined filter is selected for filtering in a second direction different from the first direction).

[0065] According to an embodiment, the decoder is configured to select (e.g. apply; e.g. separately per filtering direction) a first filter (e.g. an interpolation filter) signaled via a filter syntax element (e.g. an interpolation filter index if_idx) or a second filter signaled via a filter syntax element based on one or more fractional parts (or multiple fractional parts) of a motion vector (wherein, for example, when considering the position coordinates of the first direction, if one or more fractional parts (or multiple fractional parts) of the motion vector are located between full samples, the first filter signaled via the filter syntax element is selected for filtering in the first direction, and wherein, for example, when considering the position coordinates of the second direction, if all fractional parts (or multiple fractional parts) of the motion vector are located on full samples, the second filter signaled via the filter syntax element is selected for filtering in a second direction different from the first direction).

[0066] According to an embodiment, the decoder is configured to take over the filter selection from a neighboring block in merge mode (eg selectively depending on whether the motion vector is the same as the motion vector of the neighboring block).

[0067] According to an embodiment, in the decoder, the selected (eg applied) processing scheme defines (eg spatial) filtering of the luma component and / or (eg spatial) filtering of the chroma components.

[0068] According to an embodiment, the decoder is configured to select (eg apply) a filter depending on the prediction mode.

[0069] According to an embodiment, the decoder is configured to adapt a mapping rule according to one or more syntax elements, the mapping rule mapping the encoded index value to an indication (eg an index value) indicating a processing scheme.

[0070] According to an embodiment, the decoder is configured to adapt, according to one or more syntax elements, the number of binary codes for identifying an encoded index indicating the selected processing scheme.

[0071] According to an embodiment, the decoder is configured to determine a set of allowed processing schemes in view of the one or more syntax elements, and to identify a processing scheme to be applied from the determined set based on the one or more syntax elements and an index.

[0072] According to an embodiment, the decoder is configured to determine whether a single processing scheme is allowed for a portion of a video sequence, and in response to finding that only a single processing scheme (e.g., a spatial filter or an interpolation filter) is allowed for a portion of the video sequence, selectively omits identification of the encoded index.

[0073] According to an embodiment, the decoder is configured to select a mapping rule which maps an encoded index value to an indication (eg an index value) indicating a processing scheme such that the number of binary codes representing the encoded index value is adapted to the number of processing schemes allowed for the portion of the video sequence.

[0074] According to an embodiment, the decoder is configured to select (e.g., apply) different processing schemes (e.g., different interpolation filters) for different blocks (e.g., different prediction units PU and / or coding units CU and / or coding tree units CTU) within a video frame or picture (different interpolation filters are used for the same fractional sample positions in different parts of a video sequence or in different parts of a single video frame or "picture").

[0075] According to an embodiment, the decoder is configured to encode an index indicating a selected processing scheme (e.g., based on one or more syntax elements) such that a given encoded index value represents (e.g., is associated with) different processing schemes depending on the motion vector accuracy (e.g., which can be signaled using a syntax element in the bitstream and can, for example, be selected from one of the following values: QPEL, HPEL, FPEL, 4PEL).

[0076] According to an embodiment, the one or more syntax elements include at least one of motion vector accuracy (e.g., quarter sample, half sample, full sample), fractional sample position, block size, block shape, number of prediction hypotheses (e.g., one hypothesis for single prediction, two hypotheses for dual prediction), prediction mode (e.g., shifted inter, affine inter, shifted merge, affine merge, combined inter / intra), availability of a coded residual signal (e.g., a coded block flag), spectral properties of the coded residual signal, a reference picture signal (e.g., a reference block defined by motion data, block edges from collocated prediction units PUs within the reference block, high or low frequency characteristics of the reference signal), loop filter data (e.g., edge offset or band offset classification from a sample adaptive offset filter SAO, deblocking filter decision and boundary strength), motion vector length (e.g., enabling additional smoothing filters only for long motion vectors or specific directions), or an adaptive motion vector resolution mode.

[0077] According to an embodiment, the decoder is configured to decode an index indicating a selected processing scheme (e.g. based on one or more syntax elements) such that a given encoded index value represents (e.g. is associated with) different processing schemes depending on the fractional part (or multiple fractional parts) of the motion vector (wherein, for example, different encoding schemes are used depending on whether all motion vectors of the considered part point to integer sample positions, such as luma sample positions).

[0078] According to an embodiment, the decoder is configured to selectively determine a set of processing schemes (e.g., "multiple possibility coding") for a motion vector accuracy (e.g., sub-sample motion vector accuracy, e.g., HPEL) between a maximum motion vector accuracy (e.g., a sub-sample motion vector resolution better than the previously mentioned motion vector accuracy, e.g., QPEL) and a minimum motion vector accuracy (e.g., 4PEL) or for a motion vector accuracy (e.g., HPEL) between a maximum motion vector accuracy (e.g., QPEL) and a full sample motion vector accuracy (e.g., FPEL), and identify a processing scheme to be applied from the determined set.

[0079] According to an embodiment, the decoder is configured to decode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering), a second FIR filtering, and a third FIR.

[0080] According to an embodiment, the decoder is configured to decode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering) and a second FIR filtering.

[0081] According to an embodiment, the decoder is configured to apply processing schemes (eg interpolation filters) having different characteristics (eg stronger low-pass characteristics versus weaker low-pass characteristics).

[0082] According to an embodiment, the decoder is configured to select a mapping rule depending on the motion vector accuracy and the fractional sample position or fractional part(s) of the motion vector.

[0083] According to an embodiment, the decoder is configured to determine the available set of processing schemes (eg interpolation filters) according to the motion vector accuracy.

[0084] According to an embodiment, the decoder is configured to apply one of a quarter sample motion vector resolution, a half sample motion vector resolution, a full sample motion vector resolution, or a four sample motion vector resolution (wherein, for example, in the case where the half sample motion vector resolution is selected, an index element describing a processing scheme or an interpolation filter is selectively included, and wherein, in other cases, for example, the index element describing the processing scheme is omitted).

[0085] According to an embodiment, in the decoder, the processing scheme comprises one or more FIR filters.

[0086] Another aspect of the present disclosure relates to a decoder for hybrid video decoding (e.g., video decoding using prediction and transform decoding of prediction errors), the decoder being configured to provide output video content based on an encoded representation of a video sequence, the decoder being configured to: obtain (e.g., receive, download, open from a file) a bitstream as an encoded representation of a video sequence; identify from the bitstream one or more syntax elements (e.g., motion vector accuracy syntax elements) associated with a portion (e.g., a block) of the video sequence; determine, based on the one or more syntax elements, an entropy coding scheme for providing an encoded index in the bitstream, the encoded index indicating a processing scheme (e.g., an interpolation filter, e.g., a vector accuracy syntax element) for the portion of the video sequence; The invention relates to a method of determining a processing scheme for obtaining samples for motion compensated prediction at integer and / or fractional positions within a portion of a video sequence (e.g., with respect to the video sequence, e.g., samples, e.g., fractional samples); if the determined entropy coding scheme specifies a number of binary codes greater than zero, identifying an encoded index in a bitstream and decoding the index; if the determined number of binary codes specified by the coding scheme is greater than zero, identifying (e.g., selecting) a processing scheme based on one or more syntax elements and based on the decoded index (or if the determined number of binary codes is zero, identifying a processing scheme based only on one or more syntax elements); and applying the identified processing scheme to the portion of the video sequence.

[0087] Decoder is based on this idea, by determining entropy coding scheme based on syntactic elements to identify the processing scheme for part. From the determined entropy coding scheme, decoder can infer how to identify the processing scheme. By identifying whether the number of binary codes specified by the entropy coding scheme is greater than zero, decoder can infer the information encoded in the bit stream by the entropy coding scheme, independent of the number of binary codes. In other words, decoder can use the information that the number of binary codes is zero to identify the processing scheme. In addition, since decoder can use syntactic elements and indexes to identify the processing scheme therefrom, even if a given encoded index value can be associated with various processing schemes, decoder can also identify the processing scheme. Therefore, even if the number of binary codes used to transmit information about the processing scheme in the bit stream is a small amount or even zero, decoder can also identify the processing scheme.

[0088] According to an embodiment, in a decoder, the entropy coding scheme comprises a binarization scheme for providing an encoded index.

[0089] According to an embodiment, in a decoder, the binarization scheme comprises a number of binary codes for providing an encoded index.

[0090] According to an embodiment, in the decoder, the processing scheme is a filter (eg an interpolation filter) or a set of filters (eg a plurality of interpolation filters) (eg parameterized by a fractional part of a motion vector).

[0091] According to an embodiment, in a decoder, filters in a set of filters are respectively applicable (eg one-dimensional filters sequentially applicable in spatial directions, such as x-direction and / or y-direction) to parts of a video sequence.

[0092] According to an embodiment, the decoder is configured to select (e.g., apply) a filter (e.g., an interpolation filter) based on a fractional part (or multiple fractional parts) of a motion vector (e.g., based on the fractional parts of one or more motion vectors) (e.g., by selecting, e.g., applying, a first filter if the motion vector endpoint is located at a full sample position or at a full sample position in the considered direction, and by selecting, e.g., applying, a second filter different from the first filter if the motion vector endpoint is located between full samples or between full samples in the considered direction).

[0093] According to an embodiment, the decoder is configured to select (e.g., apply) different filters (e.g., interpolation filters) for filtering in a first direction (e.g., x) and in a second direction (e.g., y) based on a fractional part (or multiple fractional parts) of a motion vector.

[0094] According to an embodiment, the decoder is configured to select (e.g. apply) different filters (e.g. interpolation filters) for filtering in a first direction and for filtering in a second direction such that stronger low-pass filtering is applied for filtering in a direction where (one or more or all) fractional parts (or multiple fractional parts) of a motion vector are located on full samples (e.g. if (multiple) half-sample accurate motion vectors point to (multiple) full sample locations) (when compared to filtering applied in a direction where the fractional part (or multiple fractional parts) of a motion vector are located between full samples).

[0095] According to an embodiment, the decoder is configured to select (e.g. apply; e.g. separately per filtering direction) a filter (e.g. an interpolation filter) signaled via a syntax element (e.g. an interpolation filter index if_idx) or a predetermined filter based on one or more fractional parts (or multiple fractional parts) of a motion vector (wherein, for example, when considering the position coordinates in a first direction, if one or more fractional parts (or multiple fractional parts) of the motion vector are located between full samples, the filter signaled via the syntax element is selected for filtering in the first direction, and wherein, for example, when considering the position coordinates in a second direction, if all fractional parts (or multiple fractional parts) of the motion vector are located on full samples, the predetermined filter is selected for filtering in a second direction different from the first direction).

[0096] According to an embodiment, the decoder is configured to select (e.g. apply; e.g. separately per filtering direction) a first filter (e.g. an interpolation filter) signaled via a filter syntax element (e.g. an interpolation filter index if_idx) or a second filter signaled via a filter syntax element based on one or more fractional parts (or multiple fractional parts) of a motion vector (wherein, for example, when considering the position coordinates in the first direction, if one or more fractional parts (or multiple fractional parts) of the motion vector are located between multiple full samples, the first filter signaled via the filter syntax element is selected for filtering in the first direction, and wherein, for example, when considering the position coordinates in the second direction, if all fractional parts (or multiple fractional parts) of the motion vector are located on full samples, the second filter signaled via the filter syntax element is selected for filtering in a second direction different from the first direction).

[0097] According to an embodiment, the decoder is configured to take over the filter selection from a neighboring block in merge mode (eg selectively depending on whether the motion vector is the same as the motion vector of the neighboring block).

[0098] According to an embodiment, in the decoder, the selected (eg applied) processing scheme defines (eg spatial) filtering of the luma component and / or (eg spatial) filtering of the chroma components.

[0099] According to an embodiment, the decoder is configured to select (eg apply) a filter depending on the prediction mode.

[0100] According to an embodiment, the decoder is configured to adapt a mapping rule according to one or more syntax elements, the mapping rule mapping the encoded index value to an indication (eg an index value) indicating a processing scheme.

[0101] According to an embodiment, the decoder is configured to adapt, according to one or more syntax elements, the number of binary codes for identifying an encoded index indicating the selected processing scheme.

[0102] According to an embodiment, the decoder is configured to determine a set of allowed processing schemes in view of the one or more syntax elements, and to identify a processing scheme to be applied from the determined set based on the one or more syntax elements and an index.

[0103] According to an embodiment, the decoder is configured to determine whether a single processing scheme is allowed for a portion of the video sequence, and in response to finding that only a single processing scheme (e.g., a spatial filter or an interpolation filter) is allowed for a portion of the video sequence, selectively omits identification of the encoded index.

[0104] According to an embodiment, the decoder is configured to select a mapping rule which maps an encoded index value to an indication (eg an index value) indicating a processing scheme such that the number of binary codes representing the encoded index value is adapted to the number of processing schemes allowed for the portion of the video sequence.

[0105] According to an embodiment, the decoder is configured to select (e.g., apply) different processing schemes (e.g., different interpolation filters) for different blocks (e.g., different prediction units PU and / or coding units CU and / or coding tree units CTU) within a video frame or picture (different interpolation filters are used for the same fractional sample positions in different parts of a video sequence or in different parts of a single video frame or "picture").

[0106] According to an embodiment, the decoder is configured to decode an index indicating a selected processing scheme (e.g., based on one or more syntax elements) such that a given encoded index value represents (e.g., is associated with) different processing schemes based on a motion vector accuracy (e.g., which can be signaled using a syntax element in the bitstream and can, for example, be selected from one of the following values: QPEL, HPEL, FPEL, 4PEL).

[0107] According to an embodiment, in the decoder, the one or more syntax elements include at least one of motion vector accuracy (e.g., quarter sample, half sample, full sample), fractional sample position, block size, block shape, number of prediction hypotheses (e.g., one hypothesis for single prediction, two hypotheses for dual prediction), prediction mode (e.g., shifted inter, affine inter, shifted merge, affine merge, combined inter / intra), availability of a coded residual signal (e.g., a coded block flag), spectral properties of the coded residual signal, a reference picture signal (e.g., a reference block defined by motion data, block edges from collocated prediction units PUs within the reference block, high or low frequency characteristics of the reference signal), loop filter data (e.g., edge offset or band offset classification from a sample adaptive offset filter SAO, deblocking filter decision and boundary strength), motion vector length (e.g., enabling additional smoothing filters only for long motion vectors or specific directions), or an adaptive motion vector resolution mode.

[0108] According to an embodiment, the decoder is configured to decode an index indicating a selected processing scheme (e.g. based on one or more syntax elements) such that a given encoded index value represents (e.g. is associated with) different processing schemes depending on the fractional part (or multiple fractional parts) of the motion vector (wherein, for example, different encoding schemes are used depending on whether all motion vectors of the considered part point to integer sample positions, such as luma sample positions).

[0109] According to an embodiment, the decoder is configured to selectively determine a set of processing schemes (e.g., "multiple possibility coding") for a motion vector accuracy (e.g., sub-sample motion vector accuracy, e.g., HPEL) between a maximum motion vector accuracy (e.g., a sub-sample motion vector resolution better than the previously mentioned motion vector accuracy, e.g., QPEL) and a minimum motion vector accuracy (e.g., 4PEL), or for a motion vector accuracy (e.g., HPEL) between the maximum motion vector accuracy (e.g., QPEL) and the full sample motion vector accuracy (e.g., FPEL), and identify a processing scheme to be applied from the determined set.

[0110] According to an embodiment, the decoder is configured to decode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering), a second FIR filtering, and a third FIR.

[0111] According to an embodiment, the decoder is configured to decode an index (processing scheme index, if_idx) for selecting between a first FIR filtering (eg, HEVC filtering) (eg, HEVC 8-tap filtering) and a second FIR filtering.

[0112] According to an embodiment, the decoder is configured to apply processing schemes (eg interpolation filters) having different characteristics (eg stronger low-pass characteristics versus weaker low-pass characteristics).

[0113] According to an embodiment, the decoder is configured to select a mapping rule depending on the motion vector accuracy and the fractional sample position or fractional part(s) of the motion vector.

[0114] According to an embodiment, the decoder is configured to determine the available set of processing schemes (eg interpolation filters) according to the motion vector accuracy.

[0115] According to an embodiment, the decoder is configured to apply one of a quarter sample motion vector resolution, a half sample motion vector resolution, a full sample motion vector resolution, or a four sample motion vector resolution (wherein, for example, in the case where the half sample motion vector resolution is selected, an index element describing a processing scheme or an interpolation filter is selectively included, and wherein, in other cases, for example, the index element describing the processing scheme is omitted).

[0116] According to an embodiment, the processing scheme comprises one or more FIR filters.

[0117] Another aspect of the present disclosure relates to a method for hybrid video coding (e.g., video coding using prediction and transform coding of prediction errors), the method for providing an encoded representation of a video sequence based on input video content, (e.g., a method performed by an encoder), the method comprising: determining one or more syntax elements (e.g., a motion vector accuracy syntax element) associated with a portion (e.g., a block) of the video sequence; selecting a decoder to be applied to the video sequence (e.g., by a decoder) based on properties described by the one or more syntax elements (e.g., decoder settings signaled by the one or more syntax elements or characteristics of the portion of the video sequence signaled by the one or more syntax elements); a processing scheme (e.g., an interpolation filter) for a portion of a video sequence, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of a video sequence (e.g., with respect to the video sequence, e.g., samples, e.g., fractional samples); encoding an index indicating the selected processing scheme (e.g., according to one or more syntax elements) such that a given encoded index value represents (e.g., is associated with) a different processing scheme according to properties described by the one or more syntax elements (e.g., according to the values ​​of the one or more syntax elements); and providing (e.g., transmitting, uploading, storing as a file) a bitstream as a coded representation of the video sequence, the bitstream comprising the one or more syntax elements and the encoded index.

[0118] Another aspect of the present disclosure relates to a method for hybrid video coding (e.g., video coding using prediction and transform coding of prediction errors), the method for providing an encoded representation of a video sequence based on input video content, (e.g., a method performed by an encoder), the method comprising: determining one or more syntax elements (e.g., a motion vector accuracy syntax element) associated with a portion (e.g., a block) of the video sequence; selecting a processing scheme (e.g., an interpolation filter) to be applied (e.g., by a decoder) to the portion of the video sequence based on properties described by the one or more syntax elements (e.g., decoder settings signaled by the one or more syntax elements or characteristics of the portion of the video sequence signaled by the one or more syntax elements), the processing scheme being used to obtain Samples for motion compensated prediction at integer and / or fractional positions within a portion of a video sequence (e.g., with respect to the video sequence, e.g., samples, e.g., fractional samples); selecting an entropy coding scheme for providing an encoded index indicating a selected processing scheme based on properties described by one or more syntax elements (e.g., based on values ​​of the one or more syntax elements) (wherein, for example, the number of binary codes specified by the entropy coding scheme may be equal to zero if only one processing scheme is allowed in view of one or more considered syntax elements); and providing (e.g., transmitting, uploading, storing as a file) a bitstream as an encoded representation of the video sequence, the bitstream comprising the one or more syntax elements and comprising the encoded index (e.g., if the number of selected binary codes is greater than zero).

[0119] Another aspect of the present disclosure relates to a method for hybrid video decoding (e.g., video decoding using prediction and transform decoding of prediction errors), the method for providing output video content based on an encoded representation of a video sequence, (e.g., a method performed by a decoder), the method comprising: obtaining (e.g., receiving, downloading, opening from a file) a bitstream as an encoded representation of a video sequence; identifying from the bitstream one or more syntax elements (e.g., a motion vector accuracy syntax element) (and an encoded index) associated with a portion (e.g., a block) of the video sequence; identifying, based on the one or more syntax elements and the index (which may be included in the bitstream in an encoded form), a processing scheme (e.g., an interpolation filter, e.g., selected by an encoder) for the portion of the video sequence, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence (e.g., with respect to the video sequence, e.g., samples, e.g., fractional samples), wherein the method assigns different processing schemes to given encoded index values ​​according to the one or more syntax elements (e.g., according to the values ​​of the one or more syntax elements); and applying the identified processing scheme to the portion of the video sequence.

[0120] Another aspect of the present disclosure relates to a method for hybrid video decoding (e.g., video decoding using prediction and transform decoding of prediction errors), the method for providing output video content based on an encoded representation of a video sequence (e.g., a method performed by a decoder), the method comprising: obtaining (e.g., receiving, downloading, opening from a file) a bitstream as an encoded representation of a video sequence; identifying one or more syntax elements (e.g., motion vector accuracy syntax elements) associated with a portion (e.g., a block) of the video sequence from the bitstream; determining, based on the one or more syntax elements, an entropy coding scheme for providing an encoded index in the bitstream, the encoded index indicating a processing scheme (e.g., interpolation filter) for the portion of the video sequence a processor, such as one selected by an encoder), the processing scheme for obtaining samples for motion compensated prediction at integer and / or fractional positions within a portion of a video sequence (e.g., with respect to the video sequence, such as samples, such as fractional samples); if the determined entropy coding scheme specifies a number of binary codes greater than zero, identifying an encoded index in a bitstream and decoding the index; if the determined entropy coding scheme specifies a number of binary codes greater than zero, identifying (e.g., selecting) a processing scheme based on one or more syntax elements and based on the decoded index (or if the determined number of binary codes is zero, identifying a processing scheme based only on one or more syntax elements); and applying the identified processing scheme to the portion of the video sequence.

[0121] Another aspect of the present disclosure relates to a video bitstream for hybrid video coding (e.g., video coding using prediction and transform coding of prediction errors), the video bitstream describing a video sequence (e.g., in the form of an encoded representation of the video sequence), wherein the video bitstream includes one or more syntax elements (e.g., a motion vector accuracy syntax element) related to portions (e.g., blocks) of the video sequence; wherein at least for some of the portions of the video sequence, the video bitstream includes a processing scheme index bitstream element (e.g., describing an interpolation filter to be used by a video decoder, such as if_idx); wherein the presence of the processing scheme index bitstream element (e.g., which describes the filtering or interpolation filtering to be performed by the video decoder) varies depending on one or more other syntax elements (e.g., such that for a first value of another syntax element or for a first combination of values ​​of multiple other syntax elements, the processing scheme index bitstream element is present, and, e.g., such that for a second value of another syntax element or for a second combination of values ​​of multiple other syntax elements, the processing scheme index bitstream element is omitted).

[0122] Another aspect of the present disclosure relates to a video bitstream for hybrid video coding (e.g., video coding using prediction and transform coding of prediction errors), the bitstream describing a video sequence (e.g., in the form of an encoded representation of the video sequence), wherein the video bitstream includes one or more syntax elements related to portions (e.g., blocks) of the video sequence (e.g., a motion vector accuracy syntax element); wherein at least for some of the portions of the video sequence, the video bitstream includes a processing scheme index bitstream element (e.g., describing an interpolation filter to be used by a video decoder, such as if_idx); wherein the number of binary codes of the processing scheme index bitstream element varies depending on the one or more syntax elements related to the portion of the video sequence (e.g., such that the number of binary codes of the processing scheme index bitstream element is adapted to the number of processing schemes allowed for the portion of the video sequence; e.g., such that when only a single processing scheme is allowed for the portion of the video sequence, the number of binary codes of the processing scheme index bitstream element is equal to zero, e.g., the processing scheme index bitstream element is omitted).

[0123] Another aspect of the present disclosure relates to a video bitstream for hybrid video coding (e.g., video coding using prediction and transform coding of prediction errors), the bitstream describing a video sequence (e.g., in the form of an encoded representation of the video sequence), wherein the video bitstream includes one or more syntax elements associated with portions (e.g., blocks) of the video sequence (e.g., a motion vector accuracy syntax element); wherein at least for some of the portions of the video sequence, the video bitstream includes a processing scheme index bitstream element (e.g., describing an interpolation filter to be used by a video decoder, such as if_idx); wherein the meaning of a codeword of the processing scheme index bitstream element (e.g., an encoded index value) varies depending on the one or more syntax elements associated with the portion of the video sequence (e.g., such that different processing schemes are assigned to a given encoded index value depending on the one or more syntax elements associated with the portion of the video sequence).

[0124] Another aspect of the present disclosure relates to a decoder for hybrid video decoding, the decoder being used to provide output video content based on an encoded representation of a video sequence, the decoder being configured to: obtain a bitstream as an encoded representation of the video sequence; identify one or more syntax elements associated with a portion of the video sequence from the bitstream; select a processing scheme for the portion of the video sequence based on the one or more syntax elements, wherein the processing scheme is completely specified by attributes of the portion and a fractional part of a motion vector (wherein the attributes are described by the one or more syntax elements); the processing scheme is used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and apply the identified processing scheme to the portion of the video sequence.

[0125] Since the decoder can select a processing scheme based on one or more syntax elements, the decoder can select a processing scheme for a part without the syntax elements specifically used for the processing scheme. Therefore, even if the processing scheme is not clearly indicated in the bitstream, the decoder can select the processing scheme, so that the bitstream can be particularly small. When the decoder uses one or more syntax elements to obtain the processing scheme, the decoder can select the processing scheme with the granularity provided by the one or more syntax elements. Therefore, the decoder can effectively use the information already provided in the bitstream to select the processing scheme with fine granularity without the extra bits in the bitstream. The fractional part of the motion vector can particularly accurately characterize the processing scheme to be used to obtain the sample, because the motion vector can be used for motion compensation prediction. Therefore, the processing scheme can be selected quickly and reliably based on the fractional part of the motion vector.

[0126] According to an embodiment, the properties of the portion of the specified processing scheme are related to one or both or all of the motion vector accuracy, the fractional position of the sample (to be obtained by the processing scheme), and the prediction mode to be used for the portion. Since the processing scheme can be used to obtain samples for motion compensation prediction, the MV accuracy can provide accurate hints about the appropriate processing scheme to be used for the portion. Since different processing schemes can be used for full sample, half sample and quarter sample positions, the fractional position of the sample can limit the number of allowed processing schemes, or even specify the processing scheme. One or more syntactic elements for decoding the portion of the video sequence can indicate one or more or all of the motion vector accuracy, the fractional position of the sample and the prediction mode. Therefore, the decoder mainly infers the processing scheme from the information already available.

[0127] According to an embodiment, the portion is a prediction unit (PU) or a coding unit (CU), and wherein the decoder is configured to select processing schemes separately for different portions of the video sequence. Selecting processing schemes separately for different prediction units or coding units enables the processing schemes to adapt to the local characteristics of the video sequence with particularly fine granularity. This precise adaptation allows the portion to be decoded from a bitstream of particularly small size and / or may be able to be decoded particularly quickly. Since the processing scheme is selected based on one or more syntactic elements, it is possible to determine the processing schemes separately for different prediction units or coding units without increasing the size of the bitstream.

[0128] According to an embodiment, the decoder is configured to use different processing schemes for the same fractional sample positions in different parts of the video sequence.

[0129] According to an embodiment, the decoder is configured to switch processing schemes at PU or CU level to adapt local image characteristics.

[0130] According to an embodiment, none of the one or more syntax elements is explicitly dedicated to indicating a processing scheme.

[0131] Another aspect of the present disclosure relates to a decoder for hybrid video decoding, the decoder being used to provide output video content based on an encoded representation of a video sequence, the decoder being configured to: obtain a bitstream that is an encoded representation of the video sequence; identify one or more syntax elements associated with a portion of the video sequence from the bitstream; select a processing scheme for the portion of the video sequence based on a motion vector accuracy, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and apply the identified processing scheme to the portion of the video sequence.

[0132] According to an embodiment, the decoder is configured to select a processing scheme depending on the motion vector accuracy and the fractional position of the samples to be obtained by the processing scheme.

[0133] According to an embodiment, the decoder is configured to select the processing scheme additionally depending on the prediction mode to be used for the portion.

[0134] According to an embodiment, the portion is a prediction unit (PU) or a coding unit (CU), and wherein the decoder is configured to select a processing scheme separately for different portions of a video sequence. Selecting a processing scheme separately for different prediction units or coding units enables the processing scheme to be adapted to the local characteristics of the video sequence with a particularly fine granularity. This precise adaptation allows the portion to be decoded from a bitstream of particularly small size and / or may be able to be decoded particularly quickly. Since the processing scheme is selected based on one or more syntax elements, it is possible to determine the processing scheme separately for different prediction units or coding units without increasing the size of the bitstream.

[0135] According to an embodiment, the decoder is configured to use different processing schemes for the same fractional sample positions in different parts of the video sequence.

[0136] According to an embodiment, the decoder is configured to switch processing schemes at PU or CU level to adapt local image characteristics.

[0137] According to an embodiment, none of the one or more syntax elements is explicitly dedicated to indicating a processing scheme.

[0138] Another aspect of the present disclosure relates to a decoder for hybrid video decoding, the decoder being used to provide output video content based on an encoded representation of a video sequence, the decoder being configured to: obtain a bitstream as an encoded representation of the video sequence; identify one or more syntax elements related to a portion of the video sequence from the bitstream; determine a processing scheme for the portion of the video sequence at a PU granularity or a CU granularity and based on the one or more syntax elements, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and apply the identified processing scheme to the portion of the video sequence.

[0139] According to an embodiment, the decoder is configured to use different processing schemes for the same fractional sample positions in different parts of the video sequence.

[0140] According to an embodiment, the decoder is configured to switch processing schemes at PU or CU level to adapt local image characteristics.

[0141] According to an embodiment, none of the one or more syntax elements is explicitly dedicated to indicating a processing scheme.

[0142] According to an embodiment, in the decoder, the processing scheme is a filter (eg, an interpolation filter) or a set of filters (eg, a plurality of interpolation filters) (eg, parameterized by a fractional part of a motion vector).

[0143] According to an embodiment, in a decoder, filters in a set of filters may be applied separately (eg, one-dimensional filters sequentially applicable in spatial directions, such as x-direction and / or y-direction) to parts of a video sequence.

[0144] According to an embodiment, the decoder is configured to select (e.g., apply) different filters (e.g., interpolation filters) for filtering in a first direction (e.g., x) and in a second direction (e.g., y) based on a fractional part (or multiple fractional parts) of a motion vector.

[0145] According to an embodiment, the decoder is configured to select (e.g. apply) different filters (e.g. interpolation filters) for filtering in a first direction and for filtering in a second direction such that a stronger low-pass filter is applied for filtering in a direction where (one or more or all) fractional parts (or multiple fractional parts) of a motion vector are located on a full sample (e.g. if (multiple) half-sample accurate motion vectors point to (multiple) full sample locations) (when compared to filtering applied in a direction where the fractional part (or multiple fractional parts) of a motion vector are located between full samples).

[0146] According to an embodiment, the decoder is configured to take over the filter selection from a neighboring block in merge mode (eg selectively depending on whether the motion vector is the same as the motion vector of the neighboring block).

[0147] According to an embodiment, in the decoder, the selected (eg applied) processing scheme defines (eg spatial) filtering of the luma component and / or (eg spatial) filtering of the chroma components.

[0148] According to an embodiment, the decoder is configured to select (e.g., apply) different processing schemes (e.g., different interpolation filters) for different blocks (e.g., different prediction units PU and / or coding units CU and / or coding tree units CTU) within a video frame or picture (different interpolation filters are used for the same fractional sample positions in different parts of a video sequence or in different parts of a single video frame or "picture").

[0149] According to an embodiment, the one or more syntax elements include at least one of motion vector accuracy (e.g., quarter sample, half sample, full sample), fractional sample position, block size, block shape, number of prediction hypotheses (e.g., one hypothesis for single prediction, two hypotheses for dual prediction), prediction mode (e.g., shifted inter, affine inter, shifted merge, affine merge, combined inter / intra), availability of a coded residual signal (e.g., a coded block flag), spectral properties of the coded residual signal, a reference picture signal (e.g., a reference block defined by motion data, block edges from collocated prediction units PUs within the reference block, high or low frequency characteristics of the reference signal), loop filter data (e.g., edge offset or band offset classification from a sample adaptive offset filter SAO, deblocking filter decision and boundary strength), motion vector length (e.g., enabling additional smoothing filters only for long motion vectors or specific directions), or an adaptive motion vector resolution mode.

[0150] According to an embodiment, the decoder is configured to selectively determine a set of processing schemes (e.g., "multiple possibility coding") for a motion vector accuracy (e.g., sub-sample motion vector accuracy, e.g., HPEL) between a maximum motion vector accuracy (e.g., a sub-sample motion vector resolution better than the previously mentioned motion vector accuracy, e.g., QPEL) and a minimum motion vector accuracy (e.g., 4PEL), or for a motion vector accuracy (e.g., HPEL) between the maximum motion vector accuracy (e.g., QPEL) and the full sample motion vector accuracy (e.g., FPEL), and identify a processing scheme to be applied from the determined set.

[0151] According to an embodiment, the decoder is configured to apply processing schemes (eg interpolation filters) having different characteristics (eg stronger low-pass characteristics versus weaker low-pass characteristics).

[0152] According to an embodiment, the decoder is configured to apply one of a quarter sample motion vector resolution, a half sample motion vector resolution, a full sample motion vector resolution or a four sample motion vector resolution.

[0153] According to an embodiment, in the decoder, the processing scheme comprises one or more FIR filters.

[0154] Another aspect of the present disclosure relates to an encoder for hybrid video coding, the encoder being used to provide an encoded representation of a video sequence based on input video content, the encoder being configured to: determine one or more syntax elements associated with a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based on attributes described by the one or more syntax elements, wherein the processing scheme is completely specified by the attributes of the portion and a fractional part of a motion vector, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and provide a bitstream as an encoded representation of the video sequence, the bitstream comprising the one or more syntax elements.

[0155] According to an embodiment, the properties described by the one or more syntax elements are related to one, two, or all of motion vector accuracy, fractional position of samples (to be obtained by the processing scheme), and prediction mode to be used for the portion.

[0156] According to an embodiment, the portion is a prediction unit (PU) or a coding unit (CU), and wherein the encoder is configured to select the processing scheme separately for different portions of the video sequence.

[0157] According to an embodiment, the encoder is configured to use different processing schemes for the same fractional sample positions in different parts of a video sequence.

[0158] According to an embodiment, the encoder is configured to switch processing schemes at PU or CU level to adapt local image characteristics.

[0159] According to an embodiment, none of the one or more syntax elements is explicitly dedicated to indicating a processing scheme.

[0160] Another aspect of the present disclosure relates to an encoder for hybrid video coding, the encoder being used to provide an encoded representation of a video sequence based on input video content, the encoder being configured to: determine one or more syntax elements associated with a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based on the accuracy of the motion vector described by the one or more syntax elements, wherein the processing scheme is completely specified by the properties of the portion and the fractional part of the motion vector; and provide a bitstream as the encoded representation of the video sequence, the bitstream comprising the one or more syntax elements.

[0161] According to an embodiment, the encoder is configured to select a processing scheme based on the motion vector accuracy and the fractional position of the samples to be obtained by the processing scheme.

[0162] According to an embodiment, the encoder is configured to select the processing scheme additionally depending on the prediction mode to be used for the portion.

[0163] According to an embodiment, the portion is a prediction unit (PU) or a coding unit (CU), and wherein the encoder is configured to select the processing scheme separately for different portions of the video sequence.

[0164] According to an embodiment, the encoder is configured to use different processing schemes for the same fractional sample positions in different parts of a video sequence.

[0165] According to an embodiment, the encoder is configured to switch processing schemes at PU or CU level to adapt local image characteristics.

[0166] According to an embodiment, none of the one or more syntax elements is explicitly dedicated to indicating a processing scheme.

[0167] Another aspect of the present disclosure relates to an encoder for hybrid video coding, the encoder being used to provide an encoded representation of a video sequence based on input video content, the encoder being configured to: determine one or more syntax elements associated with a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based on the accuracy of the motion vector described by the one or more syntax elements at a PU granularity or a CU granularity, wherein the processing scheme is completely specified by properties of the portion and a fractional part of the motion vector; and provide a bitstream as an encoded representation of the video sequence, the bitstream comprising the one or more syntax elements.

[0168] According to an embodiment, the encoder is configured to use different processing schemes for the same fractional sample positions in different parts of a video sequence.

[0169] According to an embodiment, the encoder is configured to switch processing schemes at PU or CU level to adapt local image characteristics.

[0170] According to an embodiment, none of the one or more syntax elements is explicitly dedicated to indicating a processing scheme.

[0171] According to an embodiment, the encoder is configured to determine a set of allowed processing schemes in view of the properties described by the one or more syntax elements, and to select a processing scheme from the determined set.

[0172] According to an embodiment, in the encoder, the processing scheme is a filter (eg, an interpolation filter) or a set of filters (eg, a plurality of interpolation filters) (eg, parameterized by a fractional part of a motion vector).

[0173] According to an embodiment, in an encoder, filters in a set of filters may be separately applied (eg, one-dimensional filters sequentially applicable in spatial directions, such as x-direction and / or y-direction) to parts of a video sequence.

[0174] According to an embodiment, the encoder is configured to select different processing schemes (e.g., different interpolation filters) for different blocks (e.g., different prediction units PU and / or coding units CU and / or coding tree units CTU) within a video frame or picture (different interpolation filters are used for the same fractional sample positions in different parts of a video sequence or in different parts of a single video frame or "picture").

[0175] According to an embodiment, in the encoder, the one or more syntax elements include at least one of motion vector accuracy (e.g., quarter sample, half sample, full sample), fractional sample position, block size, block shape, number of prediction hypotheses (e.g., one hypothesis for single prediction, two hypotheses for dual prediction), prediction mode (e.g., shifted inter, affine inter, shifted merge, affine merge, combined inter / intra), availability of a coded residual signal (e.g., a coded block flag), spectral properties of the coded residual signal, a reference picture signal (e.g., a reference block defined by motion data, block edges from collocated prediction units PUs within the reference block, high or low frequency characteristics of the reference signal), loop filter data (e.g., edge offset or band offset classification from a sample adaptive offset filter SAO, deblocking filter decision and boundary strength), motion vector length (e.g., enabling additional smoothing filters only for long motion vectors or specific directions), or an adaptive motion vector resolution mode.

[0176] According to an embodiment, the encoder is configured to selectively determine a set of processing schemes (e.g., "multiple possibility encoding") for a motion vector accuracy (e.g., sub-sample motion vector accuracy, e.g., HPEL) between a maximum motion vector accuracy (e.g., a sub-sample motion vector resolution better than the previously mentioned motion vector accuracy, e.g., QPEL) and a minimum motion vector accuracy (e.g., 4PEL), or for a motion vector accuracy (e.g., HPEL) between the maximum motion vector accuracy (e.g., QPEL) and the full sample motion vector accuracy (e.g., FPEL), and select a processing scheme from the determined set.

[0177] Another aspect of the present disclosure relates to a method for hybrid video decoding, which is used to provide output video content based on an encoded representation of a video sequence, the method comprising: obtaining a bitstream as an encoded representation of the video sequence; identifying one or more syntax elements related to a portion of the video sequence from the bitstream; selecting a processing scheme for the portion of the video sequence based on the one or more syntax elements, wherein the processing scheme is completely specified by attributes of the portion and a fractional part of a motion vector; the processing scheme is used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and applying the identified processing scheme to the portion of the video sequence.

[0178] According to an embodiment, the encoder is configured to select among a quarter sample motion vector resolution, a half sample motion vector resolution, a full sample motion vector resolution, and a four sample motion vector resolution.

[0179] According to an embodiment, in the encoder, the processing scheme comprises one or more FIR filters. FIR filters are particularly stable filters for processing video sequences.

[0180] Another aspect of the present disclosure relates to a method for hybrid video decoding, the method for providing output video content based on an encoded representation of a video sequence, the method comprising: obtaining a bitstream as an encoded representation of the video sequence; identifying one or more syntax elements related to a portion of the video sequence from the bitstream; selecting a processing scheme for the portion of the video sequence based on a motion vector accuracy, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and applying the identified processing scheme to the portion of the video sequence.

[0181] Another aspect of the present disclosure relates to a method for hybrid video decoding, which is used to provide output video content based on an encoded representation of a video sequence, the method comprising: obtaining a bitstream as an encoded representation of the video sequence; identifying one or more syntax elements related to a portion of the video sequence from the bitstream; determining a processing scheme for the portion of the video sequence at a PU granularity or a CU granularity and based on the one or more syntax elements, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and applying the identified processing scheme to the portion of the video sequence.

[0182] Another aspect of the present disclosure relates to a method for hybrid video coding, which is used to provide an encoded representation of a video sequence based on input video content, the method comprising: determining one or more syntax elements associated with a portion of the video sequence; selecting a processing scheme to be applied to the portion of the video sequence based on attributes described by the one or more syntax elements, wherein the processing scheme is completely specified by the attributes of the portion and a fractional part of a motion vector, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and providing a bitstream as an encoded representation of the video sequence, the bitstream comprising the one or more syntax elements.

[0183] Another aspect of the present disclosure relates to a method for hybrid video coding, the method for providing an encoded representation of a video sequence based on input video content, the method comprising: determining one or more syntax elements associated with a portion of the video sequence; selecting a processing scheme to be applied to the portion of the video sequence based on a motion vector accuracy described by the one or more syntax elements, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and providing a bitstream as the encoded representation of the video sequence, the bitstream comprising the one or more syntax elements.

[0184] Another aspect of the present disclosure relates to a method for hybrid video coding, which is used to provide an encoded representation of a video sequence based on input video content, the method comprising: determining one or more syntax elements related to a portion of the video sequence; selecting a processing scheme to be applied to the portion of the video sequence based on properties described by the one or more syntax elements at a PU granularity or a CU granularity, the processing scheme being used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion of the video sequence; and providing a bitstream as an encoded representation of the video sequence, the bitstream comprising the one or more syntax elements.

[0185] Another aspect of the disclosure relates to a computer program for performing any described method for hybrid video coding when the computer program is run on a computer.

[0186] The described decoder provides functions and advantages similar to those described with respect to the encoder, and vice versa, in the sense that the functions and advantages of the encoder related to features of the encoder are equivalently applicable to the corresponding features of the decoder, wherein decoding replaces encoding, and vice versa. For example, if the features of the encoder enable information to be encoded in a bitstream of particularly small size or efficiently encoded, the corresponding features of the decoder may enable information to be derived from a bitstream of small size or efficiently decoded. In other words, any features, functions and details disclosed herein with respect to the encoder may be selectively included in the decoder alone or in combination, and vice versa.

[0187] The described method for hybrid video coding relies on the same ideas as the above-mentioned encoders and decoders, thereby providing the same or equivalent functions and advantages. The method can optionally be combined with (or supplemented with) any of the features, functions and details described herein with respect to the corresponding encoders and decoders. The method for hybrid video coding can optionally be combined with the above-mentioned features, functions and details alone or in any combination thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0188] Embodiments of the present disclosure are described herein with reference to the accompanying drawings and figures.

[0189] Figure 1 shows a schematic representation of an encoder that can implement the disclosed concepts,

[0190] Figure 2 shows a schematic representation of a decoder that can implement the disclosed concepts,

[0191] Figure 3 shows signals used by an encoder or decoder according to an embodiment,

[0192] Figure 4 shows fractional sample positions that may be used in motion compensated prediction according to an embodiment,

[0193] Figure 5 An encoder according to an embodiment is shown,

[0194] Figure 6 An encoder according to another embodiment is shown,

[0195] Figure 7 A decoder according to an embodiment is shown,

[0196] Figure 8 A decoder according to another embodiment is shown,

[0197] Fig. 9 A flowchart showing a method for hybrid video coding according to an embodiment is shown,

[0198] Fig.10 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0199] Fig.11 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0200] Fig.12 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0201] Fig.13 An encoder according to another embodiment is shown,

[0202] Fig.14 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0203] Fig.15 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0204] Fig.16 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0205] Fig.17 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0206] Fig.18 A flowchart showing a method for hybrid video coding according to another embodiment is shown,

[0207] Fig.19 A flowchart of a method for hybrid video coding according to another embodiment is shown. DETAILED DESCRIPTION

[0208] In the following, different inventive embodiments and aspects will be described.

[0209] And, further embodiments are defined by the dependent claims.

[0210] It should be noted that any embodiment defined by the claims may be supplemented by any of the details (features and functions) described herein.

[0211] Furthermore, the embodiments described herein can be used alone or can also be supplemented by any features included in the claims.

[0212] In addition, it should be noted that the various aspects described herein can be used alone or in combination. Therefore, details can be added to each of the various aspects without adding details to another of the multiple aspects.

[0213] It should also be noted that the present disclosure explicitly or implicitly describes features that can be used in a video encoder (a device for providing an encoded representation of an input video signal) and a video decoder (a device for providing a decoded representation of a video signal based on the encoded representation). Thus, any feature described herein can be used in the context of a video encoder and in the context of a video decoder.

[0214] In addition, the features and functions disclosed herein in relation to the methods may also be used in a device (configured to perform such functions). In addition, any features and functions disclosed herein with respect to a device may also be used in a corresponding method. In other words, the methods disclosed herein may be supplemented by any features and functions described with respect to a device.

[0215] Furthermore, as will be described in the "Implementation Alternatives" section, any features and functions described herein may be implemented in hardware or software, or may be implemented using a combination of hardware and software.

[0216] Furthermore, any features and syntax elements described herein may be selectively introduced into a video bitstream, both individually and in combination.

[0217] In the following description, embodiments are discussed in detail, but it should be understood that embodiments provide many applicable concepts that can be embedded in a wide variety of video encoders and video decoders. The specific embodiments discussed are only illustrations of specific ways of implementing and using the present concept, and do not limit the scope of the embodiments. In the following description of the embodiments, the same or similar components or elements with the same functions are provided with the same reference numerals or identified by the same name, and the repeated description of the elements provided with the same reference numerals or identified by the same name will usually be omitted. Therefore, the descriptions provided for the elements with the same or similar reference numerals or identified by the same name can be interchanged or can be applied to each other in different embodiments. In the following description, many details are set forth to provide a more thorough explanation of the embodiments of the present disclosure. However, it will be apparent to those skilled in the art that other embodiments can be implemented without these specific details. In other examples, well-known structures and devices are shown in block diagram form rather than in detail to avoid confusing the examples described herein. In addition, unless otherwise specifically stated, the features of the different embodiments described herein can be combined with each other.

[0218] 1. Example of codec framework

[0219] The following description of the drawings starts with the presentation of a description of an encoder and a decoder of a block-based prediction codec for encoding and decoding multiple pictures of a video, forming an example of a codec framework within which embodiments of the present invention may be built. Figures 1 to 3 The following describes the embodiments of the concepts of the present invention and describes how to respectively establish these concepts into Figure 1 and Figure 2 encoder and decoder, but with the subsequent Figure 4 The embodiments described below can also be used to form Figure 1 and 2The encoder and decoder construct the codec framework to operate the encoder and decoder.

[0220] Figure 1 An apparatus is shown for predictively encoding a picture 12 into a data stream 14, exemplarily using transform-based residual coding. The apparatus or encoder is indicated with reference numeral 10. Figure 2 A corresponding decoder 20 is shown, i.e. a device 20 configured to predictively decode a picture 12' from a data stream 14 also using transform-based residual decoding, wherein a prime sign has been used to indicate that the picture 12' reconstructed by the decoder 20 deviates from the picture 12 originally encoded by the device 10 with respect to coding losses introduced by quantization of the prediction residual signal. Figure 1 and Figure 2 Transform-based prediction residual coding is used illustratively, but the embodiments of the present application are not limited to such prediction residual coding. Figure 1 and Figure 2 The same is true for the other details described.

[0221] The encoder 10 is configured to subject the prediction residual signal to a spatial to spectral transform and to encode the prediction residual signal thus obtained to a data stream 14. Similarly, the decoder 20 is configured to decode the prediction residual signal from the data stream and to subject the prediction residual signal thus obtained to a spectral to spatial transform.

[0222] Internally, the encoder 10 may include a prediction residual signal former 22, which generates a prediction residual 24 in order to measure the deviation of the prediction signal 26 from the original signal, such as a picture. The prediction residual signal former 22 can be, for example, a subtractor, which subtracts the prediction signal from the original signal, i.e. from the picture 12. The encoder 10 then also includes a transformer 28, which subjects the prediction residual signal 24 to a spatial to spectral transformation in order to obtain a spectral domain prediction residual signal 24', which is then also quantized by a quantizer 32 included in the encoder 10. The quantized prediction residual signal 24" is encoded into the bitstream 14. To this end, the encoder 10 may optionally include an entropy encoder 34, which entropy encodes the transformed and quantized prediction residual signal into the data stream 14. Based on the prediction residual signal 24" encoded into the data stream 14 and decodable from the data stream 14, the prediction stage 36 of the encoder 10 generates the prediction signal 26. To this end, as Figure 1As shown, the prediction stage 36 may internally include a dequantizer 38, which dequantizes the prediction residual signal 24" to obtain a spectral domain prediction residual signal 24"', which corresponds to the signal 24' except for the quantization loss, and then passes through an inverse transformer 40, so that the latter prediction residual signal 24"' is subjected to an inverse transformation, i.e., a spectrum to spatial transformation, to obtain a prediction residual signal 24", the prediction residual signal 24"" corresponding to the original prediction residual signal 24 (except for the quantization loss). Then, the combiner 42 of the prediction stage 36 recombines the prediction signal 26 with the prediction residual signal 24"", for example by addition, to obtain a reconstructed signal 46, i.e., a reconstruction of the original signal 12. The reconstructed signal 46 may correspond to the signal 12'. Then, the prediction module 44 of the prediction stage 36 generates the prediction signal 26 based on the signal 46 by using, for example, spatial prediction, i.e., intra-picture prediction, and / or temporal prediction, i.e., inter-picture prediction.

[0223] Likewise, Figure 2 As shown, the decoder 20 can be internally composed of components corresponding to the prediction stage 36, and connected to each other in a manner corresponding to the prediction stage 36. In particular, the entropy decoder 50 of the decoder 20 can entropy decode the quantized spectral domain prediction residual signal 24" from the data stream, and then the dequantizer 52, the inverse transformer 54, the combiner 56 and the prediction module 58 connected and cooperating with each other in the manner of the modules of the prediction stage 36 described above can restore the reconstructed signal based on the prediction residual signal 24", so that Figure 2 As shown, the output of combiner 56 produces the reconstructed signal, picture 12'.

[0224] Although not specifically described above, it is easy to understand that according to some optimization schemes, for example, in a manner to optimize some rate and distortion related criteria (i.e., coding cost), the encoder 10 can set some coding parameters, including, for example, prediction modes, motion parameters, etc. For example, the encoder 10 and the decoder 20 and the corresponding modules 44 and 58 can support different prediction modes, such as intra-frame coding mode and inter-frame coding mode. The granularity at which the encoder and the decoder switch between these prediction mode types can correspond to the subdivision of the pictures 12 and 12' into coding segments or coding blocks, respectively. For example, in units of these coding segments, the pictures can be subdivided into intra-frame coded blocks and inter-frame coded blocks. The intra-frame coded blocks are predicted based on the spatial, already encoded / decoded neighborhood of the corresponding blocks, as outlined in more detail below. Several intra coding modes may be present and selected for respective intra coding segments, the intra coding modes comprising directional or angular intra coding modes, according to which the respective segments are filled into the respective intra coding segments by extrapolating sample values ​​of a neighbourhood along a certain direction, which is specified for the respective directional intra coding mode. The intra coding modes may also for example comprise one or more other modes, such as a DC coding mode, according to which the prediction of the respective intra coding block assigns a DC value to all samples within the respective intra coding segment, and / or a plane intra coding mode, according to which the prediction of the respective block is approximated or determined as a spatial distribution of sample values ​​described by a two-dimensional linear function at the sample positions of the respective intra coding block, with a driving tilt and offset based on the plane defined by the two-dimensional linear function of neighbouring samples. In contrast, inter coding blocks may for example be predicted temporally. For an inter-coded block, a motion vector may be signaled in the data stream, which indicates a spatial displacement of a portion of a previously coded picture 12 of the video to which the picture 12 belongs, at which the previously coded / decoded picture was sampled to obtain a prediction signal for the corresponding inter-coded block. This means that, in addition to the residual signal encoding comprised by the data stream 14, such as the entropy coded transform coefficient levels representing the quantized spectral domain prediction residual signal 24″, the data stream 14 may have encoded therein coding mode parameters for assigning coding modes to various blocks, prediction parameters for certain blocks, such as motion parameters for inter-coded segments, and optionally other parameters, such as parameters for controlling and signaling the subdivision of the pictures 12 and 12′ into segments, respectively. The decoder 20 uses these parameters to subdivide the pictures in the same way as the encoder, assign the same prediction modes to the segments, and perform the same predictions to produce the same prediction signals.

[0225] Figure 3The relationship between the reconstruction signal, ie the reconstructed picture 12', on the one hand, and the combination of the prediction residual signal 24"" signaled in the data stream 14 and the prediction signal 26 on the other hand is shown. As mentioned above, the combination may be an addition. The prediction signal 26 is Figure 3 12 is shown as subdividing the picture area into intra-frame coding blocks and inter-frame coding blocks, where the intra-frame coding blocks are schematically indicated by shading and the inter-frame coding blocks are schematically indicated by non-shading. The subdivision can be any subdivision, such as subdividing the picture area into columns and rows of square blocks or non-square blocks regularly, or performing multi-tree subdivision of the picture 12 into multiple leaf blocks of various sizes from the tree root block, such as quadtree subdivision, etc., where Figure 3 A mixture of these is shown, where the picture region is first subdivided into columns and rows of tree root blocks and then further subdivided into one or more leaf blocks according to the regressive multi-tree subdivision. For example, the picture 12, 12' may be subdivided into coding blocks 80, 82, which may represent coding tree blocks, for example, and may be further subdivided into smaller coding blocks 83.

[0226] Again, the data stream 14 may have an intra-coding mode encoded therein for an intra-coded block 80, which assigns one of several supported intra-coding modes to the corresponding intra-coded block 80. For an inter-coded block 82, the data stream 14 may have one or more motion parameters encoded therein. In general, the inter-coded block 82 is not limited to temporal coding. Alternatively, the inter-coded block 82 may be any block predicted from a previously coded portion other than the current picture 12 itself, such as a previously coded picture of the video to which the picture 12 belongs, or a picture of another view or hierarchically lower layer when the encoder and decoder are scalable encoders and decoders, respectively.

[0227] Figure 3 The prediction residual signal 24″″ in is also shown as a subdivision of the picture area into blocks 84. These blocks can be called transform blocks to distinguish them from the coding blocks 80 and 82. In practice, Figure 3 It is shown that the encoder 10 and the decoder 20 can use two different subdivisions of the picture 12 and the picture 12' into a plurality of blocks, namely one subdivision into coding blocks 80 and 82, respectively, and another subdivision into transform blocks 84. The two subdivisions may be identical, i.e. each coding block 80 and 82 may simultaneously form a transform block 84, but Figure 3A case is shown where, for example, the subdivision into transform blocks 84 forms an extension of the subdivision into coding blocks 80, 82, such that any boundary between two blocks of blocks 80 and 82 overlaps a boundary between two blocks 84, or in other words, each block 80, 82 coincides with one of the transform blocks 84, or with a cluster of transform blocks 84. However, the subdivision can also be determined or selected independently of one another, such that the transform block 84 can alternatively cross a block boundary between blocks 80, 82. As far as the subdivision into transform blocks is concerned, statements similar to those mentioned in relation to the subdivision into blocks 80, 82 are correct, i.e. the block 84 can be the result of a regular subdivision of a picture region into a plurality of blocks (with or without arrangement into columns and rows), a recursive multi-tree subdivision of a picture region, or a combination thereof or any other kind of blockification. Incidentally, it should be noted that the blocks 80, 82 and 84 are not limited to square, rectangular or any other shape.

[0228] Figure 3 It is further shown that the combination of the prediction signal 26 and the prediction residual signal 24"" directly produces the reconstructed signal 12'. However, it should be noted that according to alternative embodiments more than one prediction signal 26 may be combined with the prediction residual signal 24"" to produce the picture 12'.

[0229] As already outlined above, Figures 1 to 3 As an example, the inventive concepts described further below may be implemented to form specific examples of encoders and decoders according to the present application. In this regard, Figure 1 and Figure 2 The encoder and decoder of can represent the possible implementation of the encoder and decoder described in the following article respectively. However, Figure 1 and Figure 2 This is merely an example. However, an encoder according to an embodiment of the present application may perform block-based encoding of the picture 12 using the concepts outlined in more detail below. Likewise, a decoder according to an embodiment of the present application may perform block-based decoding of the picture 12' from the data stream 14 using the decoding concepts outlined further below, but for example may be used in conjunction with Figure 2 The decoder 20 is different in that: Figure 3 The described approach subdivides the picture 12 ′ into a plurality of blocks in a different manner and / or in that the prediction residual is derived from the data stream not in the transform domain, but for example in the spatial domain.

[0230] 2. According to Figure 4 Sample score

[0231] Embodiments of the present disclosure may be part of the concept of motion compensated prediction, which may be an example of inter prediction, as it may be applied by the prediction modules 44, 58. MCP may be performed with fractional sample accuracy. For example, a sample may refer to a pixel or position of a picture or video sequence, where a full sample position may refer to a plurality of positions signaled in a picture or video sequence, and fractional sample positions may refer to positions between full sample positions.

[0232] Figure 4 Integer samples 401 (shaded blocks with uppercase letters) and fractional sample positions 411 (non-shaded blocks with lowercase letters) for quarter-sample luma interpolation are shown. Figure 4 The samples shown may form or may be part of a video sequence 400. In addition, non-shaded blocks with lower case letters indicate fractional sample positions 411 of a quarter sample resolution. For example, the portion 400 may represent or may be part of a luma coding block. Thus, Figure 4 A scheme for quarter sample luma interpolation may be represented. However, a luma coding block is only one example of a coding block that may be used in the context of MCP. MCP may also be performed using samples of a video sequence or chroma samples using other schemes of color planes, such as three color planes. For example, fractional sample positions 411 with quarter sample resolution include half sample positions 415 and quarter sample positions 417.

[0233] The fractional sample positions 411 may be obtained from the full samples 401 by interpolation filtering. Different schemes for interpolation filtering may be possible. A scheme for interpolation filtering may provide a set of interpolation filters, each of which represents a rule for obtaining one or more specific fractional sample positions.

[0234] As an example of interpolation filtering, Figure 4 A scheme used in HEVC for obtaining 15 fractional luma sample positions, eg, non-shadow fractional sample positions in block 412, is described. The HEVC scheme for interpolation filtering utilizes the FIR filters listed in Table 1.

[0235] 2.1 Interpolation Filtering in HEVC

[0236] In HEVC, which uses motion vector accuracy of quarter luma samples, there are 15 fractional luma sample positions calculated using various one-dimensional FIR filters (e.g., Figure 4 ). However, for each fractional sample position, the interpolation filter is fixed.

[0237] filter coefficient HEVC (8-tap) h[i]=[-14-114040-114-1]i=-3…4 HEVC (7-tap) q[i]=[-14-105817-51]i=-3…3

[0238] Table 1

[0239] The scheme consists of a symmetric 8-tap filter h[i] for half sample (HPEL) positions: by filtering the integer sample positions A horizontally -3,0 To A 4,0 To calculate the position b 0,0 , by filtering the integer sample positions A vertically 0,-3 To A 0,4 To calculate the position h 0,0 , and using the same 8-tap filter by first calculating the HPEL position b by horizontal filtering as described above 0,-3 To b 0,4 These are then vertically filtered to calculate the position j 0,0 :

[0240] b 0,0 =∑ i=-3..4 A i,0 h[i],h 0,0 =∑ j =-3..4A 0,j h[j],j 0,0 =∑ j =-3..4b 0,j h[j]

[0241] An asymmetric 7-tap filter with coefficients q[i] for quarter sample (QPEL) positions: Again here, positions with only one fractional sample component are computed by one-dimensional filtering at the nearest integer sample position in the vertical or horizontal direction:

[0242] a 0,0 =∑ i=-3..3 A i,0 q[i],c 0,0 =∑ i=-2..4 A i,0 q[1-i]

[0243] d 0,0 =∑ j=-3..3 A 0,j q[j],n 0,0 =∑ j=-2..4 A 0,j q[1-j]

[0244] All other QPEL positions are calculated by vertical filtering of the nearest fractional sample position. For positions with vertical HPEL components, an HPEL 8-tap filter is used:

[0245] j 0,0 =∑ j=-3..4 a 0,j h[j] or i0,0 =∑ j=-3..4 a 0,j h[j],k 0,0 =∑ j =-3..4c 0,j h[j]

[0246] For locations with vertical QPEL components, a QPEL 7-tap filter is used:

[0247] e 0,0 =∑ j =-3..4a 0,j h[j],f 0,0 =∑ j =-3..4b 0,j h[j],g 0,0 =∑ j=-3..4 c 0,j h[j]

[0248] p 0,0 =∑ j=-2..4 a 0,j q[1-j],q 0,0 =∑ j=-2..4 b 0,j q[1-j],r 0,0 =∑ j=-2..4 c 0,j q[1-j]

[0249] This approach can be applied to obtain Figure 4 Score sample locations shown.

[0250] 3. According to Figure 5 , Figure 6 and Fig.13 Encoder

[0251] Figure 5An encoder 500 for hybrid video coding according to an embodiment is shown. The encoder 500 is configured to provide an encoded representation 514 of a video sequence based on an input video content 512. The encoder 500 is configured to determine one or more syntax elements 520 associated with a portion 585 of the video sequence, for example by a syntax determination module 521. In addition, the encoder 500 is configured to select a processing scheme 540 to be applied to the portion 585 of the video sequence based on the properties described by the one or more syntax elements 520. For example, the encoder includes a processing scheme selector 541 for selecting the processing scheme 540. The processing scheme 540 is used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion 585 of the video sequence, such as samples 401, 411, 415, 417. The encoder is configured to encode an index 550, for example by an index encoder 561, wherein the index 550 indicates the selected processing scheme 540, so that a given encoded index value represents a different processing scheme according to the properties described by the one or more syntax elements 520. Furthermore, the encoder 500 is configured to provide a bitstream including one or more syntax elements 520 and encoded indices 560 as an encoded representation 514 of the video sequence. For example, the encoder 500 comprises an encoder module 590, such as an entropy encoder, for providing the encoded representation 514. The index encoder 561 may be part of the encoder module 590 or may be separate.

[0252] Figure 6 An encoder 600 for hybrid video coding according to another embodiment is shown. The encoder 600 is configured to provide an encoded representation 614 of a video sequence based on input video content 512. The encoder 600 is configured to determine one or more syntax elements 520 associated with a portion 585 of the video sequence, for example by a syntax determination module 521. In addition, the encoder 600 is configured to select a processing scheme 540 to be applied to the portion 585 of the video sequence based on the properties described by the one or more syntax elements 520. For example, the encoder 600 includes a processing scheme selector 541 for selecting the processing scheme 540. The processing scheme 540 is used to obtain samples for motion compensated prediction at integer and / or fractional positions within the portion 585 of the video sequence, such as samples 401, 411, 415, 417. The encoder 600 is configured to select an entropy coding scheme 662 based on the properties described by the one or more syntax elements 520, the entropy coding scheme 662 being used to provide an encoded index 660, the encoded index 660 indicating the selected processing scheme 540. Furthermore, the encoder 600 is configured to provide a bitstream comprising one or more syntax elements 520 and comprising an encoded index 560 as the encoded representation 514 of the video sequence. The encoded index value may represent the value of the encoded index 660.

[0253] Fig.13 An encoder 1300 for hybrid video coding according to a further embodiment is shown. The encoder 1300 is configured for providing an encoded representation 1314 of a video sequence based on input video content 512. The encoder 1300 is configured to determine one or more syntax elements 520 relating to a portion 585 of a video sequence.

[0254] According to an embodiment, the encoder 1300 is configured to select a processing scheme 540 to be applied to a portion 585 of a video sequence based on properties described by one or more syntax elements 520, wherein the processing scheme 540 is completely specified by the properties of the portion 585 and the fractional part of the motion vector, wherein the processing scheme 540 is used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion (585) of the video sequence.

[0255] According to an alternative embodiment, the encoder 1300 is configured to select a processing scheme to be applied to the portion 585 of the video sequence based on the accuracy of the motion vectors described by one or more syntax elements 520 .

[0256] According to another alternative embodiment, the encoder 1300 is configured to select the processing scheme 540 to be applied to the portion 785 of the video sequence based on the properties described by one or more syntax elements 520 at a PU granularity or a CU granularity.

[0257] Furthermore, the encoder 1300 is configured to provide a bitstream comprising one or more syntax elements 520 as an encoded representation 1314 of the video sequence.

[0258] According to an embodiment, the encoder 1300 is configured to select another processing scheme that is not the standard processing scheme for the HPEL position of the sample to be obtained if the determined one or more syntax elements 520 indicate the MV accuracy of the HEPL, and if the prediction mode is one of shifted inter, shifted merge, and combined inter / intra.

[0259] Unless otherwise stated, the following description applies equally to Figure 5 The encoder 500, according to Figure 6 The encoder 600 and the Fig.13 Encoder 1300.

[0260] For example, the encoder 500, 600, 1300 receives a video sequence as input video content and provides an encoded representation 514, 614, 1314 of the video sequence, which may include a plurality of video frames. The syntax determination module 521 may obtain a portion 585 of the video sequence, for example by segmenting the video sequence or its video frames, or by obtaining the portion 585 from a module for segmenting the video sequence. The portion 585 may be a result of a segmentation of the video sequence into, for example, coding tree units or coding units or coding tree blocks or coding blocks, as described with respect to Figure 3 For example, section 585 may be derived from Figure 1 or Figure 2 The syntax determination module 521 may further determine one or more syntax elements 520 based on the portion 585 and optionally based on other portions of the video sequence.

[0261] The encoder 500, 600, 1300 optionally includes a processing module 544 for applying the processing scheme 540 to the portion 585 to obtain a prediction signal indicated by the dashed arrow. For example, the prediction signal can be used to obtain an encoded representation 514, 614, 1314 of the video sequence. For example, the prediction signal can be used to obtain an encoded representation 514, 614, 1314 of the video sequence. Figure 1 The encoding of the input video content 512 into the encoded representation 514, 614, 1314 may be performed using the scheme described for the encoder 10 in the description, wherein the picture 12 may represent the video content 512 and the bitstream 14 may include the encoded representation 514, 614, 1314. For example, the processing module 544 may include the prediction module 44 or may correspond to the prediction module 44, so that the processing scheme 540 may represent an input for the prediction module 44, and the prediction module 44 may use the processing scheme 540 for MCP to provide a prediction signal, for example using the AMVR described in the introductory part of the specification.

[0262] According to an embodiment, the processing scheme 540 is a filter or a set of filters. For example, one or more filters may be FIR filters, such as interpolation filters.

[0263] For example, the processing scheme 540 may be an interpolation filter, such as an 8-tap filter and a 7-tap filter described in Section 2.1, or a similar interpolation filter, which may be used to obtain fractional sample positions, such as for MCP. In various embodiments of the present invention, two additional 1D 6-tap low-pass FIR filters may be supported, which may be applied instead of the HEVC 8-tap filter (coefficients h[i] as described in Table 2). In the following, an interpolation filter may be used as an example of a processing scheme.

[0264] For example, the processing scheme 540 may have a spectral characteristic, such as a low-pass or high-pass characteristic, such that the encoder 500, 600, 1300 may be configured to select between processing schemes having different characteristics.

[0265] According to an embodiment, the encoder 500, 600 is configured to select different processing schemes for different blocks within a video frame or picture.

[0266] For example, by the encoder 500, 600, 1300, a video frame of a video sequence may be segmented into a plurality of blocks or portions, e.g. Figure 3 80, 82, 83 in the video frame. For example, the encoder 500, 600, 1300 may obtain a prediction signal 26 for each of the portions 80, 82, 83. The encoder 500, 600, 1300 may select the processing scheme 540 separately for different portions of the video frame. In this context, a portion or block of a video frame may refer to a regularly sized block or first-level block resulting from a first regression of a segmentation of the video frame, such as a coding tree block or coding tree unit, such as coding block 80 or 82. And, the encoder 500, 600, 1300 may select different processing schemes for different sub-portions of such a portion or first-level block or coding tree unit, such as coding block 83. The encoder 500, 600, 1300 may even select different processing schemes for different portions or blocks of a coding block or coding unit.

[0267] Thus, the encoders 500, 600, 1300 may adapt the interpolation filters at a fine granularity of a picture or video frame of a video sequence, allowing adaptation to local characteristics within a slice, tile or picture, i.e. at a granularity smaller than the size of a slice or tile or picture.

[0268] Thus, the encoder 500, 600, 1300 may determine information about the size or shape of the portion 585, such as a block size or a block shape, and provide this information as one or more syntax elements 520. Also, the encoder 500, 600, 1300 may determine or obtain other parameters that may be used in the context of an intra-picture or inter-picture prediction model. For example, the encoder 500, 600, 1300 may determine, for example, by a processing module 544 for obtaining a prediction signal to be applied to the portion 585 for encoding the portion 585.

[0269] Thus, the one or more syntax elements 520 may include at least one of motion vector accuracy, fractional sample positions, block size, block shape, number of prediction hypotheses, prediction mode, availability of an encoded residual signal, spectral properties of the encoded residual signal, reference picture signal, loop filter data, motion vector length, or an adaptive motion vector resolution mode.

[0270] For example, the encoder 500, 600, 1300 may derive a processing scheme 540 from already determined properties or processing steps, which may be indicated by one or more syntax elements 520. For example, in the case of a merge mode of HEVC or VVC, the interpolation filters used may be inherited from the selected merge candidate. In another embodiment, it may be possible to override the interpolation filters inherited from the merge candidate by explicit signaling.

[0271] According to an embodiment, the encoder 500, 600, 1300 is configured to determine a set of permissible processing schemes according to the properties described by the one or more syntax elements, and to select the processing scheme 540 from the determined set. For example, the processing scheme selector 541 may infer from the one or more syntax elements 520 which processing schemes of the entities of the processing schemes are compatible with the portion 585 or may be beneficially applied to the portion 585 in order to obtain an efficient encoding of the video sequence or in particular the portion 585.

[0272] In other words, according to one or more attributes of the part 585 indicated by one or more syntax elements 520, one or more processing schemes are available, allowable or selectable for the part 585. Therefore, for part 585, only one processing scheme can be allowable. In this case, the encoder 500, 600 can select the only allowable processing scheme as the processing scheme 540. Since the processing scheme can be uniquely identified from one or more syntax elements 520 in this case, the encoder 500, 600 can skip providing the encoded index 550, 560 in the coding representation 514, 614 to avoid redundant information and signaling overhead in the bit stream. In the case where more than one processing scheme is allowable for part 585, the encoder can determine the allowable multiple processing schemes as the set of processing schemes allowed for part 585, and can select the processing scheme 540 from the set of the processing schemes. In the latter case, the encoder 500, 600 can encode the encoded index 560, 660 in the coding representation 514, 614 for indicating the selected processing scheme 540. The embodiment described in Section 6 may be an example of such an embodiment.

[0273] Thus, in some cases, the processing scheme or interpolation filter may be adapted to different parts of the video frame without explicitly signaling the applied processing scheme or interpolation filter.Therefore, no additional bits may be required in the bitstream comprising the encoded representation 514,516.

[0274] According to an embodiment that may correspond to encoder 1300, the processing scheme is uniquely determined in all cases based on the properties described by the one or more syntax elements, so that no explicit indication of the processing scheme 540 is required in the encoded representation 1314, which has an encoded index dedicated to the processing scheme 540. Therefore, according to an embodiment, encoder 1300 may not need to determine whether to encode the encoded index, or may not need to select a coding scheme.

[0275] According to an embodiment, the encoder 500, 600, 1300 is configured to determine the available set of processing schemes according to the motion vector accuracy. For example, the available (or allowable) set of interpolation filters can be determined by the motion vector accuracy selected for the block (signaled using a dedicated syntax element).

[0276] For example, one or more syntax elements 520 may indicate the MV accuracy selected for portion 585, such as by using the scheme for signaling MV accuracy described in Section 6.1.2 with respect to Table 3.

[0277] According to an embodiment, the encoder 500, 600, 1300 is configured to select between a quarter sample motion vector resolution, a half sample motion vector resolution, a full sample motion vector resolution, and a four sample motion vector resolution.

[0278] According to an embodiment, the encoder 500, 600, 1300 is configured to selectively determine a set of processing schemes for a motion vector accuracy between a maximum motion vector accuracy and a minimum motion vector accuracy or for a motion vector accuracy between a maximum motion vector accuracy and a full sample motion vector accuracy, and to select the processing scheme 540 from the determined set.

[0279] For example, in one embodiment, for half luma sample accuracy, multiple sets of interpolation filters may be supported, while for all other possible motion vector accuracies, a default set of interpolation filters may be used.

[0280] According to one embodiment of the encoder 500, 600, in case the AMVR mode indicates HPEL accuracy (amvr mode = 2), the interpolation filter may be explicitly signaled by one syntax element (if_idx) per CU:

[0281] - if_idx is equal to 0, it indicates that the filter coefficients h[i] of the HEVC interpolation filter are used to generate the HPEL position;

[0282] - if_idx is equal to 1, it indicates that the filter coefficients h[i] (see table below) of the flat-top filter are used to generate the HPEL position;

[0283] - if_idx is equal to 2, it indicates that the filter coefficients h[i] (see table below) of the Gaussian filter are used to generate the HPEL position;

[0284] -When the CU is encoded in merge mode and the merge candidate is generated by copying the motion vector(s) from the neighboring block without modifying the motion vector(s), the index if_idx is also copied. If if_idx is greater than 0, the HPEL position is filtered using one of the two non-HEVC filters (flat top or Gaussian).

[0285] filter MV resolution Coefficient h[i] if_idx Binarization HEVC (8-tap) HPEL [-14-114040-114-1] 0 0 Flat Top (6-Tap) HPEL [-3431314-3] 1 10 Gaussian (6-tap) HPEL [39202093] 2 11

[0286] Table 2

[0287] To obtain the encoded index 560, 660, the encoder 500, 600 may apply a mapping rule that maps the index 550 or the index indicating the selected processing scheme 540 to the encoded index 560, 660. For example, the mapping rule may correspond to a binarization scheme. The encoder 500, 600 may adapt the encoded index 560, 660 according to the number of allowed processing schemes so that the encoded index 560, 660 requires a small number of bits.

[0288] For example, the encoder 500, 600 may select a processing scheme based on the motion vector accuracy and / or the fractional sample position or fractional part of the motion vector, and select the mapping rule accordingly.

[0289] The encoder 500 , 600 may further adapt the number of binary codes used to provide the encoded index 560 , 660 according to the properties described by the one or more syntax elements 520 , for example by adapting a mapping rule.

[0290] Therefore, the encoder 500, 600 may select a mapping rule for mapping index values ​​to encoded index values ​​such that the number of binary codes representing the encoded index values ​​is adapted to the number of processing schemes allowable for the portion 585 of the video sequence.

[0291] For example, the number of binary codes used to provide the encoded index 560 may depend on the number of processing schemes allowed in view of the attributes. For example, if only one processing scheme is allowed, the number of binary codes may be zero. Table 2 shows three allowable processing schemes and a maximum number of three binary codes for the encoded index 560, 660, and an example of a corresponding mapping rule for mapping index values ​​to encoded index values.

[0292] For example, Table 2 shows one embodiment of a mapping rule for mapping if_idx to an encoded index value. For different MV accuracies, the mapping rule may be different.

[0293] In the embodiment described in Table 2, the interpolation filter may be modified only for the HPEL position. If the motion vector points to an integer luma sample position, then no interpolation filter is used in all cases. If the motion vector points to a reference picture position representing a full sample x (or y) position and a half sample y (or x) position, then the selected half-pixel filter is applied only in the vertical (or horizontal) direction. In addition, only the filtering of the luma component is affected, and for the chroma components, the conventional chroma interpolation filter is used in all cases.

[0294] The if_idx index may correspond to the binarized value of the index 550 and if_idx, for example, as indicated in Table 2, may correspond to the encoded index 560, 660. Thus, the index encoder 561 may derive the encoded index 560 from the index 550 based on a binarization scheme, for example, the binarization scheme indicated in the last column of Table 2. In the context of the encoder 600, the binarization scheme indicated in the last column of Table 2 may correspond to the entropy coding scheme 662 selected by the coding scheme selector 661, or may be a part of the entropy coding scheme 662, based on which the encoder module 690 may provide the encoded index 660, for example, the encoded index may correspond to the binarized value shown in Table 2 or to its encoded representation. For example, the attribute based on which the encoder 600 may select the entropy coding scheme 662 may correspond to the MV accuracy. Thus, Table 2 shows an example of a case in which one or more syntax elements 520 indicate that the MV accuracy of the portion 585 is HPEL.

[0295] According to an embodiment, the encoder 500, 600 is configured to determine whether a single processing scheme 540 is permissible for the portion 585 of the video sequence, and selectively omit the inclusion of the encoded index in response to finding that only the single processing scheme 540 is permissible for the portion 585 of the video sequence. For example, the encoder 500 may omit the inclusion of the encoded index 560 to the encoded representation 514. For example, the encoder 600 may select the entropy coding scheme 662, which indicates that no encoded index 660 is included in the encoded representation 614 or that the number of binary codes or bits for the encoded index 660 in the bitstream is zero.

[0296] According to an embodiment, adaptive filter selection is extended to chroma components. For example, the encoder 500, 600 can select the processing scheme 540 based on the properties of the chroma components. The chroma components can be part of a chroma coding block, which can be associated with a luma coding block. For example, portion 585 can be part of a luma coding block and / or part of a chroma coding block.

[0297] 4. According to Figure 7 and Figure 8 Decoder

[0298] Figure 7 A decoder 700 for hybrid video decoding according to an embodiment is shown. The decoder 700 is configured to provide output video content 712 based on an encoded representation 714 of a video sequence. The encoded representation 714 may correspond to the encoded representation 514, 614, 1314 provided by the encoder 500, 600, 1300. The decoder 700 is configured to obtain a bitstream as the encoded representation 714 of the video sequence, and is configured to identify one or more syntax elements 520 associated with a portion 785 of the video sequence from the bitstream, which portion 785 of the video sequence may correspond to the portion 585 of the input video content 512.

[0299] According to an embodiment, the decoder 700 comprises a syntax identifier 721 for identifying one or more syntax elements 520, which may have been encoded by the encoder 500, 600 into the encoded representation 714. Furthermore, the decoder 700 is configured to identify a processing scheme 540 for a portion 785 of a video sequence based on the one or more syntax elements 520 and an index 550, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer positions 401 and / or fractional positions 411, 415, 417 within the portion 785 of the video sequence, wherein the decoder 700 is configured to assign different processing schemes to given encoded index values ​​depending on the one or more syntax elements 520.

[0300] For example, the processing scheme selector 741 may determine the index 550 from the encoded representation 714 based on the one or more syntax elements 520, and may then use the one or more syntax elements 520 and / or the index 550 to determine the processing scheme 540. Depending on the one or more syntax elements 520, the processing scheme selector 741 may also infer that the encoded representation 714 and the one or more syntax elements 520 do not include the index 550, and may derive the index 550 from the one or more syntax elements 520.

[0301] According to an alternative embodiment, the decoder 700 is configured to select a processing scheme 540 for a portion 785 of a video sequence based on one or more syntax elements 520, wherein the processing scheme is entirely specified by properties of the portion 785 and a fractional portion of a motion vector, and wherein the processing scheme 540 is used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence.

[0302] According to another alternative embodiment, the decoder 700 is configured to select the processing scheme 540 for the portion 785 of the video sequence depending on the motion vector accuracy.

[0303] According to another alternative embodiment, the decoder 700 is configured to determine the processing scheme 540 for the portion 785 of the video sequence at a PU granularity or a CU granularity and according to one or more syntax elements 520 .

[0304] Furthermore, the decoder 700 is configured to apply the identified processing scheme 540 to the portion 785 of the video sequence, for example, via the processing module 744 .

[0305] Figure 8A decoder 800 for hybrid video decoding according to another embodiment is shown. The decoder 800 is configured to provide output video content 812 based on an encoded representation 714 of a video sequence. The encoded representation 714 may correspond to the encoded representation 514, 614 provided by the encoder 500, 600. The decoder 800 is configured to obtain a bitstream as the encoded representation 714 of the video sequence, and is configured to identify one or more syntax elements 520 associated with a portion 785 of the video sequence from the bitstream, which portion 785 of the video sequence may correspond to the portion 585 of the input video content 512. For example, the decoder 700 includes a syntax identifier 821 for identifying one or more syntax elements, which may have been encoded by the encoder 500, 600 as the encoded representation 714. In addition, the decoder 800 is configured to determine an entropy coding scheme 662 for providing an encoded index in the bitstream based on one or more syntax elements 520, the encoded index indicating a processing scheme 540 for a portion 785 of a video sequence, the processing scheme 540 for obtaining samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence. For example, the decoder 800 includes a coding scheme selector 861, which may correspond to the coding scheme selector 661 of the encoder 600, for determining the coding scheme 662 based on the one or more syntax elements 520. The decoder 800 is further configured to identify the encoded index in the bitstream and decode the index, for example, by the processing scheme selector 841, if the determined entropy coding scheme 662 specifies a number of binary codes greater than zero. The decoder 800 is further configured to identify the processing scheme 540 based on the one or more syntax elements 520 and based on the decoded index if the number of binary codes specified by the determined coding scheme is greater than zero. For example, processing scheme selector 841 may identify processing scheme 540. Furthermore, decoder 800 is configured to apply identified processing scheme 540 to portion 785 of the video sequence, for example, via processing module 844, which may correspond to processing module 744.

[0306] The decoder 700, 800 may obtain output video content 712, 812 from the encoded representation 514, 614, 1314 provided by the encoder 500, 600 based on the input video content 512, such that the output video content 712, 812 may correspond to the input video content 512, except for encoding losses such as quantization losses. Thus, the description of the encoder 500, 600 and its features may be equivalently applied to the decoder 700, 800, but some processing may be performed in reverse. For example, features of the encoder 500, 600 relating to encoding may correspond to features of the decoder 700, 800 relating to decoding.

[0307] For example, the decoder 700, 800 may read or decode one or more syntax elements 520 from the encoded representation 714, 814, 1314 provided by the encoder 500, 600, 1300. Therefore, the encoder 500, 600, 1300 and the decoder 700, 800, 1300 may apply equivalent assumptions or knowledge for determining the processing scheme 540 from the one or more syntax elements 520.

[0308] For example, the encoded index 560, 660 may indicate information that the decoder 700, 800 may not be able to derive from one or more syntax elements 520, so that some embodiments of the decoder 700, 800 may determine the processing scheme 540 based on the encoded index 560, 660. For example, if the decoder 700, 800 derives from one or more syntax elements 520 that several processing schemes are allowable, for example, some embodiments of the decoder 700, 800 may decode the encoded index 560, 660 from the encoded representation 714, 814 used to obtain the index (e.g., the index 550). However, it is noted that not all embodiments of the decoder 700 are configured to derive whether several processing schemes are allowable. Some embodiments of the decoder 700 may be configured to infer the processing scheme 540 from one or more syntax elements of the encoded representation 1314, for example in all cases or independently of the indication of one or more syntax elements 520. Thus, embodiments of the decoder 700 may infer the processing scheme 540 from one or more syntax elements 520 without decoding an index explicitly dedicated to the processing scheme 540 .

[0309] Thus, even though the description of components is not explicitly repeated, the features, functions, advantages, and examples of one or more syntactic elements 520, processing scheme 540, portion 585, index 550, optionally encoded index 560, 660, and more details of encoders 500, 600, 1300 may be equivalently applied to decoders 700, 800.

[0310] For example, decoders 700, 800 may be configured as follows: Figure 2 For example, the processing module 744, 844 may include the prediction module 58 or may correspond to the prediction module 58, so that the processing scheme 540 may represent an input for the prediction module 58, and the prediction module may use the processing scheme 540 for MCP for providing the prediction signal 59. The relationship between the encoder 500, 600 and the decoder 700, 800 may correspond to the relationship between the encoder 10 and the decoder 20 as described in Section 1.

[0311] According to an embodiment, the decoder 700, 800 is configured to determine whether a single processing scheme 540 is allowable for the portion 785 of the video sequence, and in response to finding that only a single processing scheme 540 is allowable for the portion 785 of the video sequence, selectively omit identification of the encoded index.

[0312] For example, the decoder 700 can determine whether the single processing scheme 540 is allowable for the portion 785 based on the one or more syntax elements 520. Depending on the result, the decoder 700 can identify or decode the encoded index, which can correspond to the encoded index 560, 660, or the decoder 700 can omit or skip the identification of the encoded index and can select a single processing scheme that is allowable for the portion 785.

[0313] According to another example, the decoder 800 may derive from the entropy coding scheme 662 whether to decode an encoded index from the encoded representation 814. If there is an encoded index to be decoded, the decoder 800 may decode the encoded index, which may correspond to the encoded index 560, 660, to determine an index that may correspond to the index 550, and determine the processing scheme 540 based on the index. If there is no encoded index to be decoded, the decoder 800 may omit or skip decoding of the encoded index, and determine the processing scheme 540 based on one or more syntax elements 520.

[0314] According to an embodiment, the decoder 700, 800 is configured to select a filter based on the fractional part of the motion vector. For example, a motion vector can be represented by two components involving two different directions. For example, a motion vector can be represented by a horizontal component and a vertical component. Horizontal and vertical can represent two orthogonal directions in the plane of a picture or video frame. Therefore, the fractional part of a motion vector can refer to a component of an MV with a fractional resolution.

[0315] According to an embodiment, the decoder 700, 800 is configured to select different filters for filtering in the first direction and filtering in the second direction according to the fractional part of the motion vector. For example, the decoder 700, 800 can select different filters according to a first component of the MV describing the component of the MV in the first direction, and according to a second component of the MV describing the component of the MV in the second direction.

[0316] The encoded representation 514, 614, 714, 1314 may be part of a video bitstream provided by the encoder 500, 600, 1300, the video bitstream comprising encoded representations of portions of a video sequence of input video content.

[0317] According to an embodiment, a video bitstream for hybrid video coding includes one or more syntax elements 520 associated with a portion 585 of a video sequence, the video bitstream describing the video sequence. The video bitstream includes, at least for some of the portions of the video sequence, a processing scheme 540 indexing bitstream element, wherein the presence of the processing scheme 540 indexing bitstream element varies depending on one or more other syntax elements 520. For example, the video bitstream may correspond to or may include an encoded representation 514, 614, 714.

[0318] According to an embodiment, a video bitstream for hybrid video coding includes one or more syntax elements 520 associated with a portion 585 of a video sequence, the video bitstream describing the video sequence. The video bitstream includes, at least for some of the portions of the video sequence, a processing scheme 540 to index the bitstream elements, wherein the number of binary codes of the processing scheme 540 to index the bitstream elements varies according to the one or more syntax elements 520 associated with the portion 585 of the video sequence. For example, the video bitstream may correspond to or may include the coded representation 514, 614, 714.

[0319] According to an embodiment, a video bitstream for hybrid video coding includes one or more syntax elements 520 associated with a portion 585 of a video sequence, the video bitstream describing the video sequence. The video bitstream includes, at least for some of the portions of the video sequence, a processing scheme 540 to index the bitstream elements, wherein the meaning of the codewords of the processing scheme 540 to index the bitstream elements varies according to the one or more syntax elements 520 associated with the portion 585 of the video sequence. For example, the video bitstream may correspond to or may include the coded representation 514, 614, 714.

[0320] 5. According to Fig. 9 , Fig.10 , Fig.11 and Fig.12 Method for hybrid video coding

[0321] Fig. 9A flow chart of a method 5000 for hybrid video coding according to an embodiment is shown. The method 5000 is for providing an encoded representation 514 of a video sequence based on input video content 512, the method 5000 comprising a step 5001 of determining one or more syntax elements 520 associated with a portion 585 of the video sequence. Step 5002 comprises selecting a processing scheme 540 to be applied to the portion 585 of the video sequence based on the properties described by the one or more syntax elements 520, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 585 of the video sequence. Step 5003 comprises encoding an index indicating the selected processing scheme 540, such that a given encoded index value represents a different processing scheme according to the properties described by the one or more syntax elements 520. Step 5004 comprises providing a bitstream as the encoded representation of the video sequence, the bitstream comprising the one or more syntax elements 520 and the encoded index.

[0322] Fig.10 A flow chart of a method 6000 for hybrid video coding according to an embodiment is shown. The method 6000 is for providing an encoded representation of a video sequence based on input video content, the method 6000 comprising a step 6001 of determining one or more syntax elements 520 associated with a portion 585 of the video sequence. Step 6002 comprises selecting a processing scheme 540 to be applied to the portion 585 of the video sequence based on the properties described by the one or more syntax elements 520, the processing scheme 540 for obtaining samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 585 of the video sequence. Step 6003 comprises selecting an entropy coding scheme for providing an encoded index based on the properties described by the one or more syntax elements 520, the encoded index indicating the selected processing scheme 540. Step 6004 comprises providing a bitstream as the encoded representation of the video sequence, the bitstream comprising the one or more syntax elements 520 and comprising the encoded index.

[0323] Fig.11A flow chart of a method 7000 for hybrid video coding according to an embodiment is shown. The method 7000 is for providing output video content based on an encoded representation of a video sequence, the method 7000 comprising a step 7001 of obtaining a bitstream as an encoded representation of the video sequence. Step 7002 comprises identifying one or more syntax elements associated with a portion 785 of the video sequence from the bitstream. Step 7003 comprises identifying a processing scheme 540 for the portion 785 of the video sequence based on the one or more syntax elements 520 and an index, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence, wherein the method assigns different processing schemes to given encoded index values ​​according to the one or more syntax elements 520. Step 7004 comprises applying the identified processing scheme 540 to the portion 785 of the video sequence.

[0324] Fig.12 A flow chart of a method 8000 for hybrid video coding according to an embodiment is shown. The method 8000 is for providing output video content based on an encoded representation of a video sequence, the method 8000 comprising a step 8001 of obtaining a bitstream as an encoded representation of the video sequence. Step 8002 comprises identifying one or more syntax elements 520 associated with a portion 785 of the video sequence from the bitstream. Step 8003 comprises determining an entropy coding scheme 662 in the bitstream for providing an encoded index based on the one or more syntax elements 520, the encoded index indicating a processing scheme 540 for the portion 785 of the video sequence, the processing scheme 540 for obtaining samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence. Step 8004 comprises identifying the encoded index in the bitstream and decoding the index if the determined entropy coding scheme specifies a number of binary codes greater than zero. Step 8005 includes identifying a processing scheme 540 based on the one or more syntax elements 520 and based on the decoded index if the number of binary codes specified by the determined entropy coding scheme is greater than zero. Step 8006 includes applying the identified processing scheme 540 to the portion 785 of the video sequence.

[0325] Fig.14A flow chart of a method 7100 for hybrid video coding according to an embodiment is shown. The method 7100 is for providing output video content 712 based on an encoded representation 1314 of a video sequence, the method 7100 comprising: obtaining 7101 a bitstream as an encoded representation 714 of the video sequence; identifying 7102 one or more syntax elements 520 associated with a portion 785 of the video sequence from the bitstream; selecting 7103 a processing scheme 540 for the portion 785 of the video sequence based on the one or more syntax elements 520, wherein the processing scheme is completely specified by attributes of the portion 785 and a fractional part of a motion vector, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence; and applying 7104 the identified processing scheme 540 to the portion 785 of the video sequence.

[0326] Fig.15 A flow chart of a method 7200 for hybrid video coding according to an embodiment is shown. The method 7200 is for providing output video content 712 based on an encoded representation 1314 of a video sequence, the method 7200 comprising: obtaining 7201 a bitstream as an encoded representation 714 of the video sequence; identifying 7202 one or more syntax elements 520 associated with a portion 785 of the video sequence from the bitstream; selecting 7203 a processing scheme 540 for the portion 785 of the video sequence based on a motion vector accuracy, the processing scheme 540 for obtaining samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence; and applying 7204 the identified processing scheme 540 to the portion 785 of the video sequence.

[0327] Fig.16 A flow chart of a method 7300 for hybrid video coding according to an embodiment is shown. The method 7300 is used to provide output video content 712 based on an encoded representation 1314 of a video sequence, and the method 7300 includes: obtaining 7301 a bitstream as an encoded representation 714 of the video sequence; identifying 7302 one or more syntax elements 520 related to a portion 785 of the video sequence from the bitstream; determining 7303 a processing scheme 540 for the portion 785 of the video sequence at a PU granularity or a CU granularity and based on the one or more syntax elements 520, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence; and applying 7304 the identified processing scheme 540 to the portion 785 of the video sequence.

[0328] Fig.17A flow chart of a method 1310 for hybrid video coding according to an embodiment is shown. The method 1310 is used to provide an encoded representation 1314 of a video sequence based on input video content 512, the method 1310 comprising: determining 1311 one or more syntax elements 520 associated with a portion 585 of the video sequence; selecting 1312 a processing scheme 540 to be applied to the portion 585 of the video sequence based on the properties described by the one or more syntax elements 520, wherein the processing scheme is completely specified by the properties of the portion 585 and the fractional part of the motion vector, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 585 of the video sequence; and providing 1313 a bitstream as the encoded representation 1314 of the video sequence, the bitstream comprising the one or more syntax elements 520.

[0329] Fig.18 A flow chart of a method 1320 for hybrid video coding according to an embodiment is shown. The method 1320 is used to provide an encoded representation 1314 of a video sequence based on input video content 512, the method 1320 comprising: determining 1321 one or more syntax elements 520 associated with a portion 585 of the video sequence; selecting 1322 a processing scheme 540 to be applied to the portion 585 of the video sequence based on the accuracy of the motion vectors described by the one or more syntax elements 520, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence; and providing 1323 a bitstream as the encoded representation 1314 of the video sequence, the bitstream comprising the one or more syntax elements 520.

[0330] Fig.19 A flow chart of a method 1330 for hybrid video coding according to an embodiment is shown. The method 1330 is used to provide an encoded representation 1314 of a video sequence based on input video content 512, and the method 1330 includes: determining 1331 one or more syntax elements 520 related to a portion 585 of the video sequence; selecting 1332 a processing scheme 540 to be applied to the portion 585 of the video sequence based on the properties described by the one or more syntax elements 520 at a PU granularity or a CU granularity, the processing scheme 540 being used to obtain samples 401, 411, 415, 417 for motion compensated prediction at integer and / or fractional positions within the portion 785 of the video sequence; and providing 1333 a bitstream as the encoded representation 1314 of the video sequence, the bitstream including the one or more syntax elements 520.

[0331] 6. Further Embodiments

[0332] In many or possibly all current video coding standards, including the current VVC draft [5], the interpolation filters are fixed for each fractional sample position. (Here, "fractional sample position" refers to the relative position between the four surrounding FPEL or integer positions). Embodiments of the present invention allow different interpolation filters (e.g., processing schemes) to be used for the same fractional sample position in different parts (e.g., sections) of a video sequence. The previously mentioned methods for switching interpolation filtering (see the "Technical Background" section) have the disadvantage that they only allow switching between different interpolation filters at a coarse granularity (i.e., at the fragment level), and the selection can be explicitly signaled by transmitting individual FIR filter coefficients (such as AIF and its variants).

[0333] Allowing the interpolation filters to be switched at a fine granularity (e.g., PU / CU or CTU level) allows for better adaptation to local image characteristics (e.g., in addition to the high-precision HEVC interpolation filters, it is beneficial to use filters with different characteristics, such as filters with stronger low-pass characteristics for attenuating high-frequency noise components). However, explicit signaling of the interpolation filter used for each PU may be too expensive in terms of the required bit rate. Therefore, embodiments of the present invention avoid this signaling overhead by limiting the interpolation filters that can be used for a given part or region (part of a video sequence) of the video sequence according to the properties of the given part or region (e.g., PU / CU, CTU, slice, frame, etc.) that are also known to the decoder (e.g., because they are indicated by one or more syntax elements 520, which can be part of the encoded representation 514, 614, 1314). In the case where only one interpolation filter remains available, no further signaling is required. In the case where more than one remains available, only which available interpolation filter is used can be transmitted. (Note that here and below, "interpolation filtering" is used in the broad sense of any signal processing that is applied to obtain reference samples at given, possibly fractional, positions, and may also include filtering at FPEL positions.)

[0334] According to an embodiment of the present invention, it is possible to change the interpolation filter used only when the current block has certain properties (given by the values ​​of other decoded syntax elements). Here, two cases can be distinguished:

[0335] Case 1:For a given property of a block (determined by other syntax elements), only one specific set of interpolation filters is supported. Here, the term "set of interpolation filters" refers to the fact that the actual filters used do also depend on the subsample position (as in conventional video coding with subsample accuracy). The properties then determine the set of interpolation filters used, and the fractional part of the motion vector determines the actual filters (or horizontal and vertical filters if the filtering is specified by separable filters). Since the interpolation filters are completely specified by the properties of the block and the fractional part of the motion vector, no additional syntax elements are transmitted in this case.

[0336] Case 2: For a given property of a block, multiple sets of interpolation filters are supported. In this case, the set of interpolation filters can be selected by encoding a corresponding syntax element (e.g., an index into a list of supported sets). The interpolation filter used (from the selected set) can again be determined by the fractional part of the motion vector.

[0337] Note that both cases may be supported in the same picture. This means that for blocks with the first property, a fixed set of interpolation filters may be used (this set may be the same as the normal set of interpolation filters, or may deviate from the normal set). And for blocks with the second property, multiple sets of interpolation filters may be supported, and the selected filter may be determined by the transmitted filter index (or any other means). Additionally, blocks may have the third property, in which case other sets (one or more) of interpolation filters may be used.

[0338] These properties of parts or regions of a video sequence (portions of a video sequence) that can be used to limit the available interpolation filters include:

[0339] -MV accuracy (e.g. QPEL, HPEL, FPEL, etc.), i.e. different sets of interpolation filters can be supported for different motion vector accuracies

[0340] - Score sample position

[0341] - Block size or, more generally, block shape

[0342] - Number of prediction hypotheses (i.e. 1 for uni-prediction, 2 for bi-prediction, etc.), e.g. additional smoothing filters only for uni-prediction

[0343] - Prediction modes (e.g., shifted inter, affine inter, shifted merge, affine merge, combined inter / intra)

[0344] - Availability of coded residual signal (e.g. coded block flag in HEVC)

[0345] - Spectral properties of the coded residual signal

[0346] - Reference picture signals (reference blocks defined by motion data), e.g.

[0347] o Block edges from collocated Pus within the reference block

[0348] oHigh or low frequency characteristics of the reference signal

[0349] - Loop filter data, e.g.

[0350] o Edge offset or band offset classification from Sample Adaptive Offset Filter (SAO)

[0351] oDeblocking filter decision and boundary strength

[0352] -MV length, e.g. enable additional smoothing filters only for long MVs or specific directions

[0353] Combinations of two or more of these properties (eg MV accuracy with fractional sample position) are also possible (see above).

[0354] In one embodiment of the invention, the available interpolation filters may be directly linked to the MV accuracy. In particular, additional or different interpolation filters (relative to the HEVC or VVC interpolation filters) may only be used for blocks encoded using a specific MV accuracy (e.g., HPEL), and for example only applied to HPEL positions. In this case, signaling the MV accuracy may use a scheme similar to AMVR for VVC (see Section 6.1.2). If only one interpolation filter (i.e., replacing the corresponding HEVC or VVC interpolation filter) is available, no further signaling is required. If more than one interpolation filter is available, an indication of the interpolation filter used may be signaled only for blocks using a given MV accuracy, while for all other blocks the signaling remains unchanged.

[0355] In one embodiment of the invention, in case of merge mode of HEVC or VVC, the interpolation filters used may be inherited from the selected merge candidate. In another embodiment, it is possible to override the inherited interpolation filters from the merge candidate by explicit signaling.

[0356] 6.1 Further Embodiments of the Invention

[0357] In an embodiment of the invention, the available set of interpolation filters may be determined by the motion vector accuracy selected for the block (which is signaled using a dedicated syntax element). For half luma sample accuracy, multiple sets of interpolation filters may be supported, while for all other possible motion vector accuracies, a default set of interpolation filters is used.

[0358] 6.1.1 Interpolation filter set

[0359] In an embodiment of the present invention, two additional 1D 6-tap low-pass FIR filters may be supported, which may be applied instead of the HEVC 8-tap filter (with the above coefficients h[i]).

[0360] 6.1.2 Signalization

[0361] Extend the AMVR CU syntax from the current VVC draft with truncated unary binarization through HPEL resolution, and add a CABAC context for the additional binary code:

[0362] - The index is present only if at least one MVD is greater than zero

[0363] - If the index is equal to zero, it indicates the QPEL accuracy and HEVC interpolation filter

[0364] - If the index is equal to 1, it indicates that all MVDs have HPELMV accuracy and need to be shifted to QPEL accuracy before being added to MVPs, which are rounded to HPEL accuracy

[0365] - If the index is equal to 2 or 3, it indicates FPEL or 4PEL accuracy, respectively, and no interpolation filtering is applied

[0366]

[0367] Table 3

[0368] The context of the first binary code for switching between QPEL and other accuracies can be selected from three contexts according to the values ​​of the AMVR modes of the neighboring blocks to the left and above the current block. If both neighboring blocks have the QPELAMVR mode, the context is 0, otherwise, if only one neighboring block does not use the QPELAMVR mode, the context is 1, and otherwise (both neighboring blocks do not use the QPELAMVR mode), the context is 2.

[0369] In case the AMVR mode indicates HPEL accuracy (amvr mode = 2), the interpolation filter may be explicitly signaled via one syntax element (if_idx) per CU:

[0370] - If if_idx is equal to 0, it indicates that the HEVC filter coefficient h[i] is used to generate the HPEL position

[0371] - If if_idx is equal to 1, it indicates that the filter coefficients h[i] of the flat-top filter (see Table 2 in Section 3) are used to generate this HPEL position

[0372] - If if_idx is equal to 2, it indicates that the filter coefficients h[i] of the Gaussian filter (see Table 2 in Section 3) are used to generate the HPEL position

[0373] When the CU is encoded in merge mode and the merge candidate is generated by copying the motion vector(s) from the neighboring block without modifying the motion vector(s), the index if_idx is also copied. If if_idx is greater than 0, the HPEL position is filtered using one of the two non-HEVC filters (flat top or Gaussian).

[0374] In certain embodiments, the interpolation filter may be modified only for the HPEL position. If the motion vector points to an integer luma sample position, then no interpolation filter is used in all cases. If the motion vector points to a reference picture position representing a full sample x (or y) position and a half sample y (or x) position, then the selected half-pixel filter is applied only in the vertical (or horizontal) direction. Furthermore, only the filtering of the luma component is affected, and for the chroma components, the conventional chroma interpolation filter is used in all cases.

[0375] Possible variations of the described embodiments may include the following:

[0376] - The set of interpolation filters for HPEL accuracy also includes filters for changes to full sample positions. This means that if a half-sample accurate motion vector points to a full sample position in the x (or y) direction, a stronger low-pass filtering can also be applied in the horizontal (or vertical) direction.

[0377] - If motion vector accuracy of full luma samples or 4 luma samples is selected, filtering of reference samples may also be applied. Here, a single filter or multiple filters may be supported.

[0378] - Adaptive filter selection is extended to chroma components.

[0379] - The selected filter further depends on whether single or bi-prediction is used.

[0380] 7. Implementation Alternatives

[0381] Although some aspects have been described in the context of devices, it is clear that these aspects also represent descriptions of corresponding methods, where blocks or devices correspond to method steps or features of method steps. Similarly, aspects described in the context of method steps also represent descriptions of corresponding blocks or items or features of corresponding devices. Some or all of the method steps can be performed by (or using) hardware devices, such as microprocessors, programmable computers, or electronic circuits. In some embodiments, one or more of the most important method steps can be performed by such devices.

[0382] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. Implementations may be performed using a digital storage medium, such as a floppy disk, DVD, CD, ROM, PROM, EPROM, EEPROM or FLASH memory, on which electronically readable control signals are stored, which may cooperate (or be capable of cooperating) with a programmable computer system to cause the execution of the corresponding method. Thus, the digital storage medium may be computer readable.

[0383] Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.

[0384] Generally, the embodiments of the present invention can be implemented as a computer program product with a program code, which is operable to perform one of the methods when the computer program product runs on a computer. The program code can be stored on a machine-readable carrier, for example.

[0385] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

[0386] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0387] A further embodiment of the inventive method is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the computer program for performing one of the methods described herein. The data carrier, the digital storage medium or the recorded medium are typically tangible and / or non-transitory.

[0388] Therefore, a further embodiment of the inventive method is a data stream or a sequence of signals representing the computer program for performing one of the methods described herein.The data stream or the sequence of signals may, for example, be configured to be transmitted via a data communication connection, for example via the Internet.

[0389] A further embodiment comprises a processing means, for example a computer or a programmable logic device, configured to or adapted to perform one of the methods described herein.

[0390] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

[0391] Another embodiment according to the invention comprises an apparatus or system configured to transmit (e.g. electronically or optically) a computer program for performing one of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may, for example, comprise a file server for transmitting the computer program to the receiver.

[0392] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array may collaborate with a microprocessor to perform one of the methods described herein. Typically, the method is preferably performed by any hardware device.

[0393] The devices described herein may be implemented using hardware devices, or using computers, or using a combination of hardware devices and computers.

[0394] The devices described herein or any component of a device described herein may be implemented at least partially in hardware and / or software.

[0395] The methods described herein may be performed using a hardware device, or using a computer, or using a combination of a hardware device and a computer.

[0396] Any component of a method described herein or an apparatus described herein may be performed at least in part by hardware and / or software.

[0397] The embodiments described above are only used to illustrate the principles of the present invention. It should be understood that modifications and variations of the arrangements and details described herein will be apparent to those skilled in the art. Therefore, the present invention is intended to be limited only by the scope of the upcoming patent claims, and not by the specific details presented by the description and explanation of the embodiments herein.

[0398] References

[0399] [1]Yuri Vatis,Bernd Edler,Dieu Thanh Nguyen, Ostermann, "Two-dimensional non-separable Adaptive Wiener Interpolation Filter for H.264 / AVC", ITU-T SG 16 / Q.6 Doc. VCEG-Z17, Busan, Korea, April 2005.

[0400] [2] S. Wittmann, T. Wedi, “Separable Adaptive Interpolation Filter,” document COM16-C219, ITU-T, June 2007.

[0401] [3] M. Karczewicz, Y. Ye, and P. Chen, “Switched interpolation filter with offset,” document COM16-C463, ITU-T, April 2008.

[0402] [4] Y. Ye and M. Karczewicz, “Enhanced Adaptive Interpolation Filter,” document COM16-C464, ITU-T, April 2008.

[0403] [5] B. Bross, J. Chen, S. Liu (editors), “Versatile Video Coding (Draft 4),” document JVET-M1001, January 2019.

Claims

1. A video encoder, configured to: encoding syntax elements including an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether the inter prediction mode is translational or affine for a coding block of a picture; Selecting a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters to obtain samples at one-half sample positions of a reference picture corresponding to the coding block based on the indicated AMVR mode and an indication of whether the inter-prediction mode is translation or affine, the plurality of FIR interpolation filters including a first interpolation filter having 6 non-zero coefficients and a second interpolation filter having 8 non-zero coefficients, the second interpolation filter having a greater edge preservation property than the first interpolation filter; applying the selected FIR interpolation filter to samples of the reference picture to obtain samples corresponding to one-half sample positions; and The samples of the coding block are predicted using the samples corresponding to half the sample positions.

2. The video encoder of claim 1, wherein the first interpolation filter has coefficients of 3, 9, 20, 20, 9, 3.

3. The video encoder of claim 1, wherein the second interpolation filter has coefficients of -1, 4, -11, 40, 40, -11, 4, -1.

4. The video encoder of claim 1, wherein the plurality of FIR interpolation filters comprises more than one filter having six non-zero coefficients.

5. A video decoder, configured to: decoding syntax elements from a video bitstream, the syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture; Selecting a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters to obtain samples at one-half sample positions of a reference picture corresponding to the coding block based on the indicated AMVR mode and an indication of whether the inter-prediction mode is translation or affine, the plurality of FIR interpolation filters including a first interpolation filter having 6 non-zero coefficients and a second interpolation filter having 8 non-zero coefficients, the second interpolation filter having a greater edge preservation property than the first interpolation filter; applying the selected FIR interpolation filter to samples of the reference picture to obtain samples corresponding to one-half sample positions; and The samples of the coding block are predicted using the samples corresponding to half the sample positions.

6. The video decoder of claim 5, wherein the first interpolation filter has coefficients of 3, 9, 20, 20, 9, 3.

7. The video decoder of claim 5, wherein the second interpolation filter has coefficients of -1, 4, -11, 40, 40, -11, 4, -1.

8. The video decoder of claim 5, wherein the plurality of FIR interpolation filters comprises more than one filter having six non-zero coefficients.

9. The video decoder of claim 5, wherein none of the syntax elements is explicitly dedicated to indicating a selected FIR interpolation filter.

10. The video decoder of claim 5, wherein the video decoder is configured to select FIR interpolation filters separately for different coding units of a picture.

11. A method for video encoding, the method comprising: encoding syntax elements including an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether the inter prediction mode is translational or affine for a coding block of a picture; Selecting a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters to obtain samples at one-half sample positions of a reference picture corresponding to the coding block based on the indicated AMVR mode and an indication of whether the inter-prediction mode is translation or affine, the plurality of FIR interpolation filters including a first interpolation filter having 6 non-zero coefficients and a second interpolation filter having 8 non-zero coefficients, the second interpolation filter having a greater edge preservation property than the first interpolation filter; applying the selected FIR interpolation filter to samples of the reference picture to obtain samples corresponding to one-half sample positions; and The samples of the coding block are predicted using the samples corresponding to half the sample positions.

12. The method of claim 11, wherein the first interpolation filter has coefficients of 3, 9, 20, 20, 9, 3.

13. The method of claim 11, wherein the second interpolation filter has coefficients of -1, 4, -11, 40, 40, -11, 4, -1.

14. The method of claim 11, wherein the plurality of FIR interpolation filters comprises more than one filter having six non-zero coefficients.

15. A method for video decoding, the method comprising: decoding syntax elements from a video bitstream, the syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture; Selecting a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters to obtain samples at one-half sample positions of a reference picture corresponding to the coding block based on the indicated AMVR mode and an indication of whether the inter-prediction mode is translation or affine, the plurality of FIR interpolation filters including a first interpolation filter having 6 non-zero coefficients and a second interpolation filter having 8 non-zero coefficients, the second interpolation filter having a greater edge preservation property than the first interpolation filter; applying the selected FIR interpolation filter to samples of the reference picture to obtain samples corresponding to one-half sample positions; and The samples of the coding block are predicted using the samples corresponding to half the sample positions.

16. The method of claim 15, wherein the first interpolation filter has coefficients of 3, 9, 20, 20, 9, 3.

17. The method of claim 15, wherein the second interpolation filter has coefficients of -1, 4, -11, 40, 40, -11, 4, -1.

18. The method of claim 15, wherein the plurality of FIR interpolation filters comprises more than one filter having six non-zero coefficients.

19. The method of claim 15, wherein none of the syntax elements is explicitly dedicated to indicating a selected FIR interpolation filter.

20. The method of claim 15, wherein the method further comprises selecting FIR interpolation filters separately for different coding units of a picture.