Decoding of segmentation information using signaling

Abstract

Method and apparatus for decrypting data [Solution] Two or more sets of segmentation information elements are obtained from the bitstream. Each of these two or more sets of segmentation information elements is then input to two or more segmentation information processing layers among a plurality of cascaded layers. Each of the two or more segmentation information processing layers processes each set of segmentation information. Decoded data for picture or video processing is obtained based on the segmentation information processed by the plurality of cascaded layers. Thus, the data can be decoded from the bitstream in an efficient manner in a hierarchical structure.

Claims

1. A method for decoding data from a bitstream for picture or video processing, wherein the method is The steps include obtaining two or more sets of segmentation information elements from the bitstream, The steps include inputting each of two or more sets of the aforementioned segmentation information elements to two or more segmentation information processing layers among a plurality of cascade layers, Each of the two or more segmentation information processing layers includes the step of processing each set of segmentation information, A method comprising the step of obtaining decoded data for picture or video processing, based on the segmentation information processed by the plurality of cascaded layers.

2. The method according to claim 1, wherein the step of obtaining the set of segmentation information elements is based on segmentation information processed by at least one segmentation information processing layer among the plurality of cascade layers.

3. The method according to claim 1 or 2, wherein the step of inputting the set of segmentation information elements is based on the processed segmentation information output by at least one of the plurality of cascade layers.

4. The method according to any one of claims 1 to 3, wherein the segmentation information processed in each of the two or more segmentation information processing layers differs in resolution.

5. The method according to claim 4, wherein the step of processing the segmentation information in the two or more segmentation information processing layers includes the step of upsampling.

6. The method according to claim 5, wherein the step of upsampling the segmentation information includes nearest neighbor upsampling.

7. The method according to claim 5 or 6, wherein the step of upsampling the segmentation information includes transposed convolution.

8. For each of the N segmentation information processing layers j among the plurality of cascade layers, - The input step is to input initial segmentation information from the bitstream if j=1, otherwise input segmentation information processed by the (j-1)th segmentation information processing layer, The method according to any one of claims 1 to 7, comprising the step of outputting the processed segmentation information.

9. The step of processing the input segmentation information by each layer j < N of the plurality of segmentation information processing layers is as follows: The method according to claim 8, further comprising the steps of analyzing segmentation information elements from the bitstream and associating the analyzed segmentation information elements with segmentation information output by a preceding layer, wherein the position of the analyzed segmentation information elements within the associated segmentation information is determined based on the segmentation information output by the preceding layer.

10. The method according to claim 9, wherein the amount of segmentation information elements analyzed from the bitstream is determined based on the segmentation information output by the preceding layer.

11. The method according to claim 9 or 10, wherein the analyzed segmentation information elements are represented by a set of binary flags.

12. The step of obtaining decoded data for picture or video processing is based on segmentation information, - Predictive mode within or between pictures, - Picture reference index, - Single-reference or multiple-reference prediction (including dual prediction), - Predicted residual information for existence or absence, - Quantization step size, - Motion information prediction type, - Length of the motion vector, - Motion vector resolution, - Motion vector prediction index, - Motion vector difference size, - Motion vector difference resolution, - Motion interpolation filter, - Loop filter parameters, - Post-filter parameters, The method according to any one of claims 1 to 11, comprising the step of determining at least one of the following.

13. The steps include obtaining a set of feature map elements from the bitstream, and inputting the set of feature map elements into the feature map processing layer among the multiple layers based on the segmentation information processed by the segmentation information processing layer, The method according to any one of claims 1 to 12, further comprising the step of obtaining the decoded data for picture or video processing based on the feature maps processed by the plurality of cascade layers.

14. The method according to claim 13, wherein at least one of the plurality of cascade layers is a segmentation information processing layer and a feature map processing layer.

15. The method according to claim 13, wherein each of the plurality of layers is either a segmentation information processing layer or a feature map processing layer.

16. A computer program product stored on a non-temporary medium, which, when executed on one or more processors, performs the method described in any one of claims 1 to 15.

17. A device for decoding an image or video, comprising a processing circuit configured to perform the method described in any one of claims 1 to 15.

18. A device for decoding data from a bitstream for picture or video processing, wherein the device is An acquisition unit configured to acquire two or more sets of segmentation information elements from the bitstream, An input unit configured to input each of the two or more sets of segmentation information elements to two or more segmentation information processing layers among a plurality of cascade layers, Each of the two or more segmentation information processing layers includes a processing unit configured to process each set of segmentation information, A device comprising: a decoded data acquisition unit configured to acquire decoded data for picture or video processing based on the segmentation information processed in the plurality of cascade layers.

Images