Codec tools with reference picture resampling

Abstract

A video processing method is provided, comprising: deriving one or more motion vector offsets for conversion between a current video block of a current picture of a video and a codec representation of the video based on one or more resolutions of a reference picture associated with the current video block and a resolution of the current picture; and performing the conversion using the one or more motion vector offsets.

Claims

1. A video processing method, comprising: deriving one or more motion vector offsets for a conversion between a current video block of a current picture of a video and a codec representation of the video based on one or more resolutions of reference pictures associated with the current video block and a resolution of the current picture; and performing said converting using said one or more motion vector offsets, wherein the one or more motion vector offsets include a first offset offset0 and a second offset offset1, and wherein performing the conversion includes calculating the motion vector using a SatShift formula defined as follows: Where x is the motion vector.

2. The method of claim 1 , wherein the one or more motion vector offsets correspond to motion vector offsets in a Merge (MMVD) or a Symmetric (SMVD) motion vector difference with a motion vector difference, the MMVD including a motion vector expression including a distance index specifying a distance between two motion candidates, and the SMVD processing the motion vector difference symmetrically. 3 . The method of claim 1 , wherein the one or more motion vector offsets correspond to refined motion vectors used in a decoder-side derivation process.

4. The method of claim 1 , wherein deriving the one or more vector offsets comprises: deriving a first motion vector offset with reference to a first reference picture; and Based on the first motion vector offset, a second motion vector offset is derived with reference to a second reference picture.

5. The method of any one of claims 1 to 4, wherein performing the conversion comprises generating the codec representation from the video or generating the video from the codec representation.

6. The method according to claim 1, further comprising: constructing a motion candidate list for conversion between a current video block of a current picture of a video and a codec representation of the video, the motion candidates in the motion candidate list being included in a priority order such that the priority of the motion candidate is based on a resolution of a reference picture associated with the motion candidate, The conversion is also performed using the motion candidate list. 7 . The method of claim 6 , wherein a motion candidate that refers to a reference picture with a higher resolution has a higher priority than another motion candidate that refers to another reference picture with a lower resolution. 8 . The method of claim 6 , wherein a motion candidate that refers to a reference picture with a higher resolution is placed before another Merge candidate that refers to another reference picture with a lower resolution in the motion candidate list. 9 . The method of claim 6 , wherein the constructing the motion candidate list is performed to exclude motion candidates that reference reference pictures having a resolution lower than a resolution of a current picture including the current video block.

10. The method of claim 6, wherein whether and / or how the lookup table is updated depends on a resolution of a reference picture associated with the decoded motion candidate.

11. The method of claim 10, wherein the reference picture is associated with a decoded motion candidate and has a resolution different from a resolution of a current picture including the current video block, the motion candidate from the reference picture not allowing updating of the lookup table.

12. The method according to any one of claims 6-11, wherein the motion candidate is a temporal motion candidate.

13. The method according to any one of claims 6-11, wherein the motion candidate is a spatial motion candidate.

14. The method according to any one of claims 6-11, wherein the motion candidate is a history-based motion candidate.

15. The method of any one of claims 6-11, wherein performing the conversion comprises generating the codec representation from the video or generating the video from the codec representation.

16. The method according to claim 1, further comprising: determining parameters of an adaptive loop filter for a current video picture based on a size of the current video picture comprising one or more video units, Wherein the converting is further performed by filtering the one or more video units according to the parameters of the adaptive loop filter.

17. The method of claim 16, wherein the parameter is signaled in a video unit and is associated with the one or more picture sizes.

18. The method of claim 16, wherein the video unit used to signal the parameter is associated with one or more picture sizes.

19. The method of claim 16, wherein the parameters signaled in video units and associated with the same size are applied to the current picture.

20. The method of claim 16, wherein the codec representation comprises a data structure signaling at least one of a resolution, an index of a picture parameter set (PPS), and an indication of a resolution.

21. The method of claim 16, wherein the parameters are inherited or predicted from parameters for another picture having the same resolution as the current picture.

22. The method of claim 16, wherein the parameters include a first set of parameters associated with a first corresponding size and a second set of parameters associated with a second corresponding size, the second set of parameters being inherited or predicted from the first set of parameters.

23. The method of claim 22, wherein the first corresponding size is the same as the second corresponding size. The method of claim 22 , wherein the first corresponding size is different from the second corresponding size.

25. The method of any one of claims 16-24, wherein performing the conversion comprises generating the codec representation from the video or generating the video from the codec representation.

26. The method of claim 1, further comprising: A luma mapping with chroma scaling (LMCS) process is applied to a current video block of a current picture of a video, wherein luma samples of the current video block are reshaped between a first domain and a second domain, and chroma residuals are scaled in a luma-dependent manner by using LMCS parameters associated with corresponding sizes.

27. The method of claim 26, wherein the LMCS parameters are signaled in video units and are associated with one or more picture sizes.

28. The method of claim 26, wherein the video unit used to signal the LMCS parameters is associated with one or more picture sizes.

29. The method of claim 26, wherein LMCS parameters signaled in video units and associated with the same size are applied to the current picture.

30. The method of claim 26, wherein the codec representation comprises a data structure signaling at least one of a resolution, an index to a picture parameter set (PPS), and an indication of a resolution.

31. The method of claim 26, wherein the LMCS parameters are inherited or predicted from parameters for another picture having the same resolution as the current picture.

32. The method of claim 26, wherein the LMCS parameters include a first LMCS parameter associated with a first corresponding size and a second LMCS parameter associated with a second corresponding size, the second LMCS parameter being inherited or predicted from the first LMCS parameter.

33. The method of claim 32, wherein the first corresponding size is the same as the second corresponding size.

34. The method of claim 32, wherein the first corresponding size is different from the second corresponding size.

35. The method of any one of claims 26-34, wherein performing the conversion comprises generating the codec representation from the video or generating the video from the codec representation.

36. The method of claim 1, further comprising: determining, for conversion between a current video block of a video and a codec representation of the video, whether and / or how to enable a codec tool according to rules based on reference picture information of the plurality of subpartitions, the codec tool partitioning the current video block into the plurality of subpartitions, Wherein, the converting is further performed based on the determining.

37. The method of claim 36, wherein the codec corresponds to a triangular prediction mode (TPM) in which at least one of the subpartitions is a non-rectangular partition, or an inter-frame prediction (GEO) with geometric partitioning in which non-horizontal or non-vertical lines can be used to partition a video block.

38. The method of claim 36, wherein the rule specifies whether and / or how to enable the codec tool based on whether a resolution of one of two reference pictures corresponding to two sub-partitions is the same as or different from a resolution of a current picture including the current video block.

39. The method of claim 38, wherein the rule specifies that the codec tool is not enabled if at least one of the two reference pictures is associated with a resolution that is different from a resolution of the current picture.

40. The method of claim 38, wherein the rules specify that the codec tool is not enabled if the two reference pictures are associated with different resolutions from each other.

41. The method of claim 38, wherein the rules specify that the codec tool is not enabled if the two reference pictures are both associated with a resolution different than a resolution of the current picture.

42. The method of claim 38, wherein the rules specify that the codec tool is not enabled if the two reference pictures are associated with a same resolution that is different than a resolution of the current picture.

43. The method of claim 38, wherein the rule specifies that the codec tool is not enabled if at least one of the two reference pictures is associated with a resolution that is different than a resolution of the current picture.

44. The method of claim 36, wherein the rules specify whether and / or how to enable the codec tool based on whether two reference pictures corresponding to two sub-partitions are the same reference picture.

45. The method of claim 36, wherein the rules specify whether and / or how to enable the codec tool based on whether two reference pictures corresponding to two sub-partitions are in the same reference list.

46. ​​The method of claim 36, wherein the rule specifies that the codec is always disabled if reference picture resampling is enabled in a video unit of the video.

47. The method of any one of claims 36-46, wherein performing the conversion comprises generating the codec representation from the video or generating the video from the codec representation.

48. An apparatus in a video system, comprising a processor and a non-transitory memory having instructions thereon, wherein the instructions, when executed by the processor, cause the processor to implement the method of any one of claims 1 to 47.

49. A computer program product comprising a computer program, wherein When the computer program product is executed by a processor, the steps of the method according to any one of claims 1 to 47 are implemented.

Images