Concept for picture / video data streams allowing efficient reducibility or efficient random access

Abstract

This invention relates to a video streaming service that allows for the reduction of the image in the reduced video streaming service to be limited to only a predetermined sub-region of the image in the original video streaming service, and to a method that avoids transcoding such as requantization while maintaining the conformity of the reduced video streaming service with respect to a codec underlying the original video streaming service. This is achieved by providing information to the video streaming service, including an indication of the predetermined sub-region, a substitution index for redirecting the indices comprising the payload portion to refer to a second set of write parameter settings, and / or substitution parameters for adjusting the first set of write parameter settings to generate a second set of write parameter settings. This results in a more efficient presentation of the transmitted image content because the image content does not need to be shaped or ordered in a predetermined manner. Similar procedures can be applied to supplemental enhancement information. The adjustment of these parameters and / or supplemental enhancement information of a reduced streaming service is also described. According to another approach, the negative effects of bit rate spikes in a video stream caused by random access points are reduced by providing two sets of random access points for the video stream: encoding a first set of one or more images into the video stream by temporary pause time prediction in at least a first image sub-region to form a set of one or more first random access points, and encoding a second set of one or more images into the video stream by temporary pause time prediction in a second image sub-region different from the first image sub-region to form a set of one or more second random access points.

Claims

1. A video data stream representing a video stored in a storage medium, comprising: A parameter set portion that indicates coding parameter settings; A payload portion in which images of the video are coded in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by an index included in the payload portion, wherein the video data stream includes information that includes: An indication of a predetermined sub-region of the images, and Replacement indices and / or replacement parameters, the replacement indices being used to redirect the indices included in the payload portion to refer to a second set of coding parameter settings, the replacement parameters being used to adjust the first set of coding parameter settings to generate the second set of coding parameter settings, wherein the second set of coding parameters is selected such that a reduced video data stream modified compared to the video data stream has a reduced payload portion by: Removing portions of the payload portion that refer to a region of the images outside the predetermined sub-region, and Changing position indications in the payload portion such that a position is indicated in a manner measured from a circumference of the predetermined sub-region rather than the images, the reduced payload portion having sub-region specific images encoded therein in a manner parameterized using the second set of coding parameter settings, the sub-region specific images showing the predetermined sub-region of the images, wherein the video data stream and the reduced video data stream conform to HEVC, and wherein the information is included in an SEI message, a VUI, or a parameter set extension.

2. The video data stream stored in a storage medium as claimed in claim 1, wherein the parameter set portion is included in an SPS NAL unit and / or a VPS NAL unit and / or a PPS NAL unit.

3. The video data stream stored in a storage medium as claimed in claim 1, wherein the coding parameter settings define one or more of: Image size, Image block structure, Buffer size and timing.

4. The video data stream stored in a storage medium as claimed in claim 1, wherein the indices are included in the block headers of the blocks of the payload portion, each block having a corresponding region of an image encoded therein that does not cross a boundary of the predetermined sub-region.

5. The video data stream stored in a storage medium as claimed in claim 1, wherein the payload portion has the images of the video coded therein in units of image blocks, the images being subdivided into image blocks and the image blocks being arranged in an image block array of multiple rows and multiple columns, wherein the indication indicates the predetermined sub-region as a set of the image blocks.

6. The video data stream stored in a storage medium as claimed in claim 5, wherein the payload portion has the images of the video coded therein in units of image blocks such that the payload portion is subdivided in units of blocks, each block having a corresponding region of an image encoded therein that does not cross an image block edge between the image blocks.

7. The video data stream stored in a storage medium as claimed in claim 1, wherein: A part of the first set of coding parameter settings indexed by those indexes from which the redirection to be performed by these replacement indexes comes, and / or the part of the first set replaced by these replacement parameters, relates to one or more of the following: image size, image block structure, buffer size and timing.

8. The video data stream stored in a storage medium as claimed in claim 1, wherein the payload part has the images of the video coded therein such that within the predetermined sub-region, the images are coded with an interruption of temporal prediction across the boundary of the predetermined sub-region.

9. An encoder for encoding a video into a video data stream, comprising: a parameter adjuster configured to determine coding parameter settings and generate a parameter set part in the video data stream indicating one of the coding parameter settings; a coding core configured to encode the images of the video into a payload part of the video data stream in a manner parameterized by a first set of the coding parameter settings, the first set being indexed by an index included in the payload part, wherein the encoder is configured to provide an information to the video data stream, the information including: an indication of a predetermined sub-region of the images, and replacement indexes and / or replacement parameters, the replacement indexes being used to redirect the indexes included in the payload part to refer to a second set of coding parameter settings, the replacement parameters being used to adjust the first set of coding parameter settings to generate the second set of coding parameter settings, wherein the second set of coding parameters is selected such that a reduced video data stream modified compared to the video data stream has a reduced payload part by: removing several parts in the payload part referring to a region of the images outside the predetermined sub-region, and changing the position indication in the payload part such that a position is indicated in a manner measured from a circumference of the predetermined sub-region rather than the images, the reduced payload part having sub-region specific images coded therein in a manner parameterized by the second set of coding parameter settings, the sub-region specific images showing the predetermined sub-region of the images, wherein the video data stream and the reduced video data stream conform to HEVC, and wherein the encoder is configured to insert the information into a SEI message, a VUI or a parameter set extension.

10. The encoder as claimed in claim 9, wherein the parameter set part is included by an SPS NAL unit and / or a VPS NAL unit and / or a PPS NAL unit.

11. The encoder as claimed in claim 9, wherein the coding parameter settings define one or more of the following: image size, image block structure, buffer size and timing.

12. The encoder as claimed in claim 9, wherein the encoder is configured to insert the indexes into the block headers of the blocks in the payload part and encode a corresponding region of an image not crossing a boundary of the predetermined sub-region into each block.

13. The encoder of claim 9, wherein the encoder is configured to encode the images of the video, which are coded in units of image blocks, into the payload portion, the images being subdivided into image blocks and the image blocks being arranged in an image block array of multiple rows and multiple columns, wherein the indication indicates the predetermined sub-region as a set of the image blocks.

14. The encoder of claim 13, wherein the encoder is configured to encode the images of the video, which are coded in units of image blocks, into the payload portion such that the payload portion is subdivided in units of tiles, each tile having a corresponding region of an image encoded therein that does not cross an image block edge between the image blocks.

15. The encoder of claim 9, wherein a part of the first set of coding parameter settings indexed by the indices from which the redirection to be performed by the replacement indices is derived, and / or the part of the first set replaced by the replacement parameters, relates to one or more of the following: image size, image block structure, buffer timing.

16. The encoder of claim 9, wherein the encoder is configured to encode the payload portion into the images of the video such that, within the predetermined sub-region, the images are coded with an interruption in temporal prediction across the boundary of the predetermined sub-region.

17. A device for processing a video data stream for delivery to a video decoder, the video data stream comprising a parameter set portion that indicates coding parameter settings; a payload portion in which the images of the video are coded into the payload portion in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by an index included in the payload portion, wherein the device is configured to read from the video data stream an information that includes: an indication of a predetermined sub-region of the images, and replacement indices and / or replacement parameters, the replacement indices being used to redirect the indices included in the payload portion to refer to a second set of coding parameter settings, the replacement parameters being used to adjust the first set of coding parameter settings to produce the second set of coding parameter settings, reduce the video data stream to a reduced video data stream modified by performing the redirection and / or adjustment such that the second set of coding parameters is indexed by the index of the payload portion; remove portions of the payload portion that refer to a region of the images outside the predetermined sub-region, and change position indications in the payload portion such that a position is indicated measured from a circumference of the predetermined sub-region rather than the images, such that the reduced video data stream has a reduced payload portion that has sub-region specific images encoded therein in a manner parameterized using the second set of coding parameter settings, the sub-region specific images showing the predetermined sub-region of the images, wherein the video data stream and the reduced video data stream comply with HEVC, and wherein the device is configured to read the information from a SEI message, a VUI, or a parameter set extension of the video data stream.

18. The device of claim 17, wherein the parameter set portion is included in an SPS NAL unit and / or a VPS NAL unit and / or a PPS NAL unit.

19. The device of claim 17, wherein the coding parameter settings define one or more of the following: image size, image block structure, buffer size, and timing.

20. The device of claim 17, wherein the device is configured to locate the indices in the tile headers of the tiles in the payload portion, each tile having a corresponding region of an image encoded therein that does not cross a boundary of the predetermined sub-region.

21. The device of claim 17, wherein the payload portion has the images of the video encoded therein in units of image tiles, the images being subdivided into image tiles and the image tiles being arranged in an image tile array of multiple rows and multiple columns, wherein the indication indicates the predetermined sub-region as a set of the image tiles.

22. The device of claim 21, wherein the payload portion has the images of the video encoded therein in units of image tiles such that the payload portion is subdivided in units of tiles, each tile having a corresponding region of an image encoded therein that does not cross an image tile edge between the image tiles.

23. The device of claim 17, wherein a part of the first set of coding parameter settings indexed by the indices from which the redirection to be performed by the replacement indices originates, and / or the part of the first set replaced by the replacement parameters, relates to one or more of the following: image size, image block structure, buffer size, and timing.

24. The device of claim 17, wherein the payload portion has the images of the video encoded therein such that within the predetermined sub-region, the images are encoded with an interruption in temporal prediction that crosses the boundary of the predetermined sub-region.

25. The device of claim 17, wherein the device is one of the following: a video decoder capable of decoding the video data stream and the reduced video data stream, a video decoder whose class level is sufficient to enable the video decoder to decode the reduced video data stream but whose class level is insufficient to prevent the video decoder from decoding the video data stream, and a network device configured to transmit, depending on a control signal, one of the video data stream and the reduced video data stream to a video decoder.

26. The apparatus of claim 17, wherein the video data stream includes a shift information that indicates, for a set of at least one predetermined sub-region of the images, a shift of the set of at least one predetermined sub-region relative to an unshifted copy of the set of at least one predetermined sub-region within a target image region, within the target image region, and the apparatus is configured to modify the shift information to modified shift information such that the sub-region specific images coincide with the predetermined sub-regions of the images within the target image region, the sub-region specific images are copied to the target image region having the predetermined sub-regions of the sub-region specific images shifted according to the modified shift information, the predetermined sub-regions of the images are copied to the target image region having the set of at least one predetermined sub-region of the images shifted according to the shift information, and when reducing the video data stream, the shift information is replaced with the modified shift information, or the modified shift information is included in the video data stream associated with the predetermined sub-regions of the images, and the shift information is included in the video data stream associated with the images, and when reducing the video data stream, the apparatus is configured to remove the shift information and continue the modified shift information to the reduced video data stream for association with the sub-region specific images.

27. A digital storage medium having stored thereon a data stream as claimed in claim 1.

28. A method for encoding a video into a video data stream, comprising: determining coding parameter settings and generating a parameter set portion in the video data stream that indicates the coding parameter settings; encoding images of the video into a payload portion of the video data stream in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by an index included in the payload portion; providing information to the video data stream, the information including: an indication of a predetermined sub-region of the images, and replacement indices and / or replacement parameters, the replacement indices being used to redirect the indices included in the payload portion to refer to a second set of coding parameter settings, the replacement parameters being used to adjust the first set of coding parameter settings to generate the second set of coding parameter settings, wherein the second set of coding parameters is selected such that a reduced video data stream modified compared to the video data stream has a reduced payload portion by: removing portions of the payload portion that refer to a region of the images outside the predetermined sub-region, and changing position indications in the payload portion such that a position is indicated in a manner measured from a circumference of the predetermined sub-region rather than from the images, the reduced payload portion having sub-region specific images encoded therein in a manner parameterized using the second set of coding parameter settings, the sub-region specific images showing the predetermined sub-region of the images, wherein the video data stream and the reduced video data stream comply with HEVC, and wherein the information is inserted into a SEI message, a VUI or a parameter set extension.

29. A method for processing a video data stream, the video data stream comprising: a parameter set portion that indicates coding parameter settings; a payload portion in which images of the video are coded into the payload portion in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by an index included in the payload portion, wherein the method comprises: reading from the video data stream an information that includes: an indication of a predetermined sub-region of the images, and replacement indices and / or replacement parameters, the replacement indices being used to redirect the indices included in the payload portion to refer to a second set of coding parameter settings, the replacement parameters being used to adjust the first set of coding parameter settings to produce the second set of coding parameter settings; reducing the video data stream to a reduced video data stream modified by: performing the redirection and / or adjustment such that the second set of coding parameters is indexed by the indices of the payload portion; removing portions of the payload portion that refer to a region of the images outside the predetermined sub-region; and changing position indications in the payload portion such that a position is indicated that is measured circumferentially from the predetermined sub-region rather than from the images, such that the reduced video data stream has a reduced payload portion that has sub-region specific images encoded therein in a manner parameterized using the second set of coding parameter settings, the sub-region specific images showing the predetermined sub-region of the images, wherein the video data stream and the reduced video data stream conform to HEVC, and wherein the information is read from a SEI message, a VUI, or a parameter set extension of the video data stream.

30. A computer-readable storage medium comprising a computer program that includes code for performing the method of claim 28 when run on a computer.

31. A computer-readable storage medium comprising a computer program that includes code for performing the method of claim 29 when run on a computer.

32. A method for processing a video data stream, the method comprising: receiving a data stream encoded with an image of a video, and reading, as part of the shift information in the data stream, from the data stream the following as part of the shift information: a count of one or more predetermined sub-regions within the image, a size parameter defining a size of a target image region representing a cubic projection of a panoramic scene, for each of the one or more predetermined sub-regions of the image, a width, a height, a top sample row, and a leftmost sample row of each respective predetermined sub-region in the target region, and another width, another height, another top sample row, and another leftmost sample row of each respective predetermined region within the image, and wherein the shift information allows: deriving the target image region from the image by: shifting each of the one or more predetermined sub-regions of the image according to the width, the height, the top sample row, and the leftmost sample row of each respective predetermined sub-region of the image within the target image and the another width, the another height, the another top sample row, and the another leftmost sample row of each respective predetermined region within the image as read for each respective predetermined sub-region, and filling a portion of the target image region according to preset padding information included in the data stream, wherein none of the one or more predetermined sub-regions of the image is shifted to the portion according to the shift information.

33. The method of claim 32, wherein the set of at least one sub-region of the image is a subset of a gapless and non-overlapping spatial partitioning of the image into an array of sub-regions.

34. The method of claim 32, wherein the shift information includes, for each of the one or more predetermined sub-regions of the image, information about a rotation and information about a mirroring when mapping the respective predetermined sub-region between the target region and the image.

35. The method of claim 32, wherein the data stream has a sequence of images encoded therein, and wherein the shift information is valid for the sequence of images.