Decoder, encoder, method, network device, and readable storage medium

Abstract

A decoder and method of decoding a data stream, an encoder and method of encoding a picture into a data stream, a network device and method, and a computer readable storage medium are provided. The video data stream is provided so as to be able to be reduced, such that the reduction results in a restriction of pictures of the reduced video data stream to predetermined sub-regions that are only pictures of the original video data stream, and transcoding such as re-quantization can be avoided when the reduction is performed, and maintains the compliance of the reduced video data stream relative to the codec at the bottom layer of the original video data stream. This is accomplished by providing the video data stream with information comprising: an indication of a predetermined sub-region; and a replacement index for redirecting an index comprised by the payload portion to refer to the second set of code processing parameter settings and / or a replacement parameter for adjusting the first set of code processing parameter settings to obtain the second set of code processing parameter settings.

Description

[0001] This application is a divisional application of an application with a filing date of February 8, 2017, Chinese application number “202110493099.3”, and invention name “Decoder, encoder, method, network device and readable storage medium”. Technical Field

[0002] The present application relates to video / picture code processing, and more particularly to techniques allowing efficient reduction of such data streams, techniques allowing easier processing of such data streams, and / or techniques allowing more efficient random access to video data streams. Background Art

[0003] There are many video codecs that allow scalability of video data streams without transcoding, i.e., without the need for sequential execution of decoding and encoding. An example of such a scalable video data stream is a data stream that is scalable in terms of, for example, temporal resolution, spatial resolution, or signal-to-noise ratio by simply omitting some enhancement layers of the corresponding scalable video data stream. However, to date, no video codec has allowed computationally uncomplicated scalability in terms of scene segmentation. In HEVC, there are also or have been proposed techniques for limiting HEVC data streams to picture sub-regions, but these techniques are still computationally complex.

[0004] Moreover, depending on the application, the picture content to be encoded into the data stream may be in a form that cannot be effectively encoded within the commonly provided rectangular picture area. For example, the panoramic picture content can be projected onto a two-dimensional plane to form a picture area in a manner such that the projection target (i.e., the space occupied by the panoramic scene on the picture area) is non-rectangular or even non-convex. In that case, more efficient coding of the picture / video data would be advantageous.

[0005] Furthermore, in existing video data streams, random access points are provided in a manner that causes considerable bit rate peaks. In order to reduce the negative impact caused by these bit rate peaks, it may be considered to reduce the time granularity at which these random access points occur. However, this increases the average duration of random access to such video data streams, and therefore, it would be advantageous to have an idea that can solve this problem more effectively. Summary of the invention

[0006] Therefore, it is an object of the present invention to solve the above mentioned problems. According to the present application, this is achieved by the subject matter of the independent claims.

[0007] According to a first aspect of the present application, a video data stream is provided in a manner that enables reduction, such that the reduction results in limiting the pictures of the reduced video data stream to only predetermined subareas of the pictures of the original video data stream, such that transcoding such as requantization can be avoided, and compliance of the reduced video data stream with respect to the codec of the original video data stream is maintained. This is achieved by providing the video data stream with information including: an indication of the predetermined subarea; and a replacement index and / or replacement parameters, the replacement index being used to redirect an index included by a payload portion to refer to a second set of code processing parameter settings, the replacement parameters being used to adjust the first set of code processing parameter settings to obtain the second set of code processing parameter settings. The pictures of the video are encoded into the payload portion of the original video data stream in a manner that uses the first set of code processing parameter settings as parameters, the first set being indexed by an index included by the payload portion. Additionally or alternatively, similar measures are feasible for supplemental enhancement information. Thus, the video data stream may be reduced to a reduced video data stream by performing the following operations: performing a redirection and / or adjustment so that the second set of code processing parameter settings is indexed by an index of the payload portion and is therefore a valid set of code processing parameter settings; removing portions of the payload portion that refer to areas outside the predetermined sub-region of the picture; and changing position indications (such as slice addresses in the payload portion) so that positions are indicated in a manner measured relative to the perimeter of the predetermined sub-region rather than the perimeter of the picture. Alternatively, the data stream that has been reduced so as not to include those portions of the payload portion that refer to areas outside the predetermined sub-region may be modified by real-time adjustment of parameters and / or supplementary enhancement information.

[0008] According to another aspect of the present application, the transmission of picture content is more efficient because the picture content does not need to be shaped or ordered in a predetermined manner, such as filling a rectangular picture area that is generally supported by the underlying codec. Instead, a data stream encoded with pictures is provided, which includes shift information indicating a shift within a target picture area for a set of at least one predetermined subregion of the picture, the shift being relative to the set being copied into the target picture area without distortion or one-to-one or identically. For example, providing such shift information is useful when transmitting a projection of a panoramic scene within a picture when the projection is non-rectangular. The shift information is also effective in cases where the picture content is no longer suitable for transmission within a smaller picture of a reduced video data stream due to data stream reduction (for example, when a panoramic view segment of interest to be transmitted within the reduced video data stream intersects a predicted transition boundary, etc.).

[0009] According to another aspect of the present application, the negative impact of bit rate peaks in a video data stream caused by random access points is reduced by providing two sets of random access points to a video data stream: when encoding a first set of one or more pictures into the video data stream, temporal prediction is interrupted at least within a first picture subregion so as to form a set of one or more first random access points, and when encoding a second set of one or more pictures into the video data stream, temporal prediction is interrupted within a second picture subregion different from the first picture subregion so as to form a set of one or more second random access points. In this way, a decoder seeking to randomly access the video data stream or to restart decoding of the video data stream can select one of the first and second random access points, which first and second random access points can be distributed in time and allow random access at least with respect to the second picture subregion in the case of the second random access point and at least with respect to the first picture subregion in the case of the first random access point. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above techniques can be used together advantageously. In addition, advantageous embodiments are the subject of the dependent claims. Preferred embodiments of the present application are described below with reference to the accompanying drawings, in which:

[0011] Figure 1 A schematic diagram of a video data stream according to an embodiment of the present application related to the first aspect is shown, according to which, with respect to a sub-field of a picture of the video data stream that can be reduced, the video data stream can be reduced to a reduced video data stream;

[0012] Figure 2 The embodiment described in the embodiment Figure 1 A schematic diagram of the interdependence between a payload part and a parameter set part of a reducible video data stream, so as to illustrate parameterization when encoding a picture into a reducible video data stream;

[0013] Figure 3 The embodiment is shown to allow reduction in accordance with Figure 1 A schematic diagram of possible contents of information provided together with a video data stream;

[0014] Figure 4 A schematic diagram showing a network device that receives a video data stream capable of being reduced and derives a reduced video data stream therefrom;

[0015] Figure 5 A schematic diagram illustrating an operation mode for downscaling a video data stream using parameter set redirection according to an embodiment is shown;

[0016] Figure 6A schematic diagram showing a video decoder 82 receiving a reduced video data stream to reconstruct therefrom a picture of the reduced video data stream, the picture of the reduced video data stream showing only a sub-region of a picture of the original video data stream;

[0017] Figure 7 A schematic diagram showing an alternative mode of operation in downscaling a downscalable video data stream, this time using parameter set adjustments that exploit substitutions within information provided with the downscalable video data stream;

[0018] Figure 8 An example of syntax of information that may be provided with a downscalable video data stream is shown;

[0019] Fig. 9 shows an alternative syntax example of information that may be provided with a downscalable video data stream;

[0020] Fig.10 Another example of the syntax of information that may be provided with a downscalable video data stream is shown;

[0021] Fig.11 Another example of the syntax of this information is shown, where this information is used to replace the SEI message;

[0022] Fig.12 An example of a syntax table that can be used to form information related to a multi-layer video data stream is shown;

[0023] Fig.13 shows a schematic diagram according to an embodiment showing the relationship between tiles within a sub-area of ​​a picture within a video data stream capable of being reduced on the one hand and corresponding tiles within a picture of the reduced video data stream on the other hand, thereby illustrating the possibility of spatial rearrangement of these tiles;

[0024] Fig.14 An example of a picture obtained by rectilinear prediction of a panoramic scene is shown;

[0025] Fig.15 An example of a picture carrying picture content corresponding to a cubic projection of a panoramic scene is shown;

[0026] Fig.16 shows that by rearranging the Fig.15 The image that effectively fills the cubic projection content;

[0027] Fig.17 An example of a syntax table for shift information according to an embodiment related to the second aspect of the present application is shown, and a data stream can be provided by using the example of the syntax table;

[0028] Fig.18A schematic diagram illustrating the structure of a video data stream according to an embodiment related to the second aspect of the present application is shown;

[0029] Fig.19 A schematic diagram illustrating possible contents of shift information according to an embodiment is shown;

[0030] Fig. 20 A schematic diagram illustrating an encoder configured to form a data stream including shift information and capable of being reduced at the same time is shown;

[0031] Fig.21 A schematic diagram illustrating a decoder configured to receive a data stream comprising shift information is shown in order to illustrate the possibility of how the shift information can be advantageously used;

[0032] Fig. 22 shows a schematic diagram illustrating a video data stream including sub-region specific random access pictures according to an embodiment related to another aspect of the present application;

[0033] Figure 23a-23e shows a schematic diagram illustrating a possible arrangement of sub-regions used according to different alternatives;

[0034] Fig.24 shows a schematic diagram illustrating a video decoder according to an embodiment, the video decoder being configured to receive a video data stream having sub-region specific random access pictures interspersed therein;

[0035] Fig.25 Shows the description Fig.24 but showing another mode of operation of a video decoder, wherein the video decoder, when randomly accessing a video data stream, does not output or present a video until a picture area of ​​an input video data stream is completely covered by a sub-region of a sub-region-specific random access picture;

[0036] Fig.26 A schematic diagram illustrating a network device receiving a video data stream comprising sub-region-specific random access pictures, the sub-regions of the sub-region-specific random access pictures simultaneously forming sub-areas about which the video data stream can be reduced;

[0037] Fig. 27 A schematic diagram illustrating a network device receiving a data stream having shift information and capable of being downscaled is shown, the schematic diagram being used to illustrate the possibility of how the network device 231 can provide a downscaled video data stream having subdomain-specific shift information;

[0038] Fig.28 An example of disjoint areas of interest for a picture, illustratively a cylindrical panorama, is shown; and

[0039] Fig.29 A syntax table of the TMCTS SEI message of HEVC is shown. DETAILED DESCRIPTION

[0040] The description of the present application relates to the above aspects of the present application. The first aspect of the present application relates to sub-region extraction / reduction of a video data stream. In order to provide background related to this aspect, an application example as the cause of such a demand, problems encountered in meeting this demand, and motivations for overcoming these problems are described below by exemplarily referring to HEVC.

[0041] In HEVC, spatial subsets, i.e., tile sets, can be signaled using the Temporal Motion Constrained Tile Set (TMCTS) SEI message. The tile sets defined in such a message have the following characteristics: "The inter-frame prediction process is constrained so that: in the inter-frame prediction of any sample within the identified tile set, sample values ​​outside each identified tile set are not used, and sample values ​​at fractional sample positions derived using one or more sample values ​​outside the identified tile set are not used." In other words, samples of a TMCTS can be decoded independently of samples in the same layer that are associated with the same TMCTS. A TMCTS comprises one or more rectangular unions of one or more tiles, such as Fig.28 The area of ​​interest 900 viewed by the user includes two non-intersecting image blocks.

[0042] The exact syntax of the TMCTS SEI message is given in Fig.29 Given in for reference.

[0043] There are many applications where it is advantageous to create independently decodable rectangular spatial subsets of a video bitstream, i.e., regions of interest (RoIs), without the burden of heavy processing such as video transcoding. These applications include, but are not limited to:

[0044] ● Panoramic video streaming: Only a specific spatial area of ​​a wide-angle video (e.g., 360° viewing angle) is displayed to the end user through a head-mounted display.

[0045] ●Aspect ratio adjustment streaming: adjust the aspect ratio of the encoded video in real time on the server side according to the display characteristics of the client.

[0046] • Decoding complexity scaling: Low-cost / low-tech devices that are unable to decode a given encoded video bitstream due to level limitations may be able to process a spatial subset of the video.

[0047] With respect to the above list of exemplary applications, a number of problems arise with the prior art described above.

[0048] ● There is no mechanism to make the HRD parameters of a spatial subset of the video bitstream (i.e., buffer

[0049] / timing information) is available to the system layer.

[0050] • There are no conformance points in the video for simply converting a spatial subset of a given video bitstream into a conforming video bitstream.

[0051] ● For the encoder, there is no mechanism to guarantee that a set of tiles with a given identifier can be simply converted into a conforming video bitstream.

[0052] All of the above example applications can be implemented in a standard-compliant manner given solutions to the problems listed. Defining this functionality within the video transcoding layer is expected to be an important compliance point for both the application and system layers.

[0053] The HEVC specification already includes a process for extracting sub-bitstreams that can reduce the temporal resolution or the number of layers of the coded video bitstream, ie, reduce the spatial resolution, signal fidelity or the number of viewing angles.

[0054] The present invention provides solutions to the identified problems and in particular provides the following mechanisms:

[0055] 1. Extract spatial subsets from a coded video sequence (i.e., a single TMCTS-based video bitstream) by defining a TMCTS-based sub-picture extraction process.

[0056] 2. Transmit and identify the correct parameter set values ​​and (optionally) SEI information for the extracted sub-picture video sequence.

[0057] 3. The encoder delivers guarantees on certain bitstream constraints on the video bitstream and TMCTS that allow the extraction of sub-regions.

[0058] The embodiments described below overcome the problems just outlined by providing a video data stream having information that is not required when reconstructing a video picture from the payload portion of the video data stream, including an indication of a predetermined sub-region and a replacement index and / or replacement parameters, the importance and function of which are described in more detail below. The following description is not limited to HEVC or variations of HEVC. Instead, the embodiments described below can be implemented in any video codec technology to provide additional compliance points for such video code processing technology, which additional compliance points are used to provide a reduced sub-region-specific video data stream. Later, it is described in detail how the embodiments described next can be specifically implemented to form an extension of HEVC.

[0059] Figure 1 A video data stream 10 according to an embodiment of the present application is shown. That is, the video data stream can be reduced to a reduced video data stream in a manner that maintains compliance, in which the picture only displays a predetermined sub-region of a picture 12 of a video 14 encoded into the video data stream 10, and no transcoding is required in the reduction, or more precisely, no time-consuming and computationally complex operations such as re-quantization, spatial to spectral transformation and its inverse transformation and / or re-performance of motion estimation are required.

[0060] Figure 1 The video data stream 10 is shown to include a parameter set portion 16 representing the code processing parameter settings 80 and a payload portion 18 into which the pictures 12 of the video 14 are encoded. Figure 1 , portions 16 and 18 are exemplarily distinguished from each other by using hatching for the payload portion 18, while the parameter setting portion 16 is shown without hatching. In addition, portions 16 and 18 are exemplarily shown as being interleaved with each other within the data stream 10, although this is not necessarily the case.

[0061] The pictures 12 of the video 14 are encoded in a particular manner in the payload portion 18. In particular, Figure 1An exemplary predetermined sub-region 22 is shown, and the video data stream 10 has the ability to be reduced to a reduced video data stream with respect to the predetermined sub-region 22. The picture 12 is encoded into the payload portion 18 in such a way that any code processing dependency is restricted to not cross the boundary of the sub-region 22 with respect to the predetermined sub-region 22. That is, a certain picture 12 is coded into the payload portion 18 so that within the sub-region 22, the code processing of the sub-region 22 does not depend on the spatial neighborhood of the region 22 within the picture. In the case where the picture 12 is also encoded into the payload portion 18 using temporal prediction, the temporal prediction can be restricted to the sub-region 22 so that the portion within the sub-region 22 of the first picture of the video 14 does not depend on the region of the reference picture (other pictures) of the video 14 outside the sub-region 22 when coding. That is, the corresponding encoder that produces the video data stream 14 restricts the set of available motion vectors for coding the sub-region 22 so that it does not point to the portion of the reference picture, and the motion compensation prediction signal formed by the portion of these reference pictures requires or involves samples outside the sub-region 22 of the reference picture. With respect to spatial dependencies, it is noted that restrictions on spatial dependencies may relate to spatial prediction of sample-wise spatial prediction, spatial prediction of code processing parameters and code processing dependencies (which may result, for example, from continuous arithmetic code processing spatially across the boundaries of sub-regions 22).

[0062] Thus, a picture 12 is encoded in the payload portion 18, and as described above, its encoding method follows the restrictions on code processing dependencies so as not to involve parts outside the predetermined sub-region 22. The payload portion 18 can therefore consist of a grammatically ordered sequence 24 of syntax elements, which include, for example, motion vectors, picture reference indices, partition information, code processing modes, transform coefficients, residual sample values ​​representing quantized prediction residuals, or one or any combination thereof. However, most importantly, the picture 12 of the video 14 is encoded in the payload portion 18 using a first set 20a of code processing parameter settings 20 as parameters. For example, the code processing parameter settings in the set 20a define, for example, the picture size of the picture 12, such as the vertical height and horizontal width of the picture 12. In order to illustrate how the picture size is taken "as a parameter" when coding the picture 12 into the payload portion 18, briefly refer to Figure 2 . Figure 2A picture size code processing parameter 26 is shown as an example of one of the code processing parameter settings of the set 20a. Obviously, the picture size 26 indicates the size of the picture area that must be "code processed" by the payload portion 18, and it can signal that a corresponding sub-block of a certain picture 12 is not to be code processed and is accordingly filled with predetermined sample values ​​such as zero (which can correspond to black), for example. Therefore, the picture size 26 affects 28 the amount or size 30 of the grammatical description 24 of the payload portion 18. In addition, the picture size 26 affects 28 the position indication 32 within the grammatical description 24 of the payload portion 18, in terms of, for example, the value range of the position indication 32 and the order in which the position indication 32 may appear in the grammatical description 24. For example, the position indication 32 may include a slice address within the payload portion 18. As shown in FIG. Figure 1 As shown, the slice 34 is a component of the data stream 10, for example, the data stream 10 can be transmitted to the decoder in units of slices 34. Each picture 12 can be coded into the data stream 10 in units of such slices 34, wherein the subdivision into slices 34 is performed in a decoding order, which is the order in which the picture 12 is coded into the data stream 10. Each slice 34 corresponds to a corresponding area 36 of the picture 12 and is therefore encoded into the corresponding area 36, ​​wherein the area 36 is inside or outside the sub-area 22, that is, it does not cross the boundary of the sub-area. In this case, each slice 34 can be provided with a slice address, which indicates the position of the corresponding area 36 within the picture area of ​​the picture 12 (that is, relative to the periphery of the picture 12). To give a specific example, the slice address can be measured relative to the upper left corner of the picture 12. Obviously, such a slice address will not exceed a certain value, which exceeds the value of the slice address within the picture with a picture size of 26.

[0063] Similar to the picture size 26, the set 20a of code processing parameter settings may also define a patch structure 38, which is a structure of patches into which the tile 12 may be subdivided. Figure 1An example of a subdivision of the picture 12 into tiles 42 is given using dash-dot lines 40, the subdivision being arranged in a tile array of columns and rows. In the optional case where the picture 12 is encoded into the payload portion 18 by a tile subdivision into tiles 42, this may for example mean that: 1) spatial interdependencies across tile boundaries are not allowed and therefore not used, 2) the decoding order in which the picture 12 is coded into the data stream 10 is traversed in a raster scan tile order, i.e., each tile is traversed before accessing the next tile in the tile order. Thus, the tile structure 38 affects 28 the decoding order 44 in which the picture 12 is encoded into the payload portion 18, and therefore affects the syntax description 24. Similar to the picture size 26, the tile structure 38 also affects 28 the position indication 32 within the payload portion 18, i.e., affects the order in which different instances of the position indication 32 are allowed to appear within the syntax description 24.

[0064] The code processing parameter settings of the set 20a may also include a buffer timing 46. For example, the buffer timing 46 may be a buffer removal time for a signal code processing picture, at which time certain portions of the data stream 10 (e.g., a single slice 34 or a portion of the data stream 10 that references one picture 12) are removed from the code processing picture buffer of the decoder, and these time values ​​affect 28 or relate to the size of the corresponding portion within the data stream 10, so that the buffer timing 46 also affects 28 the amount / size 30 of the payload portion 18.

[0065] That is to say, Figure 2 As illustrated in the description, the set 20a of code processing parameter settings is used "as a parameter" or "described" when encoding the picture 12 into the payload portion 18, in the sense that any non-compliance between the set 20a of code processing parameter settings 20 and the payload portion 18 and its grammatical description 24 will be identified as a violation of the compliance requirement, which is a requirement that must be followed for any data stream to be identified as a compliant data stream.

[0066] The first set 20a of code processing parameter settings is referenced or indexed by an index 48 included in the payload portion 18 and interspersed or included in the syntax description 24. For example, the index 48 may be included in a slice header of the slice 34.

[0067] Although the indexed set 20a of code processing parameter settings may be modified in conformance with the payload portion 18 or in conjunction with the payload portion 18 such that portions of the payload portion 18 that do not belong to the sub-region 22 are eliminated and such that the resulting reduced data stream remains conformant, Figure 1Although this associated modification of both the code processing parameter settings within the indexed set 20a and the payload portion 18 does not require a detour through a complete decoding and encoding execution, the computational overhead required to perform this associated modification still requires considerable parsing steps, etc.

[0068] therefore, Figure 1 An embodiment of the invention follows another approach, according to which the video data stream 10 comprises (i.e. is provided with) information 50, which is not necessary for reconstructing the video picture 12 from the payload portion 18, and which comprises an indication of a predetermined sub-region and a replacement index and / or a replacement parameter. For example, the information 50 may indicate the predetermined sub-region 22 in terms of its position within the picture 12. For example, the information 50 may indicate the position of the sub-region 22 in units of tiles. Thus, the information 50 may identify a set of tiles 42 within each picture to form the sub-region 22. The set of tiles 42 within each picture 12 may be fixed between pictures 12, i.e., the tiles forming the sub-region 22 within each picture 12 may be located at the same position as each other, and the tile boundaries of these tiles forming the sub-region 22 may coincide spatially between different pictures 12. It should be mentioned that the set of tiles is not limited to forming a continuous rectangular tile sub-array of pictures 12. However, non-overlapping and gap-free adjacencies of the tiles forming the sub-regions 22 within each picture 12 may exist, such gap-free and non-overlapping adjacencies or adjoining forming rectangular areas. However, naturally, the indication 50 is not limited to indicating the sub-regions 22 in units of tiles. It should be remembered that, in any case, the use of tile subdivisions of the pictures 12 is merely optional. For example, the indication 50 may indicate the sub-regions 22 in units of samples or by some other means. In a further embodiment, the position of the sub-regions 22 may even form default information, which is known to the participating network devices and decoders that are intended to process the video data stream 10, wherein the information 50 only indicates the reducibility of the sub-region 22 or the existence of the sub-region 22. As described above and as Figure 3 As shown, in addition to the indication 52 of the predetermined sub-region, the information 50 also includes a replacement index 54 and / or a replacement parameter 56. The replacement index and / or the replacement parameter are used to change the indexed set of code processing parameter settings (i.e., the set of code processing parameter settings indexed by the index within the payload portion 18) so that the indexed set of code processing parameter settings is suitable for the payload portion of the reduced video data stream, in which the payload portion 18 has been modified in the following way: those parts related to the parts of the picture 12 outside the sub-region 22 are removed, and the position indication 32 is changed to be related to the periphery of the sub-region 22 instead of the periphery of the picture 12.

[0069] To clearly describe the latter case, reference is made to a diagram showing a network device 60. Figure 4 The network device 60 is configured to receive and process according to Figure 1 The video data stream 10 is converted into a reduced video data stream 62 in order to derive therefrom a reduced video data stream 62. The term "reduced" in the "reduced video data stream" 62 shall mean two things, namely first, that the reduced video data stream 62 corresponds to a lower bit rate than the video data stream 10 and second, that the pictures encoded in the reduced video data stream 62 are smaller than the pictures 12 of the video data stream 10, since the smaller pictures of the reduced video data stream 62 only show a sub-region 22 of the picture 12.

[0070] To accomplish the tasks as described in more detail below, the method apparatus 60 includes a reader 64 configured to read information 50 from the data stream 10 and a reducer 66 that performs a reduction or extraction process based on the information 50 in a manner described in more detail below.

[0071] Figure 5 The function of the network device 60 in the exemplary case of using the replacement index 54 in the information 50 is shown. In particular, as Figure 5 As shown, the network device 60 uses, for example, the information 50 in order to remove 68 a portion 70 from the payload portion 18 of the data stream 10, which portion 70 is not associated with the sub-region 22, i.e., which portion 70 refers to a region of the picture 12 outside the sub-region 22. For example, the removal 68 can be performed on a slice basis, wherein the reducer 66 identifies those slices 34 within the payload portion 18 that are not associated with the sub-region 22 based on the position indication or the slice address within the slice header of the slice 34 on the one hand and the indication 52 within the information 50 on the other hand.

[0072] exist Figure 5 In the example of FIG. 5 , the information 50 carries a replacement index 54, and the parameter set portion 16 of the video data stream 10 carries, in addition to the indexed set 20a of the code processing parameter settings, a non-indexed set 20b of the code processing parameter settings, which set 20b is not referenced or indexed by the index 48 in the payload portion 18. When performing the reduction, the reducer 66 replaces the index 48 in the data stream 10 (in Figure 5 An alternative is exemplarily shown in Figure 5 The replacement is shown in FIG. 5 using a curved arrow 72. By replacing the index 48 with the replacement index 54, a redirection 72 occurs, according to which the index included in the payload portion of the reduced video data stream 62 references or indexes the second set 20b of code processing parameter settings, so that the first set 20a of code processing parameter settings becomes non-indexed. Thus, the redirection 72 may also include the reducer 66 removing 74 from the parameter set portion 16 the no longer indexed set 20a of code processing parameter settings.

[0073] The reducer 66 also changes the position indication 32 within the payload portion 18 so as to be measured relative to the perimeter of the predetermined sub-region 22. This change Figure 5 7, whereby a change of only one position indication 32 from the data stream 10 to the reduced video data stream 62 is schematically indicated by showing the position indication 32 in the reduced video data stream 62 in a cross-hatched manner and showing the position indication 32 in the data stream 10 in an unshaded manner.

[0074] Therefore, in summary Figure 5 , the network device 60 is able to obtain the reduced video data stream 62 in a manner involving only relatively low complexity. The tedious task of correctly adjusting the set of code processing parameter settings 20b so as to correctly parameterize or adapt the amount / size 30, the position indication 32 and the decoding order 44 of the payload portion 18 of the reduced video data stream 62 may have been performed elsewhere, for example within the encoder 80, which is performed by using Figure 1 Another approach is to change the order between the evaluation of the information 50 and the reduction by the reducer 66, as described further below.

[0075] Figure 6 The reduced video data stream 62 is shown being fed to a video decoder 82 in order to illustrate that the reduced video data stream 62 has encoded therein a video 84 in which a smaller picture 86 is encoded, the size of which is smaller than the picture 12 and only a sub-region 22 thereof is shown. Thus, the video decoder 82 decodes the reduced video data stream 62, thereby producing a reconstruction of the video 84. Figure 5 As explained, the downscaled video data stream 62 has a downscaled payload portion 18 in which a smaller picture 86 has been encoded, the encoding being parameterized or described accordingly by the second set of code processing parameter settings 20b.

[0076] The video encoder 80 may, for example, encode the picture 12 into the video data stream 10 while complying with the above description in connection with the sub-region 22. Figure 1 The encoder 80 may perform the encoding using, for example, an optimization of an appropriate rate-distortion optimization function. As a result of the encoding, the payload portion 18 indexes the set 20a. In addition, the encoder 80 generates the set 20b. To this end, the encoder 80 may, for example, adjust the picture size 26 and the patch structure 38 relative to their values ​​in the set 20a so as to correspond to the size of the sub-region 22 and the set of patches occupied. Apart from this, the encoder 80 itself will essentially perform the same operations as described above with respect to Figure 5The explained downscaling process calculates the buffer timing 46 so as to enable a decoder such as the video decoder 82 to correctly manage its transcoding picture buffer using the thus calculated buffer timing 46 within the second set 20b of transcoding parameter settings.

[0077] Figure 7 An alternative mode of operation of the network device is shown, namely, the case where the replacement parameters 56 in the information 50 are used. According to this alternative, Figure 7 , the parameter set portion 16 comprises only the indexed set 20a of the code processing parameter settings, so that there is no need for the reindexing or redirection 72 and the set removal 74 to be performed by the reducer 66. However, instead of these operations, the reducer 66 uses the replacement parameters 56 obtained from the information 50 in order to adjust 88 the indexed set 20a of the code processing parameter settings into the set 20b of the code processing parameter settings. Even according to this alternative, the reducer 66 that performs steps 68, 78 and 88 in order to derive the reduced video data stream 62 from the original video data stream 10 does not have relatively complex operations.

[0078] In other words, Figure 7 In the case of , the replacement parameters 56 may, for example, include one or more of the picture size 26 , the tile structure 38 , and / or the buffer timing 46 .

[0079] about Figure 5 and 7 It should be noted that there may also be a hybrid of the two alternatives, where the information 50 includes both replacement indices and replacement parameters. For example, the code processing parameter settings that undergo a change from set 20a to set 20b may be distributed over different parameter set slices (e.g. SPS, PPS, VPS, etc.) or included in different parameter set slices. Thus, for different slices of these slices, for example, a change according to Figure 5 or Figure 7 different treatments.

[0080] With regard to the task of changing 78 the position indication, it should be noted that this task must be performed relatively often, for example for each payload slice of the slices 34 within the payload portion 18, but the calculation of the new replacement value of the position indication 32 is relatively uncomplicated. For example, the position indication may indicate the position by means of a horizontal coordinate and a vertical coordinate, and the change 78 may calculate the new coordinates of the position indication, for example by forming a subtraction between the original position indication 32 and the corresponding coordinates of the data stream 10 and the offset of the sub-region 22 relative to the upper left corner of the picture 12. Alternatively, the position indication 32 may indicate the position using some linear metric, for example, which follows the above-mentioned decoding order in some suitable units, for example in units of coded blocks (such as tree root blocks), where the picture 12 is regularly divided into rows and columns. In this case, the position indication will be recalculated in step 78, while only considering the code processing order of these code blocks within the sub-region 22. In this regard, it should also be noted that the reduction / extraction process just outlined for forming the reduced video data stream 62 from the video data stream 10 is also suitable for forming the reduced video data stream 62 in the following manner: smaller pictures 86 of the video 84 coded into the reduced video data stream 62 show the segments 22 in a spatially spliced ​​manner, and the same picture content of the pictures 84 can be located in sub-areas 22 within the picture 12 in different spatial arrangements.

[0081] about Figure 6 , it should be noted that Figure 6 The video decoder 82 shown in may or may not be able to decode the video data stream 10 in order to reconstruct therefrom the pictures 12 of the video 14. The reason why the video decoder 82 cannot decode the video data stream 10 may be that the profile level of the video decoder 82 is, for example, sufficient to cope with the size and complexity of the reduced video data stream 62, but may not be sufficient to decode the original video data stream 10. However, in principle, due to the appropriate adjustment of the indexed set of code processing parameter settings by re-indexing and / or parameter adjustment as described above, both the data streams 62 and 10 conform to one video codec.

[0082] Having described fairly general embodiments regarding video stream reduction / extraction of a sub-region of a picture of a video data stream to be reduced, the above description of the motivations and problems associated with such extraction for HEVC will be continued below in order to provide specific examples for implementing the above embodiments.

[0083] 1. Signaling aspects of single-layer sub-domains

[0084] 1.1. Parameter set:

[0085] When extracting a spatial subset, the following parameter set aspects need to be adjusted:

[0086] ●VPS: No specification information for single-layer code processing

[0087] ●SPS:

[0088] ■Level Information

[0089] ■Image size

[0090] ■ Clipping or compliance window information

[0091] ■Buffering and timing information (i.e. HRD information)

[0092] ■ Possibly further Video Usability Information (VUI) items, such as motion_vectors_over_pic_boundaries_flag, min_spatial_segmentation_idc

[0093] ●PPS:

[0094] ■ Spatial segmentation information, ie, tile partitioning information regarding the number and size of tiles in horizontal and vertical directions.

[0095] Signaling Example

[0096] ● Signaling 1A: The encoder may send additional unused (i.e., never activated) VPSs for each TMCTS in-band (i.e., as corresponding NAL units),

[0097] SPS and PPS, and the mapping to TMCTS is provided in the Supplemental Enhancement Information (SEI) message.

[0098] Example syntax / semantics for signaling 1A SEI are in Figure 8 Shown in.

[0099] Syntax elements 90 are optional as they may be derived from the picture parameter set identifier.

[0100] The semantics are provided below.

[0101] num_extraction_information_sets_minus1 indicates the number of information sets contained in a given SignalingIA SEI to be applied in the sub-picture extraction process.

[0102] num_applicable_tile_set_identifiers_minus1 indicates the number of values ​​of mcts_id of the tile set to which the subsequent i-th information set is applied for the sub-picture extraction process.

[0103] mcts_identifier[i][k] represents the value of all num_applicable_tile_set_identifers_minus1 plus 1 of the mcts_id of the tile set to which the subsequent i-th information set is applied for the sub-picture extraction process.

[0104] num_mcts_pps_replacements[i] represents the number of pps identifier replacement signaling in the signaling 1A SEI for tilesets with mcts_id equal to mcts_id_map[i].

[0105] mcts_vps_id[i] indicates that the mcts_vps_idx[i]th video parameter set will be used for the patch set with mcts_id equal to mcts_id_map[i] in the sub-picture extraction process.

[0106] mcts_sps_id[i] indicates that the mcts_sps_idx[i]th sequence parameter set will be used for the patch set with mcts_id equal to mcts_id_map[i] in the sub-picture extraction process.

[0107] mcts_pps_id_in[i][j] represents the j-th value of the num_mcts_pps_replacements[i] pps identifier in the slice header syntax structure of the tile set with mcts_id equal to mcts_id_map[i] to be replaced in the sub-picture extraction process.

[0108] mcts_pps_id_out[i][j] represents the jth value of the num_mcts_pps_replacements pps identifier in the slice header syntax structure of the tileset with mcts_id equal to mcts_id_map[i] to be replaced with the pps identifier equal to the value mcts_pps_id_in[i][j] during sub-picture extraction.

[0109] ● Signaling 1B: The encoder can send VPS, SPS, and PPS for each TMCTS, and can send a map to the TMCTS, all of which are contained in the containerized SEI.

[0110] Example syntax / semantics for signaling 1B SEI are in Fig. 9 Shown in.

[0111] The yellow syntax elements 92 are optional as they can be derived from the picture parameter set identifier.

[0112] The semantics are as follows:

[0113] num_vps_in_message_minus1 indicates the number of vps syntax structures in a given signaling 1B SEI to be used in the sub-picture extraction process.

[0114] num_sps_in_message_minus1 indicates the number of sps syntax structures in a given signaling 1B SEI to be used in the sub-picture extraction process.

[0115] num_pps_in_message_minus1 indicates the number of pps syntax structures in a given signaling 1B SEI to be used in the sub-picture extraction process.

[0116] num_extraction_information_sets_minus1 indicates the number of information sets contained in a given signaling 1B SEI to be applied in the sub-picture extraction process.

[0117] num_applicable_tile_set_identifiers_minus1 indicates the number of values ​​of mcts_id of the tile set to which the subsequent i-th information set is applied for the sub-picture extraction process.

[0118] mcts_identifier[i][k] represents the value of all num_applicable_tile_set_identifers_minus1 plus 1 of the mcts_id of the tile set to which the subsequent i-th information set is applied for the sub-picture extraction process.

[0119] mcts_vps_idx[i] indicates that the mcts_vps_idx[i]th video parameter set notified in signaling 1B_SEI is to be used for the patch set with mcts_id equal to mcts_id_map[i] in the sub-picture extraction process.

[0120] mcts_sps_idx[i] indicates that the mcts_sps_idx[i]th sequence parameter set notified in signaling 1B SEI is to be used for the patch set with mcts_id equal to mcts_id_map[i] in the sub-picture extraction process.

[0121] num_mcts_pps_replacements[i] represents the number of pps identifier replacement signaling in the signaling 1B SEI for tilesets with mcts_id equal to mcts_id_map[i].

[0122] mcts_pps_id_in[i][j] represents the j-th value of the num_mcts_pps_replacements[i] pps identifier in the slice header syntax structure of the tile set with mcts_id equal to mcts_id_map[i] to be replaced in the sub-picture extraction process.

[0123] mcts_pps_idx_out[i][j] indicates that during the sub-picture extraction process, the picture parameter set with the pps identifier equal to mcts_pps_id_in[i][j] is to be replaced with the mcts_pps_idx_out[i][j]th notified picture parameter set in the signaling 1C SEI.

[0124] • Signaling 1C: The encoder may provide parameter set information associated with the TMCTS that cannot be derived (essentially additional buffering / timing (HRD) parameters) within the SEI and a mapping to the applicable TMCTS.

[0125] Example syntax / semantics for signaling IC SEI are in Fig.10 Shown in.

[0126] The HRD information in the following SEI is structured in such a way that the extraction process can replace consecutive blocks of syntax elements in the original VPS with corresponding consecutive blocks of syntax elements from the SEI.

[0127] num_extraction_information_sets_minus1 indicates the number of information sets contained in a given signaling 1C SEI to be applied in the sub-picture extraction process.

[0128] num_applicable_tile_set_identifiers_minus1 indicates the number of values ​​of mcts_id of the tile set to which the subsequent i-th information set is applied for the sub-picture extraction process.

[0129] mcts_identifier[i][k] represents the value of all num_applicable_tile_set_identifers_minus1 plus 1 of the mcts_id of the tile set to which the subsequent i-th information set is applied for the sub-picture extraction process.

[0130] mcts_vps_timing_info_present_flag[i] equal to 1 specifies that mcts_vps_num_units_in_tick[i], mcts_vps_time_scale[i], mcts_vps_poc_proportional_to_timing_flag[i], and mcts_vps_num_hrd_parameters[i] are present in the VPS. mcts_vps_timing_info_present_flag[i] equal to 0 specifies that mcts_vps_num_units_in_tick[i], mcts_vps_time_scale[i], mcts_vps_poc_proportional_to_timing_flag[i], and mcts_vps_num_hrd_parameters[i] are not present in the signaling IC SEI.

[0131] mcts_vps_num_units_in_tick[i] is the i-th time unit of a clock operating at a frequency of mcts_vps_time_scale Hz, which corresponds to one increment of the clock tick counter (called a clock tick). The value of mcts_vps_num_units_in_tick[i] should be greater than 0. The clock tick in seconds is equal to the quotient of mcts_vps_num_units_in_tick divided by mcts_vps_time_scale. For example, when the picture rate of the video signal is 25 Hz, mcts_vps_time_scale can be equal to 27000000 and mcts_vps_num_units_in_tick can be equal to 1080000, so the clock tick can be 0.04 seconds.

[0132] mcts_vps_time_scale[i] is the i-th time unit that elapses in one second. For example, the vps_time_scale of a time coordinate system that measures time using a 27MHz clock is 27000000. The value of vps_time_scale should be greater than 0.

[0133] mcts_vps_poc_proportional_to_timing_flag[i] equal to 1 indicates that the picture order count value of each picture in the CVS that is not the first picture in the CVS in decoding order is proportional to the output time of the picture relative to the output time of the first picture in the CVS. mcts_vps_poc_proportional_to_timing_flag[i] equal to 0 indicates that the picture order count value of each picture in the CVS that is not the first picture in the CVS in decoding order may or may not be proportional to the output time of the picture relative to the output time of the first picture in the CVS.

[0134] mcts_vps_num_ticks_poc_diff_one_minus1[i] plus 1 specifies the number of clock ticks corresponding to the difference in the picture order count value equal to 1. The value of mcts_vps_num_ticks_poc_diff_one_minus1[i] shall be between 0 (inclusive) and 2. 32 -2 (inclusive).

[0135] mcts_vps_num_hrd_parameters[i] specifies the number of hrd_parameters() syntax structures present in the i-th entry of the signaling 1C SEI. The value of mcts_vps_num_hrd_parameters shall be in the range of 0 (inclusive) to vps_num_layer_sets_minus1+1 (inclusive).

[0136] mcts_hrd_layer_set_idx[i][j] specifies the index of the layer set in the layer set list specified by the VPS of the i-th entry in the signaling 1C SEI, which is the layer set to which the j-th hrd_parameters() syntax structure in the signaling 1C SEI applies and is the layer set to be used in the sub-picture extraction process. The value of mcts_hrd_layer_set_idx[i][j] should be in the range of (vps_base_layer_internal_flag?0:1) (inclusive) to vps_num_layer_sets_minus1 (inclusive). A requirement for bitstream compliance is that for any value of j not equal to k, the value of mcts_hrd_layer_set_idx[i][j] should not be equal to the value of hrd_layer_set_idx[i][k].

[0137] mcts_cprms_present_flag[i][j] equal to 1 specifies that the HRD parameters common to all sublayers are present in the jth hrd_parameters() syntax structure of the i-th entry of the signaling 1C SEI. mcts_cprms_present_flag[i][j] equal to 0 specifies that the HRD parameters common to all sublayers are not present in the i-th hrd_parameters() syntax structure of the i-th entry of the signaling 1C SEI and are inferred to be the same as the (i-1)th hrd_parameters() syntax structure of the i-th entry of the signaling 1C SEI. mcts_cprms_present_flag[i][0] is inferred to be equal to 1.

[0138] Since the above HRD information is related to the VPS, the signaling of similar information of the SPS VUI HRD parameters can be implemented in the same way, for example, by extending the above SEI or as a separate SEI message.

[0139] It is worth noting that other embodiments of the present invention may use the mechanisms employed by signaling 1A, 1B and 1C in other bitstream syntax structures (eg, VUI) or as extensions to parameter sets.

[0140] 1.2.SEI message

[0141] The presence of any of the following SEI messages in the original video bitstream may require adjustments to the mechanism to avoid discontinuities after TMCTS extraction:

[0142] ●HRD related buffering period, picture timing and decoding unit information SEI

[0143] ●PanScan SEI

[0144] ●*FramePackingArrangement*SEI

[0145] DecodedPictureHash SEI

[0146] ●TMCTS SEI

[0147] Signaling Example:

[0148] ● Signaling 2A: For all TMCTSs, the encoder can provide suitable replacements for the above SEIs in the container SEI associated with the TMCTS. This signaling can be combined with the embodiment in signaling 1C and Fig.11In other words, in addition to or in lieu of the above description, the video data stream 10 representing the video 14 may include: a payload portion 18, into which the picture 12 of the video is coded; and a supplementary enhancement information message indicating supplementary enhancement information matching the payload portion 18, more precisely, indicating the manner in which the picture 12 of the video is coded into the payload portion 18, the video data stream also includes information 50, the information 50 including: an indication 52 of a predetermined sub-region 22 of the picture 12; and a replacement supplementary enhancement information message for replacing the supplementary enhancement information message, wherein the replacement supplementary enhancement information message is selected so that the reduced video data stream 62 has a reduced payload portion, the reduced video data stream 62 having a reduced payload portion. The video data stream 62 is modified as compared to the video data stream by removing 68 a portion 70 of the payload portion 18 that refers to an area outside the predetermined sub-region 22 of the picture 12, and changing 78 a position indication 32 in the payload portion 18 so as to indicate a position measured relative to the perimeter of the predetermined sub-region 22 rather than the perimeter of the picture 12, and in the reduced payload portion a sub-region-specific picture 86 showing the predetermined sub-region 22 of the picture is encoded in such a way that: the replacement supplementary enhancement information message indicates replacement supplementary enhancement information matching the reduced payload portion, i.e., indicates a way to transcode the sub-region-specific picture 86 into the reduced payload portion 18. In addition to or as an alternative to the above-mentioned parameter generation, the parameter setter 80a will generate a supplementary enhancement information message that is a potential replacement object for replacement by the replacement SEI message. In addition to or as an alternative to the above-mentioned redirection and / or adjustment, the replacement will be performed by the network device 60.

[0149] all_tile_sets_flag equal to 0 specifies that for all tilesets defined in the bitstream, the list applicable_mcts_id[0] is specified by wapplicable_mcts_id[i]. all_tile_sets_flag equal to 1 specifies that the list applicable_mcts_id[0] includes all values ​​of nuh_layer_id present in the current access unit that are greater than or equal to the nuh_layer_id of the current SEI NAL unit, in increasing order of value.

[0150] tile_sets_max_temporal_id_plus1 minus 1 indicates the maximum temporal level to be extracted in the sub-picture extraction process for the tile set whose mcts_id is equal to the element of the array applicable_mcts_id[i].

[0151] nnm_applicable_tile_set_identifiers_minus1 plus 1 specifies the number of applicable mcts ids of the following SEI message that should be used in the sub-picture extraction process.

[0152] mcts_identifier[i] represents the value of all num_applicable_tile_set_identifiers_minus1 of mcts_id. When the corresponding tile set with mcts_id equal to applicable_mcts_id[i] is extracted using the sub-picture extraction process for tilesets, the following SEI message should be inserted.

[0153] 2. Sub-image extraction and processing:

[0154] The extraction process details obviously depend on the signaling scheme applied.

[0155] Constraints on tile settings and TMCTS SEI (particularly the extracted TMCTS) must be made to ensure compliant output.The presence of any of the above signaling embodiments in the bitstream represents a guarantee that the encoder obeys the constraints made below during the creation of the video bitstream.

[0156] enter:

[0157] ●Bitstream.

[0158] ●Target MCTS identifier MCTSIdTarget.

[0159] ●Target layer identifier list layerIdListTarget.

[0160] Constraints or bitstream requirements:

[0161] ●tiles_enabled_flag is equal to 1.

[0162] ●num_tile_columns_minus1>0||num_rows_minus1>0.

[0163] - A TMCTS SEI message with mcts_id[i] equal to MCTSIdTarget is present and associated with all pictures to be output.

[0164] ●TMCTS with mcts_id[i] equal to MCTSIdTarget exists in the TMCTS SEI.

[0165] • The appropriate tier of the TMCTS with mcts_id[i] equal to MCTSIdTarget must be signaled via the TMCTS SEI syntax elements mcts_tier_level_idc_present_flag[i], mcts_tier_idc[i], mcts_level_idc[i] or one of the signalling variants 1A or 1B described above.

[0166] ●The HRD information of TMCTS is present in the bitstream via one of the signaling variants 1A, 1B or 1C.

[0167] ● All rectangles in a TMCTS with mcts_id[i] equal to MCTSIdTarget have equal height or equal width or both in terms of luma samples.

[0168] deal with:

[0169] - Remove all patch NALUs that are not in the patch set associated with mcts_id[i] equal to MCTSIdTarget.

[0170] ●Replace / adjust parameter set according to signaling 1X.

[0171] ●Adjust the remaining NALU slice headers according to the following

[0172] ○ Adjust slice_segement_address and first_slice_segment_in_pic_flag to create a common picture plane from all rectangles in the tileset.

[0173] ○ If necessary, adjust pps_id

[0174] ●Remove SEI, or replace SEI if signaling 2A exists.

[0175] As an alternative embodiment, the above constraints or bitstream requirements as part of the extraction process may take the form of dedicated signaling within the bitstream (eg, a separate SEI message or VUI indication), the presence of which is required by the extraction process.

[0176] 2. Multi-layer

[0177] In some cases, layered codecs may be of interest, for example, to provide different qualities for each domain. It may be of interest to provide larger spatial regions at lower layer qualities in case the user needs them, or some specific regions of wide-angle video that are not available in higher layers, and that content may be available in lower layers for upsampling and presentation together with higher layer content. The extent to which the lower layer video domain should be allowed to extend the higher layer video domain varies depending on the use case.

[0178] In addition to the described TMCTS SEI, in the hierarchical extension of the HEVC specification (i.e., Annex F), an Inter-Layer Constraint Tile Set (ILCTS) SEI message is specified, which indicates constraints of similar nature for inter-layer prediction. For reference, the syntax table is in Fig.12 Given in.

[0179] Therefore, as another part of the present invention, an extraction process similar to that described above is implemented for a layered coded video bitstream taking into account the additional information.

[0180] In the case of considering the signaling aspects for multi-layer sub-pictures, the main difference between the signaling and processing disclosed above is that the target data portion of the bitstream is no longer identified by a single value of the mcts_id identifier. Instead, the identifier of the layer set, the multiple identifiers of the TMCTS within each included layer (if applicable), and the corresponding ILCTS identifiers between the included layers (if applicable) form a multi-dimensional vector identifying the target portion of the bitstream.

[0181] • An embodiment of the present invention is a variant of the single layer signalling 1A, 1B, 1C and 2A disclosed above, wherein the syntax element mcts_identifier[i][k] is replaced by the described multi-dimensional identifier vector.

[0182] Furthermore, the encoder constraints or bitstream requirements are extended as follows.

[0183] 2.2. Extraction processing:

[0184] enter:

[0185] ●Multi-dimensional identifier vector, including:

[0186] ●Target layer set layerSetIdTarget

[0187] ● The target layer TMCTS identifier MCTSIdTargetLx, at least for the highest layer in the layer set with the identifier layerSetIdTarget

[0188] ● Target ILCTS identifier LTCTSIdTargetLxrefLy, corresponding to

[0189] Bitstream

[0190] Bitstream requirements:

[0191] In addition to what is defined for the single-layer case:

[0192] o For any used reference layer Ly contained in the bitstream and layer set layerSetIdTarget, there is a TMCTS SEI message with mcts_id[i] equal to MCTSIdTarget_Lx for the corresponding layer Lx and an ILCTS SEI message with ilcts_id[i] equal to ILTCTSIdTarget_Lx_refLy is present in the corresponding layer Lx

[0193] In order to exclude the presence of missing reference samples in the extracted bitstream portion, the TMCTS and ILCTS defining the bitstream portion must also satisfy the following constraints.

[0194] o For each referencing layer A whose patch set tsA is associated with mcts_id[i] equal to MCTSIdTarget_LA: the patches in layer A constituting tsA are the same patches associated with the patch set with ilcts_id[i] equal to ILTCTSIdTarget_LA_refLy.

[0195] o For each referenced layer B whose patch set tsB is associated with mcts_id[i] equal to MCTSIdTarget_LB: the patches in layer B constituting tsB are fully contained in the associated reference patch set indicated by ilcts_id[i]ILCTSIdTarget_Lx_refLB.

[0196] deal with

[0197] Per layer x: remove all patch NAL units that are not in the patch set with mcts_id[i] identifier MCTSIdTarget_Lx.

[0198] Before turning to the next aspect of the present application, a brief description is given of the above-mentioned possibility that the sub-region 22 may be composed of a set of patches, the relative positions of which within the image 12 may be different from the relative positions of these patches within a smaller image 86, which is a picture of the video 84 represented by the reduced video data stream 62.

[0199] Fig.13 The picture 12 is shown subdivided into a tile array 42 enumerated using uppercase letters A to I in decoding order. For illustration purposes only, Fig.13Exemplarily, only one picture is shown and is subdivided into 3×3 patches 42. It is assumed that the picture 12 is transcoded into the video data stream 10 in such a way that transcoding dependencies do not cross patch boundaries 40, and that transcoding dependencies limited in this way include not only intra-picture spatial interdependencies but also, for example, temporal independence. Thus, a patch 42 within the current picture depends only on co-located patches within itself or any previously transcoded / decoded picture (i.e., temporal reference picture).

[0200] In this case, the sub-region 22 may, for example, consist of a non-contiguous set of tiles 42, such as the set of tiles {D, F, G, I}. Due to the mutual independence, the picture 86 of the video 84 may display the sub-region 22 in such a way that the participating tiles are spatially arranged in a different manner within the picture 86. This is Fig.13 4 shows that the picture 86 is also encoded into the reduced video data stream 62 in units of blocks 42, but the blocks forming the sub-region 22 in the picture 12 are spatially arranged in another relative position to each other in the picture 86. Fig.13 In the example of 86, tiles 42 forming sub-region 22 occupy tiles on opposite sides of picture 12, as if picture 12 showed a horizontal panorama, so that the tiles at these opposite sides actually show adjacent parts of the panoramic scene. However, in picture 86, the tiles in each tile row have swapped positions relative to their relative positions in picture 12. That is, for example, compared to the mutual horizontal positioning of tiles D and F in picture 12, tile F appears on the left hand side relative to tile D.

[0201] Before moving on to the next aspect of the present application, it should be noted that it is not necessary to encode the patch 42 or segment 22 into the picture 12 in the manner described above (constraining the code processing dependency to not cross its boundaries). Naturally, such a restriction mitigates the disadvantages of the video data stream reduction / extraction techniques outlined above, but such code processing dependencies tend to affect only small edge portions along the boundaries of the sub-regions 22 / patch 42, where distortion may be acceptable, depending on the application.

[0202] It should also be noted that the above embodiments so far provide the possibility of extending an existing video codec in such a way that the compliance point is newly included, i.e. the possibility of reducing the video stream to a reduced video stream related to the sub-region 22 of the original picture 12 only while maintaining compliance, for which the information 50 is exemplarily hidden in an SEI message, a VUI or a parameter set extension (i.e. a portion of the original video data stream that the decoder can skip if it likes it or not). However, as an alternative, the information 50 can also be transmitted in a portion that is a normative part within the video data stream. That is, a new video codec can be set up in such a way that the compliance point is included from the beginning.

[0203] In addition, for the sake of completeness, another specific implementation example for the above-mentioned embodiment is described, which shows the possibility of extending the HEVC standard in a way that implements the above-mentioned embodiment. To this end, a new SEI message is provided. In other words, a modification to the HEVC specification is described that enables the extraction of a motion constrained patch set (MCTS) as a separate HEVC-compliant bitstream. Two SEI messages are used and described below.

[0204] The first SEI message, the MCTS Extraction Information Set SEI message, provides the syntax for carrying MCTS-specific replacement parameter sets and defines the extraction process in the semantics. The second SEI message, the MCTS Extraction Information Nesting SEI message, provides the syntax for MCTS-specific nested SEI messages.

[0205] Therefore, in order to include these SEI messages into the HEVC framework, the general SEI message syntax of HEVC is modified to include a new type of SEI message:

[0206]

[0207] Thus, the list SingleLayerSeiList is set to consist of payloadType values ​​3, 6, 9, 15, 16, 17, 19, 22, 23, 45, 47, 56, 128, 129, 131, 132, and 134 to 153 (inclusive of 134 and 153). Similarly, the lists VclAssociatedSeiList and PicUnitRepConSeiList will be extended by the type numbers 152 and 153 of the new SEI messages, which numbers are of course chosen only for illustration purposes.

[0208] Table D.1 (Persistent scope of SEI messages) of HEVC will also include a hint for the new SEI messages:

[0209] SEI news Persistence Scope MCTS extracts information set CLVS including SEI message MCTS extracts information embedding Access unit including SEI message

[0210] Their syntax can be as follows. The MCTS extraction information set SEI message syntax can be designed as:

[0211]

[0212]

[0213] In terms of semantics, the MCTS extract information set SEI message is an example of information 50 using replacement parameters 56 .

[0214] The MCTS extraction information set SEI message provides supplementary information to perform sub-bitstream MCTS extraction as described below to derive an HEVC-compliant bitstream from a motion-constrained patch set (i.e., a patch set of segments 84 that form an entire picture area). The information consists of multiple extraction information sets, each of which contains an identifier of the motion-constrained patch set to which the extraction information set applies. Each extraction information set contains a replacement video parameter set, sequence parameter set, and picture parameter set for the RBSP bytes to be used during the sub-bitstream MCTS extraction process.

[0215] Assume that the picture set associatedPicSet is the pictures in decoding order starting from and including the access unit containing the MCTS extraction information set SEI message up to (but not including) the first of any of the following pictures:

[0216] -The next access unit in decoding order that contains the MCTS extraction information set SEI message.

[0217] - The next IRAP picture in decoding order with NoRaslOutputFlag equal to 1.

[0218] - The next IRAP access unit in decoding order with NoClrasOutputFlag equal to 1.

[0219] The scope of the MCTS extraction information set SEI message is the picture set associatedPicSet.

[0220] When the MCTS extraction information set patch set SEI message is present for any picture in associatedPicSet, the temporal motion constraints patch set SEI message shall be present for the first picture of associatedPicSet in decoding order, and may also be present for other pictures of associatedPicSet. For all pictures in associatedPicSet, the temporal motion constraints patch set SEI message shall have mcts_id[] equal to mcts_identifer[].

[0221] When the MCTS extraction information set patch set SEI message is present for any picture in the associatedPicSet, the MCTS extraction information set SEI message shall be present for the first picture of the associatedPicSet in decoding order, and may also be present for other pictures of the associatedPicSet.

[0222] For any PPS that is valid for any picture in associatedPicSet, when tiles_enabled_flag is equal to 0, the MCTS extract information set SEI message shall not be present for any picture in associatedPicSet.

[0223] The MCTS extract information set SEI message shall not be present for any picture in associatedPicSet unless every PPS valid for any picture in associatedPicSet has the same values ​​of the syntax elements num_tile_columns_minus1, num_tile_rows_minus1, uniform_spacing_flag, column_width_minus1[i] and row_height_minus1[i].

[0224] NOTE 1—This constraint is similar to the constraint associated with tiles_fixed_structure_flag being equal to 1, and it may be desirable for tiles_fixed_structure_flag to be equal to 1 when an MCTS Extract Information Set SEI message is present (although this is not required).

[0225] When more than one MCTS Extract Information Set SEI message exists for a picture of associatedPicSet, they shall contain the same content.

[0226] A NAL unit containing tiles belonging to tileSetA shall not contain tiles that do not belong to tileSetA.

[0227] The number of MCTS extraction information set SEI messages in each access unit shall not exceed 5.

[0228] num_extraction_info_sets_minus1 plus 1 indicates the number of extraction information sets contained in the MCTS extraction information set SEI message to be applied in the mcts extraction process. The value of num_extraction_info_sets_minus1 should be between 0 (inclusive) and 2. 32 The range is -2 (inclusive).

[0229] The i-th extracted information set is assigned an MCTS extracted information set identifier value equal to i.

[0230] num_associated_tile_set_identifiers_minus1[i] plus 1 indicates the number of values ​​of mcts_id for the tile set in the i-th extraction information set. The value of num_extraction_info_sets_minus1[i] shall be between 0 (inclusive) and 2. 32 The range is -2 (inclusive).

[0231] mcts_identifier[i][j] identifies the j-th tile group associated with the i-th extraction information group and whose mcts_id is equal to mcts_identifier[i][j]. The value of mcts_identifier[i][j] shall be between 0 (inclusive) and 2. 32 The range is -2 (inclusive).

[0232] num_vps_in_extraction_info_set_minus1[i] plus 1 indicates the number of replacement video parameter sets in the i-th extraction information set. The value of num_vps_in_extraction_info_set_minus1[i] shall be in the range of 0 (inclusive) to 15 (inclusive).

[0233] vps_rbsp_data_length[i][j] represents the number of bytes vps_rbsp_data_bytes[i][j][k] of the subsequent j-th replacement video parameter set in the i-th extraction information set.

[0234] num_sps_in_extraction_info_set_minus1[i] plus 1 indicates the number of replacement sequence parameter sets in the i-th extraction information set. The value of num_sps_in_extraction_info_set_minus1[i] shall be in the range of 0 (inclusive) to 15 (inclusive).

[0235] sps_rbsp_data_length[i][j] represents the number of bytes sps_rbsp_data_bytes[i][j][k] of the subsequent j-th replacement sequence parameter set in the i-th extraction information set.

[0236] num_pps_in_extraction_info_set_minus1[i] plus 1 indicates the number of replacement picture parameter sets in the i-th extraction information set. The value of num_pps_in_extraction_info_set_minus1[i] shall be in the range of 0 (inclusive) to 63 (inclusive).

[0237] pps_nuh_temporal_id_plus1[i][j] specifies the temporal identifier used to generate the PPS NAL unit associated with the PPS data specified in the PPS RBSP specified by pps_rbsp_data_bytes[i][j][] for the j-th replacement picture parameter set for the i-th extraction information set.

[0238] pps_rbsp_data_length[i][j] represents the number of bytes pps_rbsp_data_bytes[i][j][k] of the subsequent j-th replacement picture parameter set in the i-th extraction information set.

[0239] mcts_alignment_bit_equal_to_zero shall be equal to 0.

[0240] vps_rbsp_data_bytes[i][j][k] contains the k-th byte of the RBSP of the subsequent j-th replacement video parameter set in the i-th extraction information set.

[0241] sps_rbsp_data_bytes[i][j][k] contains the k-th byte of the RBSP of the subsequent j-th replacement sequence parameter set in the i-th extraction information set.

[0242] pps_rbsp_data_bytes[i][j]k] contains the k-th byte of the RBSP of the subsequent j-th replacement picture parameter set in the i-th extraction information set.

[0243] The sub-bitstream MCTS extraction process is applied as follows:

[0244] It is assumed that the bitstream inBitstream, the target MCTS identifier mctsIdTarget, the target MCTS extraction information set identifier mctsEISIdTarget and the target highest TemporalId value mctsTIdTarget are input to the sub-bitstream MCTS extraction process.

[0245] The output of the sub-bitstream MCTS extraction process is the sub-bitstream outBitstream.

[0246] The bitstream conformity requirement for an input bitstream is that any output sub-bitstream that is the output of a process specified with the bitstream in this clause shall be a conforming bitstream.

[0247] The output sub-bitstream is derived as follows:

[0248] - Set the bitstream outBitstream to be the same as the bitstream inBitstream.

[0249] - The lists ausWithVPS, ausWithSPS and ausWithPPS are set to include all access units in outBitstream that contain VCL NAL units of type VPS_NUT, SPS_NUT and PPS_NUT.

[0250] - Remove all SEI NAL units with nuh_layer_id equal to 0 and containing non-nested SEI messages.

[0251] NOTE 2—A “smart” bitstream extractor may include appropriate non-nested SEI messages in the extracted sub-bitstream, provided that the SEI messages applicable to the sub-bitstream are present in the original bitstream as nested SEI messages in mcts_extraction_info_nesting().

[0252] - Remove from outBitstream all NAL units with the following types:

[0253] - a VCL NAL unit containing a patch that does not belong to the patchset with mcts_id[i] equal to mctsIdTarget,

[0254] - Non-VCL NAL units with type VPS_NUT, SPS_NUT or PPS_NUT.

[0255] - Insert num_vps_in_extraction_info_minus1[mctsEISIdTarget] plus 1 NAL unit of type VPS_NUT generated from the VPS RBSP data in the mctsEISIdTarget-th MCTS extraction information set, namely vps_rbsp_data_bytes[mctsEISIdTarget][j][] (for all values ​​of j in the range of 0 to num_vps_in_extraction_info_minus1[mctsEISIdTarget], inclusive) in all access units in the list ausWithVPS in outBitstream. For each VPS_NUT generated, set nuh_layer_id to 0 and set nuh_temporal_id_plus1 to 1.

[0256] - Insert num_sps_in_extraction_info_minus1[mctsEISIdTarget] plus 1 NAL unit of type SPS_NUT generated from the SPS RBSP data in the mctsEISIdTarget-th MCTS extraction information set, namely sps_rbsp_data_bytes[mctsEISIdTarget][j][] (for all values ​​of j in the range of 0 to num_sps_in_extraction_info_minus1[mctsEISIdTarget], inclusive) in all access units in the list ausWithSPS in outBitstream. For each SPS_NUT generated, set nuh_layer_id to 0 and set nuh_temporal_id_plus1 to 1.

[0257] -Insert NAL units of type PPS_NUT in all access units in list ausWithPPS in outBitstream, which are generated by the PPS RBSP data in the mctsEISIdTarget-th MCTS extraction information set, and the PPS RBSP data, namely pps_rbsp_data_bytes[mctsEISIdTarget][j][] (for all values ​​of j in the range of 0 to num_pps_in_extraction_info_minus1[mctsEISIdTarget] (including the endpoint values)), whose pps_nuh_temporal_id_plus1[mctsEISIdTarget][j] is less than or equal to mctsTIdTarget. For each PPS_NUT generated, nuh_layer_id is set equal to 0 and nuh_temporal_id_plus1 is set equal to pps_nuh_temporal_id_plus1[mctsEISIdTarget][j] for all values ​​of j in the range of 0 to num_pps_in_extraction_info_minus1[mctsEISIdTarget], inclusive, where pps_nuh_temporal_id_plus1[mctsEISIdTarget][j] is less than or equal to mctsTIdTarget.

[0258] - Remove from outBitstream all NAL units with a TemporalId greater than mctsTIdTarget.

[0259] - For each remaining VCL NAL unit in outBitstream, adjust the slice segment header as follows:

[0260] - For the first VCL NAL unit in each access unit, the value of first_slice_segment_in_pic_flag is set equal to 1, otherwise it is set equal to 0.

[0261] - The value of slice_segment_address is set according to the tile set defined in the PPS with pps_pic_parameter_set_id equal to slice_pic_parameter_set_id.

[0262] The MCTS extraction information of the nested SEI message syntax can be designed as:

[0263]

[0264] Regarding semantics, it is noted that the MCTS extraction information nested SEI message may exist in addition to or instead of the MCTS extraction information set SEI message to form information 50 .

[0265] The MCTS extraction information of the nested SEI message provides a mechanism to carry the nested SEI message and associate the nested SEI message with a bitstream subset corresponding to one or more motion constraint patch sets.

[0266] In the sub-bitstream MCTS extraction process specified in the semantics of the MCTS extraction information set SEI message, the nested SEI message contained in the MCTS extraction information of the nested SEI message can be used to replace the non-nested SEI message in the access unit including the MCTS extraction information of the nested SEI message.

[0267] all_tile_sets_flag equal to 0 specifies that the mcts_identifier list is set to include mcts_identifier[i]. all_tile_sets_flag equal to 1 specifies that the list mcts_identifier[i] includes all values ​​of mcts_id[] of the temporal_motion_constrained_tile_sets SEI message present in the current access unit.

[0268] num_associated_mcts_identifiers_minus1 plus 1 specifies the number of subsequent mcts_identifiers. The value of num_associated_mcts_identifiers_minus1[i] shall be between 0 (inclusive) and 2. 32 The range is -2 (inclusive).

[0269] mcts_identifier[i] identifies the tile set with mcts_id equal to mcts_identifier[i] that is associated with the subsequent nested SEI message. The value of mcts_identifier[i] shall be between 0 (inclusive) and 2. 32 -2 (inclusive).

[0270] num_seis_in_mcts_extraction_seis_minus1 plus 1 indicates the number of subsequent nested SEI messages.

[0271] mcts_nesting_zero_bit shall be equal to 0.

[0272] As already indicated above, the evaluation or generation of the information 50 (i.e. the information guiding the parameters and / or SEI adaptation) may alternatively be done outside the encoder 80, i.e. outside the location where the encoding of the picture 12 into the stream 10 is actually performed. According to this alternative, the data stream 10 may be transmitted in a manner accompanied only by the original parameters 20a and / or the original SEI messages related to the unreduced stream 10. Optionally, information about one or more supported sub-regions 22 of the picture 12 may be present in the video stream 10, but even this information is not mandatory, since the evaluation of the information 50 may be based on its own evaluation of the patch structure of the stream 12 in order to determine the one or more sub-regions. In doing so, although the tedious task of evaluating the information 50 is moved from the encoder to a location closer to the client, or even to the user (e.g. directly upstream of the final decoder 82), it is possible to avoid the need to transmit the complete (i.e. unreduced) data stream 10 by not transmitting the portion 70 of the payload portion 18 that refers to the picture 12 region that is outside the desired sub-region 22. Of course, the original code processing parameter set 20a and / or SEI message related to the unreduced data stream 12 will also be transmitted. The network entity 60 that performs the actual reduction or removal 68 of the part 70 can accordingly reside directly upstream of the entity that performs the evaluation of the information 50. For example, the streaming device is dedicated to downloading only those parts of the payload part 18 of the data stream 10 that do not belong to the part 70. For this purpose, some downloading provisions can be used, such as a manifest file. The DASH protocol can be used for this purpose. In fact, the evaluation of the information 50 can be used only as a separate Figure 3 or Figure 5 The actual parameter adjustment preparation of the parameters and / or the preparation of SEI replacement are completed inside such a network device residing in front of the decoder. In summary, according to the alternative just discussed, the network device may include an interface for receiving a reduced data stream 10, which only includes the payload part 18 after the part 70 is removed, but the reduced data stream 10 still has parameters 20a, which are parameters when the picture 12 is completely coded into the payload part 18 (including the part 70). The position indication 32 can still be the original position indication. That is, the received data stream is actually an error-coded data stream. The received data stream corresponds to a Figure 5 , however, the parameter 20b is still the original parameter 20a and the position indication 32 is still wrong. The index 54 in the stream refers to the parameter 20a in the stream and may not have been modified relative to the original code processing of the unreduced data stream. In fact, the only difference between the unreduced original data stream and the received data stream is that the part 70 is omitted. Optionally, one or more SEI messages are included, however, these SEI messages refer to the original code processing, for example, the size of the original picture 12 or other characteristics of the complete code processing. At the output of such a network device, the data stream 62 for decoding by a decoder 82 is output. A module is connected between the input and the output, which adapts the SEI messages and / or parameters to the sub-region 12 to which the input data stream 10 has been reduced. That is, such a module must perform task 74 (i.e., adjusting parameter 20a to become parameter 20b) and task 78 (i.e., adjusting the position indication 32 to correctly refer to the periphery of the sub-region 22). In the case of such a network device that exclusively limits the downloading of the stream 10 to the portion of the reference sub-region 22 of the payload portion 18, the knowledge of the sub-region 22 for which reduction has been performed may be internal to such a network device, or may be provided externally in the case of another network device, possibly located upstream of the network device, that undertakes the task of reduction 68. For a network device including such a module located between input and output, the above reference to Figure 4The same statements made by a network device (e.g., with respect to software, firmware, or hardware implementation aspects) are true. Summarizing the embodiment just outlined, it relates to a network device configured to receive a data stream, the data stream including a portion of a payload portion into which a picture of a video is transcoded. The portion corresponds to the result when a portion 70 is excluded from the payload portion 18, the portion 70 referring to an area of ​​the picture outside a predetermined sub-region 22 of the picture. The picture 12 of the video is transcoded into the payload portion 18 in the following manner: the transcoding parameter settings in the parameter set portion of the data stream are used as parameters without exclusion. That is, assuming that portion 70 is not eliminated, the parameter set portion of the received data stream is correctly used as a parameter when transcoding the picture 12 into the payload portion 18. Additionally or alternatively, the picture 12 of the video is transcoded into the payload portion 18 in the following manner: matching the supplemental enhancement information indicated by the supplemental enhancement message of the data stream without exclusion. That is, the SEI message optionally included by the received data stream actually matches the unreduced payload portion 18. The network device modifies the received data stream by changing 78 the position indication 32 in the payload portion so as to indicate the position in a manner measured relative to the periphery of the predetermined sub-region 22 rather than the periphery of the picture 12, and adjusting the code processing parameter settings in the parameter set portion, and / or adjusting the supplemental enhancement information message, so that after the adjustment, in the modified data stream, the portion of the payload portion 18 (i.e., the portion other than the portion 70, in other words, the sub-region-specific picture 84 showing the predetermined sub-region of the picture) is encoded in the following manner: using the code processing parameter settings thus adjusted as parameters, and / or matching the supplemental enhancement information indicated by the adjusted supplemental enhancement information message. According to the previous embodiment, in addition to the parameters 20a, the generation of the parameters 20b has also been completed by the encoder 80, thereby generating a data stream carrying both parameter settings 20a and 20b. Here, in the alternative just described, the parameters 20a are converted into the parameters 20b in quasi-real time. Adjusting the parameters 20a to the parameters 20b requires using the knowledge about the sub-region 22 to modify the parameters 20a. For example, while the picture size 26 within the setting 20a corresponds to the size of the full picture 12, after the adjustment of the setting 20b, the picture size must represent the size of the sub-region 22 or the picture 86, respectively. Similarly, while the tile structure 38 within the setting 20a corresponds to the tile structure of the full picture 12, after the adjustment of the setting 20b, the tile structure 38 must represent the tile structure of the sub-region 22 or the picture 86, respectively. Similar statements hold true for, for example (but not limited to), the buffer size and timing 46. If no SEI messages are present in the incoming receive data stream, no adjustment is required.Instead, the SEI message may simply be discarded instead of adjusting it.

[0273] With respect to the above-described embodiments, it should be noted that the adaptation of the supplemental enhancement information may involve buffer size and / or buffer timing data. In other words, within the optionally present SEI, the type of information that is adapted or differs between the original SEI and the replacement SEI in order to conform to the stripped or reduced video stream may at least partially involve buffer size and / or buffer timing data. That is, the SEI data in the stream 10 may have buffer size and / or buffer timing data related to the full code processing, while the replacement SEI data has buffer size and / or buffer timing data related to the reduced stream 62 and / or reduced picture 86, according to the information about Figure 1 According to the description in the previous paragraph, in addition to transmitting the SEI data, replacement SEI data is also transmitted, or according to the description in the previous paragraph, the replacement SEI data is generated in real time.

[0274] The following description relates to a second aspect of the present application, namely a technique for achieving more efficient transmission of video data that is not suitable for the usual rectangular picture shape of a video codec. As before with respect to the first aspect, the following description begins with an introduction, namely an exemplary description of an application in which these problems may arise, in order to draw out the advantages resulting from the embodiments described below. However, it should be noted that this preliminary description should not be construed as limiting the breadth of the embodiments described subsequently. In addition, it should be noted that the aspects of the present application described below may also be combined with the above-described embodiments in an advantageous manner. Details of this aspect are also listed below.

[0275] The problems described next arise from the various projections used for panoramic videos, especially when applying processes such as the sub-domain extraction described above.

[0276] Exemplarily, the so-called cubic projection is used in the following description. The cubic projection is a special case of a rectilinear projection, also called a gnomonic projection. This projection describes the approximate transformation of most conventional camera systems / lenses when acquiring an image representation of a scene. Fig.14 As shown, straight lines in the scene are mapped to straight lines in the result image.

[0277] The cubic projection now applies a rectilinear projection to map the surroundings of the cube onto its six faces, each with a viewing angle of 90°x90° relative to the center of the cube. Results such as Fig.15 As shown in Figure A. Other arrangements of the six faces in the common image are also possible.

[0278] Now, in order to derive a more coding-friendly representation of the thus obtained picture A (i.e., less unused image regions 130 and rectangular shapes), the image blocks may be shifted within the picture (e.g., as Fig.16 as shown) to export picture B.

[0279] From a system perspective, understanding image B ( Fig.16 ) is crucial for deriving the representation of image A ( Fig.15 ) is crucial. This is especially true when performing tasks such as Figures 1 to 13 In this case, only by Fig.28 A portion of picture B indicated by the disjoint ROI 900 in FIG. 1 is available at the terminal device. The terminal device must be able to remap the relevant area of ​​the given (partial) video to the correct position and area expected by the terminal display / presentation device. The server or network device that changes the video bitstream processed by the code according to the above extraction process can create and add or adjust the corresponding signaling of the notification shift according to the changed video bitstream.

[0280] Therefore, the embodiments described subsequently provide for signaling of (rectangular) sample groups indicating picture B within a video bitstream. Furthermore, a shift of each group of samples relative to the samples of picture B in horizontal and vertical directions. In another embodiment, the bitstream signaling comprises explicit information about the resulting picture size of picture A. Furthermore, default luma and chroma values ​​for samples that are not covered by the shifted sample group or that were originally covered by the shifted sample group. Furthermore, it may be assumed that some samples of picture A are initialized with sample values ​​of corresponding samples in picture B.

[0281] An exemplary embodiment is Fig.17 The syntax is given in the table.

[0282] Another embodiment utilizes tile structure signaling to indicate the samples belonging to the group of samples to be shifted.

[0283] about Fig.18 , shows an embodiment of a data stream 200 according to the second aspect. Video 202 is encoded in the data stream 200. It should be noted that Fig.18 The embodiment of the present invention can be modified to indicate only one picture encoded into the data stream 200, but for ease of understanding of those examples combining the embodiment according to the second aspect with the embodiment of any other aspect of the present application, Fig.18An example is shown where the data stream 200 is a video data stream rather than a picture data stream. As just mentioned, the picture 204 of the video 202 is encoded in the data stream 200. However, in addition, the video data stream 200 includes shift information 206. The shift information has the following meaning. In practice, the data stream 200 must transmit the picture content in the picture 204, which has a non-rectangular outer perimeter. Fig.18 An example of such picture content is shown at reference numeral 200. That is, picture content 208 shows picture content that data stream 200 would transmit within one timestamp (i.e., within one picture 204). However, the outer perimeter 210 of the actual picture content is non-rectangular. Fig.18 In the example of FIG. 1 , the actual image content is equivalent to the release of the six sides of the cube 212. Fig.18 208 are exemplarily distinguished from each other using the usual distribution of the numbers 1 to 6 on the six sides of the cube 212 (i.e., the sum of the numbers of the opposite sides is equal to 7). Thus, each side represents a sub-area 214 of the actual picture content 208 and can, for example, represent a suitable projection of one sixth of the complete three-dimensional panoramic scene to the corresponding sub-area 214, which according to this example is square in shape. However, as mentioned above, the sub-areas 214 can also have different shapes and can be arranged in the picture content 208 in a manner different from the regular arrangement of rows and columns. In any case, the actual picture content depicted in 208 has a non-rectangular shape, so the smallest possible rectangular target picture area 216 that completely contains the released panoramic content 208 has an unused portion 130, i.e., a portion that is not occupied by the actual picture content related to the panoramic scene.

[0284] Therefore, in order not to "waste" the picture area in the picture 204 of the video 202 transmitted in the data stream 200, the picture 204 carries the complete actual picture content 208 in the following way, that is, the spatial relative arrangement of the sub-areas 214 is changed relative to the arrangement of the sub-areas 214 in the target picture area 216.

[0285] like Fig.18 As shown, Fig.18 The following example is shown: four sub-areas, namely sub-areas 1, 2, 4 and 5, do not need to be shifted when the image 204 is copied to the target image area 216 without distortion or compliance, however, sub-areas 3 and 6 must be shifted. Fig.18In the example, the shift is a pure translation replacement, which can be described by a two-dimensional vector 218, but according to alternative embodiments, a more complex shift may be chosen, for example, the shift additionally includes a scaling and / or a reflection (mirroring) and / or a rotation of the corresponding sub-region when transferring between the picture 204 and the target picture area 216. For each of a set of at least one predetermined picture sub-region 204, the shift information 206 may represent a shift of the corresponding sub-region within the target picture area 216 relative to a distortion-free or non-shifted copy of the picture 204 to the target picture area 216. For example, in Fig.18 In the example of , the shift information 206 may indicate the shift of a group of sub-areas 214 including only sub-areas 3 and 6. Alternatively, the shift information 206 may indicate the shift of the sub-areas 214 or the set of shifted sub-areas 214 relative to a default point (e.g., the upper left corner) of the target area 216. By default, the remaining sub-areas in the image 204 (in Fig.18 1, 2, 4 and 5) in the example can be considered unchanged when they are copied to the target picture 216 without distortion or conformance, for example relative to the default point.

[0286] Fig.19 It is shown that the shift information may include a count 220 of sub-regions 214 to be shifted, a target picture region size parameter 222 indicating the size of the target picture region 216, and coordinates 224 for each of the n shifted sub-regions, the coordinates 224 describing a shift 218 of the respective sub-region 214 to be shifted, the shift 218 measuring, for example, the shift relative to the aforementioned default point, or relative to the position when the sub-region 214 in the original constellation within the picture 204 is mapped onto the target region 216. In addition to the coordinates 224, the information 206 may include a scaling factor 226 for each sub-region 214 to be shifted, which indicates how the respective sub-region 214 is scaled when mapping the respective sub-region 214 within the target picture region 216, the respective sub-region 214 being shifted according to the respective coordinates 224. The scaling factor 226 may result in an enlargement or reduction relative to the non-shifted sub-region 214. Even optionally, horizontal and / or vertical mapping and / or rotation may be signaled for each sub-region 214. And, even further, the shift information 206 may include, for each sub-region to be shifted or arranged within the target area 216, the coordinates of the upper left corner and the lower right corner of the corresponding region, which are also measured relative to a default point or a corresponding corner that is not shifted when mapping the corresponding sub-region 214 to the target area 216. Thus, placement, scaling and mapping may be signaled. Thus, the sub-regions 214 of the transmitted picture 204 may be freely shifted relative to their original relative arrangement in the picture 204.

[0287] For example, the shift information 206 may have a scope (ie, validity) of a time interval of the video 202 that is larger than one timestamp or one picture 204 (eg, for a sequence of pictures 204 or the entire video 202). Fig.18 It is shown that the data stream 200 may optionally further include default padding information 228, which indicates a default padding for filling a portion 130 of the target picture area at the decoding side, which portion 130 is a portion not covered by any sub-area 214 (i.e., any of the shifted or non-shifted sub-areas 214 of the picture 204). Fig.18 In the example of FIG. 2 , for example, sub-areas 1, 2, 4 and 5 form the non-shifted portion of picture 204, which is Fig.18 , while the rest of the image 204 (i.e., sub-areas 3 and 6) are shown in Fig.18 2 and after the sub-areas 3 and 6 are shifted according to the information 206 , all six sub-areas do not cover the shaded portion 130 in the target picture area 216 , so the portion 130 will be filled according to the default filling information 228 .

[0288] The encoder 230 is adapted to generate the data stream 200 in Fig. 20 The encoder 230 simply accompanies or provides in the data stream 200 information 206 indicating the shift required to fill the target picture area with the picture 204 (the encoder 230 also encodes the picture 204 into the data stream 200). Fig. 20 It is also shown that encoder 230 can, for example, generate data stream 200 so that data stream 200 can be reduced in a manner that maintains compliance (e.g. Figures 1 to 13 In other words, the encoder 230 can also implement Figure 1 For the purpose of illustration, Fig. 20 The picture 204 is shown to be subdivided into an array of sub-areas 214 (i.e., according to Fig.18 The picture 204 may correspond to the picture 12, ie, to the picture of the non-reduced data stream 200. Fig. 20 A sub-region 22 is shown by way of example, for which the encoder 230 enables the data stream 200 to be reduced. Figure 1 As explained, there may be several such sub-areas 22. By this measure, the network device can reduce the data stream 200 so as to extract only a small part of the data stream 200 to obtain a reduced video data stream, the picture 86 of the reduced video data stream only showing the sub-area 22. The reduced video data stream to which the sub-area 22 belongs and to which the data stream 200 can be reduced is shown in FIG. Fig. 20232. While the picture 204 of the unreduced video data stream 200 shows the picture 204, the picture of the reduced video data stream 232 shows only the sub-region 22. In order to provide a receiver (e.g., a decoder) receiving the reduced video data stream 232 with the ability to fill the target picture region with the picture content of the reduced video data stream 232, the encoder 230 may additionally provide the video data stream 200 with shift information 206' specific to the sub-region 22. In the case where the video data stream 200 is reduced to generate the reduced video data stream 232, the network device (e.g., Figure 4 60) can remove the shift information 206 and only transfer the shift information 206' to the reduced video data stream 232. By this measure, a receiver such as a decoder can fill the content of the picture of the reduced video data stream 232 (which is related to the content of the sub-region 22) into Fig.18 The target image area 216 is shown.

[0289] Likewise, it should be emphasized that Fig. 20 It should not be understood as being limited to video data streams that can be scaled down. If the video data stream 200 is scaled down, the same method as above with respect to Figures 1 to 13 The techniques given are different techniques.

[0290] Fig.21 A possible receiver is shown: a decoder 234 receives the video data stream 200 or the reduced video data stream 232 and reconstructs its pictures therefrom, i.e. the pictures 204 or pictures showing only the sub-area 22 based on the reduced video data stream 232, respectively. The receiver is a decoder which, in addition to the decoding core 234, comprises a shifter 236 which uses the shift information (206 in the case of the video data stream 200 and 206' in the case of the reduced video data stream) to fill the target picture area 216 based on the picture content. Thus, the output of the shifter 236 is the filled target picture area 216 for each picture of the corresponding data stream 200 or 232. As mentioned above, some parts of the target picture area are still not filled with the picture content. Optionally, a renderer 238 can be connected after the shifter 236 or to the output of the shifter 236. The renderer 238 applies an injective projection to a target picture formed by the target picture area 216, or at least a sub-area thereof located within the fill area of ​​the target picture area, to form an output picture or output scene 240 corresponding to the currently viewed scene segment. The injective projection performed by the renderer 238 may be an inverse projection of a cubic projection.

[0291] Therefore, the above embodiment enables rectangular region packing of picture data of panoramic or semi-panoramic scenes, etc. A specific syntax example can be provided as follows. Below, a syntax example is given in the form of a pseudo code, the name of which is RectRegionPacking(i), which specifies how the source rectangular region of the projection frame (i.e., 216) is packed into the target rectangular region of the packing frame (i.e., 204). Horizontal mirroring and 90, 180, or 270 degree rotation can be indicated, and vertical and horizontal resampling are inferred from the width and height of the region.

[0292]

[0293]

[0294] The semantics are described below.

[0295] proj_reg_width[i], proj_reg_height[i], proj_reg_top[i], and proj_reg_left[i] are expressed in pixels of the projected frame (i.e., 216) with a width and height equal to proj_frame_width and proj_frame_height, respectively. Fig.18When comparing, i is the index of the corresponding area of ​​tile 214. proj_reg_width[i] specifies the width of the i-th area of ​​the projected frame. proj_reg_width[i] should be greater than 0. proj_reg_height[i] specifies the height of the i-th area of ​​the projected frame. proj_reg_height[i] should be greater than 0. proj_reg_top[i] and proj_reg_left[i] specify the top sample row and leftmost sample column in the projected frame. These values ​​should be in the range from 0 (including 0, representing the top left corner of the projected frame) to proj_frame_height (excluding) and proj_frame_width (excluding), respectively. proj_reg_width[i] and proj_reg_left[i] should be constrained so that proj_reg_width[i]+proj_reg_left[i] is less than proj_frame_width. proj_reg_height[i] and proj_reg_top[i] should be constrained so that proj_reg_height[i]+proj_reg_top[i] is less than proj_frame_height. When the projected frame 216 is stereoscopic, proj_reg_width[i], proj_reg_height[i], proj_reg_top[i], and proj_reg_left[i] should be such that the domains identified by these fields on the projected frame are located within a single constituent frame of the projected frame. transform_type[i] specifies the rotation and mirroring that has been applied to the i-th domain of the projected frame to map it to the padding frame, and therefore, the mapping must be reversed in order to map the corresponding domain 214 back to the region 216. Of course, the mapping from the picture 204 to the target region 216 can be indicated. When transform_type[i] specifies both rotation and mirroring, the rotation is applied after the mirroring. Of course, the opposite is also possible. The following values ​​are specified according to an embodiment, while other values ​​can be retained:

[0296] 1: No transformation, 2: Horizontal mirror, 3: Rotate 180 degrees (counterclockwise), 4: Rotate 180 degrees (counterclockwise) after horizontal mirror, 5: Rotate 90 degrees (counterclockwise) after horizontal mirror, 6: Rotate 90 degrees (counterclockwise), 7: Rotate 270 degrees (counterclockwise) after horizontal mirror, 8: Rotate 270 degrees (counterclockwise). Note that these values ​​correspond to the EXIF ​​orientation tag.

[0297] packed_reg_width[i], packed_reg_height[i], packed_reg_top[i], and packed_reg_left[i] specify the width, height, top sample row, and leftmost sample column, respectively, of the region in the packed frame (i.e., the area covered by the tile 214 in the picture 204). For any value of j in the range of 0 to i-1, inclusive, the rectangle specified by packed_reg_width[i], packed_reg_height[i], packed_reg_top[i], and packed_reg_left[i] shall not overlap with the rectangle specified by packed_reg_width[j], packed_reg_height[j], packed_reg_top[j], and packed_reg_left[j].

[0298] To summarize and generalize the examples just outlined, the embodiments further described above may be varied as follows: for each domain or tile 214 of the picture 214, two rectangular areas are indicated, namely the area covered by the corresponding domain or tile 214 within the target area 216 and the rectangular area covered by the corresponding domain or tile 214 within the picture area 204, and a mapping rule, namely a reflection and / or a rotation, for mapping the picture content of the corresponding domain or tile 214 between these two areas is indicated. The scaling ratio may be signaled by signaling a pair of regions of different sizes.

[0299] In the following, a third aspect of the present application is described. The third aspect relates to advantageous techniques for distributing access points in a video data stream. In particular, access points associated with one or more sub-regions of a picture encoded into a video data stream are introduced. The advantages resulting therefrom will be described below. As with the other aspects of the present application, the description of the third aspect will begin with an introduction describing the occurrence of the problem. Similar to the description of the first aspect, the introduction exemplarily relates to HEVC, but this situation should also not be interpreted as limiting the embodiments explained subsequently to only involving HEVC and its extensions.

[0300] In the context of the TMCTS system given above, patch-specific random access points can provide significant benefits. Random access in patches at different times will enable more equal distribution of bitrate peaks across pictures within a video sequence. All or part of the mechanism used for picture-specific random access in HEVC can be transferred to patches.

[0301] One of the picture-specific random access mechanisms is an indication for intra-coded pictures or access units that, starting from the intra-coded pictures or access units, pictures following them in a) presentation order or b) coding and presentation order do not inherit prediction dependencies on samples of pictures preceding the intra-coded pictures. In other words, b) immediately, or a) starting from the first following trailing picture, a reference picture buffer reset is indicated. In HEVC, such access units are signaled on the network abstraction layer (NAL) by a specific NAL unit type, which is a so-called intra random access point (IRAP) access unit, such as BLA, CRA (all belonging to category a above), or IDR (belonging to category b above). The embodiments described further below may use a NAL unit header level indication (e.g., by a new NAL unit type, or by an SEI message for backward compatibility), which indicates to a decoder or network middlebox / device that a given access unit contains at least one intra-coded slice / tile, where condition a) or b) (i.e. some form of reference picture buffer reset) applies to each slice / tile. Furthermore, in addition to or as an alternative to the signaling of the NAL unit type, the slice / tile may be identified by an indication on the slice header level of the picture on the encoder side. Thus, the early decoding operation allows reducing the DPB size required for decoding after extraction.

[0302] For this purpose, the constraints expressed by fixed_tile_structure have to be satisfied and samples of the tile preceding the indicated access unit should not be referenced by the same tile (and any other tile) of the current picture.

[0303] According to some embodiments, the encoder may constrain the code processing dependencies by temporal prediction between sub-regions in a way that for each sub-region that undergoes RA, the picture region used as reference for temporal prediction in reference pictures is extended by the picture regions covered by other sub-regions (once these other sub-regions have also undergone RA). These slices / tiles / sub-regions are indicated within the bitstream, for example, at NAL unit or slice level or SEI messages. This structure hinders the extraction of sub-regions, but reduces the loss of constrained temporal prediction. The type of sub-region random access (extraction allowed or not) must be distinguished from the bitstream indication.

[0304] Another embodiment exploits the above signaling opportunities by adopting a certain structure of code process dependencies in which picture-wise random access points exist at a coarse time granularity, which enables drift-free instantaneous random access at certain moments and existing prior art signaling.

[0305] However, at a finer temporal granularity, the coding structure allows for patch-wise random access, which distributes the bitrate burden of intra-coded picture samples over time, tending to be a less variable bitrate representation. For backward compatibility, this patch-wise random access can be signaled via SEI messages, keeping the individual slices as non-RAP pictures.

[0306] In the sub-picture bitstream extraction process, the type of NAL unit indicated by the above-mentioned SEI message within this stream structure (which indicates tile-based random access) will be appropriately changed to picture-wise random access to signal the opportunity for instantaneous random access at the corresponding picture of the extracted sub-bitstream.

[0307] refer to Fig. 22 A video data stream 300 according to an embodiment of the third aspect of the present application is described. The video data stream 300 has a sequence of pictures 302 encoded therein, i.e., a video 304. As with the other embodiments described previously, the temporal order in which the pictures 302 are depicted may correspond to a presentation temporal order, which may or may not be consistent with the decoding order in which the pictures 302 are encoded into the data stream 300. That is, although not described previously with respect to other figures, the video data stream 300 may be subdivided into a series of access units 306, each access unit 306 being associated with a corresponding one of the pictures 302, and the order in which the pictures 302 are associated with the sequence of access units 306 corresponds to the decoding order.

[0308] The pictures 302 are encoded into the video data stream 300 using temporal prediction. That is, predictive coding pictures between the pictures 302 are coded using temporal prediction based on one or more temporal reference pictures that precede the corresponding pictures in decoding order.

[0309] The video data stream 300 includes at least two different types of random access pictures as described later, rather than having only one type of random access picture. In particular, a common random access picture is a picture that does not use temporal prediction. That is, the corresponding picture is coded in a manner independent of any previous picture in the decoding order. For these common random access pictures, the interruption of temporal prediction involves a complete picture area. According to the embodiments described below, the video data stream 300 may or may not include this common picture-based random access picture.

[0310] As just described, random access pictures do not depend on previous pictures in decoding order. Therefore, they allow random access to decoded video data stream 300. However, transcoding pictures without temporal prediction means a transcoding loss in compression efficiency. Therefore, a typical video data stream suffers from a bit rate peak, i.e., a bit rate maximum, at a random access picture. These problems can be solved by the above-described embodiments.

[0311] according to Fig. 22 In an embodiment, the video data stream 300 includes: a first set of one or more pictures of type A, which, when encoded into the video data stream 300, interrupt temporal prediction in at least a first picture sub-region A to form a set of one or more first random access points; and a second set of one or more pictures of type B, which, when encoded into the video data stream 300, interrupt temporal prediction in a second picture sub-region B different from the first picture sub-region A to form a set of one or more second random access points of the video data stream 300.

[0312] exist Fig. 22 In the case of , the first and second picture sub-regions A and B are shown using hatching, and as Fig.23a As shown, sub-regions A and B do not overlap each other, wherein sub-regions A and B are adjacent to each other along a common border 308, so that sub-regions A and B cover the entire picture area of ​​picture 302. However, this is not necessarily the case. Figure 23b As shown, sub-areas A and B may partially overlap, or as Fig.23c As shown, the first picture area A can actually cover the entire picture area of ​​the picture 302. Fig.23c In the case of , a picture of type A will be a picture-wise random access point where temporal prediction is completely turned off, i.e., there is no temporal prediction in the entire corresponding picture when encoded into the data stream 300. For completeness, Fig.23d It is shown that the sub-region B need not be located inside the picture region 302 , but may also adjoin an outer picture boundary 310 of the two pictures 302 . Fig.23e It is shown that in addition to pictures of type A and B there may also be pictures of type C with associated sub-areas C which together completely cover the picture area of ​​picture 302 .

[0313] Interrupting time prediction Fig. 22 Restricting the area within picture B and picture A to sub-areas A and B has the following consequences: In general, the bit rate for encoding picture 302 into video data stream 300 is larger for pictures forming random access points, since the use of temporal prediction is avoided in the entire corresponding picture area, and for subsequent pictures (at least in presentation order), the prediction from previous pictures (in decoding order) is broken. Fig. 22 In the case of pictures of type A and B in , temporal prediction is avoided only in sub-regions A and B, respectively, so that the peak bit rate 312 at these pictures A and B is lower compared to the picture-wise random access point pictures. However, as described below, except for the code processing dependency constraints at the sub-region boundaries, the reduction in the peak bit rate 312 occurs at a relatively low cost, at least in terms of the full picture random access rate. This is in Fig. 22 Here, the curve 314 shall represent the function of the temporal variation of the display bit rate over the time t. As explained, the peak 312 at the time of pictures A and B is lower than the peak resulting from the picture-wise random access to the pictures. Compared to the case where only picture-wise random access to the pictures is used, the picture-dependent random access rate of the video data stream 300 corresponds to the rate of the sub-region-dependent random access to the pictures that together cover the entire picture area, Fig. 22 In the case of , this corresponds to the rate at which at least one picture of type B and at least one picture of type A arrive. Even in the case of a normal picture-by-picture random access picture in the video data stream 300 (e.g. Fig.23c There are also advantages over a normal video data stream in which only these pictures are temporally distributed over the video data stream. In particular, in this case, sub-region-dependent random access pictures (in Fig.23c The presence of picture B in the case of a video data stream 300 (as explained in more detail below) is employed to reduce the picture rate of picture A associated with a high bit rate peak, but to compensate for the increased random access latency by spreading pictures of type B into the video data stream 300 between pictures of type A, thereby allowing random access restricted to a sub-region of the video data stream to be bridged before the time of reaching the next picture-wise random access point (i.e., the next picture A).

[0314] Before proceeding with the description of a decoder that utilizes a special type of random access picture within the video data stream 300, some explanation is given of sub-region B and / or sub-region A and the manner in which picture 302 is encoded into the video data stream 300 by taking these sub-regions into account (except for interrupting temporal prediction within sub-regions A and B and applying temporal prediction in areas outside sub-regions A and B within the same picture).

[0315] Fig. 22A video encoder is shown using a dashed box 316, which is configured to encode the picture 302 into the video data stream 300 so as to include the pictures A and B just outlined, respectively. As described above, the video encoder 316 can be a hybrid video encoder that uses motion compensated prediction to encode the picture 302 into the video data stream 300. The video encoder 316 can use any GOP (group of pictures) structure to encode the picture 302 into the video data stream 300, such as an open GOP structure or a closed GOP structure. With respect to the random access pictures A and B associated with sub-regions, this means that the video encoder 316 intersperses among the pictures 302 those pictures whose sub-regions (i.e., A or B) do not depend on any previous pictures in the decoding order. As will be described later, such sub-regions B and / or A can correspond to pictures according to Figures 1 to 13 22 of the embodiment, i.e., a sub-region for which the video data stream 300 can be downscaled. However, although this is only an example and downscalability is not a necessary characteristic of the video data stream 300, it should be noted that it is advantageous to encode the picture 312 into the video data stream 300 in a manner that follows the boundaries of the sub-regions B and / or A, similar to the above description of Figures 1 to 13 A description is given of the boundaries of the sub-region 22 .

[0316] In particular, although the scope of the spatial code processing dependency mechanism when encoding the picture 302 of the video data stream 300 is generally short, the random access picture associated with the sub-region (i.e., in Fig. 22 It is advantageous that the pictures A and B in the case of a respective sub-region B / A are encoded into the video data stream 300 in such a way that code processing dependencies for coding the respective sub-region B / A do not cross the boundaries of the respective sub-region, so that no code processing dependencies on the outside or spatial neighborhood of the respective sub-region are introduced. That is, within the respective sub-region B / A, no temporal prediction is performed when coding the sub-region-related random access pictures A and B, and there is no spatial code processing dependency on the respective picture parts outside the respective sub-region A / B. In addition to this, it is advantageous that pictures between the random access pictures A and B are also encoded into the video data stream 300 in such a way that the segment boundaries of the segments are taken into account, and the directly preceding segment-specific random access pictures form sub-region-specific random access points with respect to the segment.

[0317] For example, in Fig. 22, picture B forms a sub-region-specific random access point with respect to sub-region B, and therefore, it is advantageous for pictures 302 (the sequence is exemplarily indicated by curly brackets 317) after picture B and before the first occurrence of the next sub-region random access picture (i.e., picture A) to be coded in a manner that takes into account the boundaries of the partition B. In particular, it is advantageous that the spatial and temporal prediction and coding dependencies for coding these pictures into the video data stream 300 are restricted so that when coding these pictures into the video data stream 300, their partitions B do not depend on any part of these pictures or picture B itself that is located outside the partition B. With respect to motion vectors, for example, the video encoder 316 restricts the available motion vectors for coding the partition B of pictures between pictures B and A so as not to point to parts of reference pictures among picture B and pictures between picture B and picture A that extend outside the sub-region B of the reference picture. In addition to this, since picture B forms a random access point with respect to sub-region B, the temporal reference pictures used for temporal prediction of sub-region B of picture 317 should not be located upstream relative to picture B. The spatial dependency for coding the sub-region B of the intermediate picture between pictures B and A will be limited in a similar way, i.e., so that it does not introduce dependencies on neighboring parts outside sub-region B. Again, depending on the application, this limitation can be mitigated. In addition, for possible countermeasures to drift errors, please refer to Figures 1 to 13 Likewise, the restrictions just discussed for pictures between random access pictures (where the preceding picture is a sub-region specific random access picture such as picture B) can be applied only to temporal prediction, while spatial dependencies have a less severe impact on drift errors.

[0318] The discussion presented in the previous paragraph concerns the restriction of the code processing dependency on the code processing of the immediately successor picture 317 (in terms of decoding order) of a sub-region-wise random access picture B, which is limited only to the code processing of pictures 317 within a sub-region B, where the immediately predecessor random access picture (i.e., picture B) forms a sub-region-specific random access point with respect to the sub-region B. A separate question to be addressed is whether the restriction should be made to the code processing of pictures 317 within the outer region of the segment B (i.e., within the Fig. 22In the embodiment of the present invention, the code processing dependency of the sub-region A of the picture 317 for code processing is determined in such a way that the code processing of the outer part of the picture 317 is dependent on the sub-region B. That is, the question is whether the sub-region A of the picture 317 should be code-processed in such a way that, for example, the spatial code processing dependency is restricted so as not to extend to the segment B of the same picture, and whether the temporal code processing dependency of the code-processed sub-region A of the picture 317 should be restricted in such a way that the dependency does not extend to the sub-region B of the reference picture, which is the picture B or any preceding picture 317 in the code processing / decoding order. More precisely, it should be noted that the reference picture 317 for code processing the sub-region A of the picture 317 may belong to one of the previously code-processed / decoded pictures of the picture 317 on the one hand, and to the preceding random access picture B on the other hand, or may be located upstream (in decoding order) with respect to the picture B. For the reference pictures located upstream with respect to the picture B, the temporal code processing dependency for code processing the sub-region A of any picture 317 is still restricted so as not to extend to the sub-region B. Instead, the question discussed here is whether any code processing dependency for code processing sub-region A of picture 317 will be restricted or not restricted so as not to extend into segment B, taking into account intra-code or spatial code processing dependency or temporal code processing dependency on a reference picture (which is picture B or any previously code processed / decoded picture in picture 317). Both options have their advantages. If the sub-region boundaries of picture B and sub-region B of picture 317 are also respected when code processing sub-region A of picture 317, i.e., the code processing dependency for code processing sub-region A is restricted so as not to extend into sub-region B, then sub-region A continues to be code processed in a manner independent of segment B and thus forms a sub-region, with respect to which the data stream 300 can be extractable or reducible as described above. This also applies to sub-region B when considering the same situation with respect to code processing of sub-region B of a picture immediately following a sub-region-specific random access picture A. If the reducibility of a certain sub-region (e.g., sub-region A and / or sub-region B) is not so important, it may be advantageous in terms of coding efficiency to allow the code processing dependency just discussed to extend to the sub-region (the immediately preceding segment-wise random access picture forms a sub-region-specific random access point with respect to the sub-region). In this case, the other sub-regions in the just-proposed discussion (e.g., sub-region A) will no longer be reducible, but the code processing efficiency is increased because the video encoder 316 has fewer restrictions on the use of redundancy, for example, selecting a motion vector so as to cross the boundary of sub-region B, thereby temporally predicting a portion of sub-region A of the picture 317 based on sub-region B of any of these pictures or picture B. For example, if the following is performed, the data stream 300 will no longer be reducible with respect to region A.The picture 317 is encoded into the video data stream 300 in the picture region A outside the second picture subregion B in a manner using temporal prediction, the temporal prediction at least partially referring to the second picture subregion B of the reference picture among the picture 317 and the picture B. That is, in . Fig. 22 In the case of , the complete picture area (i.e. not only A but also B) can be used for reference by the temporal prediction code processing area A of picture 317. Picture 317' located after picture A in decoding order (i.e. between A and Fig. 22 A picture 317′ between subsequent pictures of type B (not shown in the figure) will be encoded into the video data stream 300, wherein within the picture region A located outside the second picture sub-region B, the temporal prediction is restricted to not refer to the second picture sub-region B of the preceding reference picture (among picture A and picture 317′) in decoding order. That is, in Fig. 22 In the case of , only region A can be used for reference by the temporal prediction code processing region A of picture 317 ′. The same is true for sub-region B: picture B follows sub-region B within sub-region B, and the code processing of B in picture B can use A in addition to sub-region A. In this case, stream 300 will no longer be able to be reduced with respect to sub-region B.

[0319] The following description is configured to decode Fig. 22 Before decoding the video data stream 300 of FIG. 304 , it should be noted that the video encoder 316 may be configured to provide the video data stream 300 with a signal 319 indicating, in a range relating to the entire video 304 or in a range comprising a sequence of pictures 302 , a spatial subdivision of the corresponding picture into sub-regions A and B or according to any alternative scheme (e.g. Figures 23a to 23e Encoder 316 also provides to data stream 300 a signal 318 indicating pictures A and B, i.e., signal 318 marks certain pictures as sub-region-specific random access points with respect to any sub-region indicated by signal 319. In other words, signal 319 informs of a constant spatial subdivision among the pictures for which signal 319 is valid, and signal 318 distinguishes sub-region-specific random access pictures from other pictures and associates these sub-region random access pictures with one of sub-regions A and B.

[0320] In terms of picture type, pictures B and A may not be specifically distinguished from other pictures in the video data stream 300. Fig. 22In the example of , pictures B and A are "only" sub-region specific random access pictures and are therefore not real picture-wise random access pictures (e.g., IDR, etc.). Therefore, with respect to the picture type signal 320 within the video data stream 300, the video data stream 300 may not distinguish between pictures B and A and other temporally predicted pictures. For example, the signal 318 may be included in a slice or a slice header of these slices (the picture 302 is coded into the stream 300 in units of slices), thereby indicating that the picture area corresponding to the corresponding slice forms segment B. Alternatively, a combination of signals 320 and 318 may be used to indicate to the decoder that a certain picture is a sub-region specific random access picture and that it belongs to a certain sub-region. For example, the signal 320 may be used to indicate that certain pictures are sub-region specific random access pictures, however, without revealing which sub-region the corresponding picture represents a sub-region specific random access point. The latter indication will be performed by signal 318, which will associate a certain picture notified by signal 320 as a sub-region-specific random access picture with any sub-region of the picture subdivision notified by signal 319. However, alternatively, signal 320 (which can be a NAL unit type syntax element) not only distinguishes or differentiates between temporally predicted pictures such as B and P pictures, picture-wise random access pictures such as IDR pictures, and sub-region-wise random access points such as pictures A and B, but also distinguishes or differentiates sub-region-wise random access points associated with different sub-regions (i.e., distinguishes or differentiates pictures A and B) by using different values ​​for each of pictures A and B.

[0321] The video encoder 316 may insert another signal 321 in order to inform the data stream 300 for a certain sub-region whether it is possible to reduce the data stream 300 with respect to the corresponding sub-region. The signal 321 may be signaled within the data stream 300 to allow one of the sub-regions to be informed as a sub-region of the data stream 300 with respect to which it can be reduced, while the other sub-region does not constitute a sub-region of the data stream 300 with respect to which it can be reduced. Alternatively, the signal 321 may only allow a binary signal with respect to the reducibility of all sub-regions, i.e. the signal 321 may inform that all sub-regions are sub-regions of the data stream 300 with respect to which they can be reduced, or that the data stream 300 with respect to any of these sub-regions cannot be reduced. However, the signal 321 may also be removed so that, for example, Fig. 22 Sub-regions such as sub-regions A and B in the example are either treated as completely independently code-processed sub-regions (with respect to which the data stream 300 can be reduced separately) or are not treated as such sub-regions, in which case the above-mentioned asymmetric code processing dependencies across sub-region boundaries are used as described above.

[0322] Although sub-regions B and A have been shown so far as to be contiguous regions, it should be noted that sub-regions B and A may alternatively be non-contiguous regions (e.g., a set of tiles of picture 302), where reference Figures 1 to 13 With reference to the description of the specific processing of the tiles, according to this example, the picture 302 can be coded into the data stream 300 in tiles.

[0323] about Fig.23c , note that since picture A will be a picture-wise random access picture, the picture type of picture A will be different from the picture types of other temporal prediction pictures, so picture A will be signaled in the picture type signal 320.

[0324] Fig.24 A video decoder 330 is shown which is configured to decode the video data stream 300 in a manner that utilizes pictures B and A. Fig.24 The video data stream 300 corresponds to Fig. 22 , i.e., sub-region-related random access pictures B and A are interspersed between pictures 302 of a video 304 encoded into a video data stream 300. When randomly accessing the video data stream 300, the video decoder 330 is configured to wait for the next random access picture (i.e., any sub-region-related or picture-wise random access picture) to appear. In the case where the video data stream 300 does not include picture-wise random access pictures, the video decoder 330 may not even respond to such pictures. In any case, once the video decoder 330 encounters the first sub-region-related random access picture ( Fig.24 ), the video decoder 330 restarts decoding the video data stream 300. Starting from this picture B, the video decoder 330 starts to reconstruct, decode and output the pictures 322 that only display the sub-region B. An alternative is that the video decoder 330 also decodes, reconstructs and outputs the parts of these pictures 322 that are located outside the sub-region B, and provides or does not provide signaling accompanying these pictures, which indicates to a presentation device such as a display device that the parts of these pictures that are located outside the sub-region B suffer from drift errors because the reference picture of the external sub-region is missing.

[0325] The video decoder 330 continues to decode the video data stream 300 in this manner until the next random access picture is encountered, i.e. Fig.24 Since sub-region A represents a random access point for the remaining picture area (i.e., the area of ​​picture 302 outside sub-region B), the video decoder 330 completely decodes, reconstructs, and outputs picture 302 starting from picture A. That is, by referring to Fig.24The functionality described provides the user with an opportunity to take advantage of seeing the video 304 earlier, at least with respect to sub-region B (i.e., the sub-region of the first encountered sub-region-related random access picture B). Then, after encountering the next sub-region-related random access picture related to the sub-region covering the rest of the picture 302, the video decoder 330 is able to provide the complete picture 302 without drift errors. Fig.23e In the example of , this is the case after encountering the first of the sub-region-specific random access pictures relating to sub-regions A, B and C, respectively.

[0326] Fig.25 302. An alternative mode of operation of the video decoder 330 is shown. Here, the video decoder 330 begins decoding and reconstructing sub-region B from the moment it encounters the first sub-region-specific random access picture, here picture B, but the video decoder 330 waits until enough random access pictures have been encountered so that their sub-regions cover the entire picture area of ​​the picture 302, after which the video decoder 330 actually outputs the picture 302 in its entirety. In the case of this example, this is the case when picture A is encountered following picture B. That is, starting with picture A, the video decoder 330 outputs picture 302, even though sub-region B is available starting with picture B.

[0327] Fig.26 A network device 322 is shown that receives a video data stream 300 including sub-region-specific random access pictures. However, this time, the video data stream 300 is downscalable with respect to one or more sub-regions of the sub-region-specific random access pictures. For example, Fig.26 The video data stream 300 is shown to be able to be reduced with respect to the sub-area B. With respect to the reducibility and corresponding functionality of the network device 322, it should be noted that the functionality may or may not be based on the corresponding Figures 1 to 13. In any case, the aforementioned signal 318 is used to indicate picture B within the video data stream 300. In the case of reducing the video data stream 300 so as to be related only to picture B, the network device 322 extracts from the video data stream 300, or reduces the video data stream 300 to a reduced video data stream 324, and the picture 326 of the reduced video data stream 324 constitutes a video 328 that only displays the content of sub-region B of the video 304 (i.e., the non-reduced video data stream 300). However, by this measure, sub-region B no longer represents a sub-region with respect to picture 326, so the reduced video data stream 324 no longer includes the signal 318. Instead, the picture of the video 328 corresponding to the sub-region B of the random access picture B specific to the sub-region of the video data stream is notified as a random access picture (e.g., an IDR picture, etc.) in a picture-wise manner within the reduced video data stream 324 by the picture type signal 320. There are many ways in which this can be done. For example, in addition to (in the case where the network device 322 is configured to correspond to the network device 60) the aforementioned Figure 5 and Figure 7 In addition to the described redirection and / or parameter set revision, the network device 322 itself may change the picture type signal 320 in the NAL unit header of the corresponding NAL unit when downscaling the video data stream 300 to the downscaled video data stream 324 .

[0328] For the sake of completeness, Fig. 27 shows a configuration to process Fig. 20 The data flow 20 of the network device 231. However, Fig. 20 It is shown that the information 206′ may or may not be present in the downscalable video data stream 200, for example in the information 50. Thus, the network device 231 may be configured as described above either to discard the shift information 206 and to transfer only the sub-region-specific shift information 206′ from the video data stream 200 to the downscaled video data stream 232 when downscaling the video data stream 200 to the downscaled video data stream 232, or the network device 231 itself may re-adjust the shift information 206 to be sub-region-specific shift information 206 based on the knowledge of the position of the sub-region 22 relative to the picture of the downscalable video data stream 200.

[0329] Thus, for example, the above description discloses processing and signaling for extracting a set of patches with constrained temporal motion and inter-layer prediction. Extraction or spatial subsets of a coding process video bitstream using single-layer or multi-layer video coding is also described.

[0330] According to the embodiments of the present disclosure, the following implementations are provided as examples.

[0331] Embodiment 1. A data stream, in which a picture (204) is encoded, the data stream comprising:

[0332] Shift information (206), for a set of at least one predetermined sub-areas (214) of the picture (204), the shift information (206) indicating a shift (218) of the set of at least one predetermined sub-areas within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-areas to a target picture area (216).

[0333] Embodiment 2. The data stream of embodiment 1, wherein the shift information (206) indicates the shift (218) in units of one of:

[0334] Image samples,

[0335] The picture is subdivided into tiles, the picture is code-processed in units of the tiles without code-processing interdependencies, and each sub-area in a set of at least one sub-area (214) is composed of the tiles.

[0336] Embodiment 3. A data stream according to embodiment 1, wherein the set of at least one sub-region of the picture is a subset of a gap-free and non-overlapping spatial division of the picture into an array of sub-regions.

[0337] Embodiment 4. The data stream of embodiment 1, wherein the shift information comprises:

[0338] a count of predetermined sub-regions within a set of at least one predetermined sub-region of the picture (220);

[0339] a size parameter (222) defining the size of the target picture area, and

[0340] for each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture, the coordinates (224) of the displacement of the corresponding predetermined sub-area of ​​the picture within the target picture area; or

[0341] For each predetermined sub-area in a set of at least one predetermined sub-area of ​​the picture, the shift information includes: first position information about the position of the corresponding predetermined sub-area in the target area; second information about the position of the corresponding predetermined area within the picture; and information about rotation and / or mirroring when mapping the corresponding predetermined sub-area between the target area and the picture.

[0342] Embodiment 5. The data stream according to embodiment 4, wherein the shift information further indicates a scaling ratio (226) of the corresponding sub-area within the target picture area.

[0343] Embodiment 6. A data stream according to embodiment 1, wherein the data stream further comprises default filling information (228), the default filling information (228) indicating a default filling for filling a portion (130) of the target picture area (216), the portion (130) being neither covered by any predetermined sub-area in a set of at least one predetermined sub-area of ​​the picture shifted according to the shift information, and if the set of at least one predetermined sub-area does not completely cover the picture (204), it is also not covered by any unshifted portion of the picture.

[0344] Embodiment 7. A data stream according to embodiment 1, wherein a sequence of pictures is encoded in the data stream, and wherein the shift information is valid for the sequence of pictures.

[0345] Embodiment 8. A decoder for decoding a data stream encoded with a picture, the decoder comprising:

[0346] a decoding core (234) configured to reconstruct the picture from the data stream, and

[0347] The shifter (236) is configured to synthesize a target picture based on the picture by shifting each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture within a target picture area according to shift information contained in the data stream.

[0348] Embodiment 9. A decoder according to embodiment 8, wherein the shifter is configured to: if the set of at least one predetermined sub-area does not completely cover the picture (204), copy any unshifted portion of the picture to the target picture area (216) in an unshifted manner.

[0349] Embodiment 10. The decoder of embodiment 8, wherein the shift information indicates a shift of the corresponding sub-field in units of:

[0350] Image samples,

[0351] The picture is subdivided into tiles, the picture is code-processed in units of the tiles without code-processing interdependencies, and each sub-area in a set of at least one sub-area (214) is composed of the tiles.

[0352] Embodiment 11. A decoder according to embodiment 8, wherein the set of at least one sub-region of the picture is a subset of a gap-free and non-overlapping spatial partition of the picture into an array of sub-regions.

[0353] Embodiment 12. The decoder of embodiment 8, wherein the shifter is configured to:

[0354] As part of the shift information, read from the data stream:

[0355] a count of predetermined sub-areas within a set of at least one predetermined sub-areas of the picture,

[0356] a size parameter defining the size of the target image area,

[0357] for each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture, the coordinates of the displacement of the corresponding predetermined sub-area of ​​the picture within the target picture area,

[0358] Each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture is shifted relative to the superposition of the picture onto the target picture area according to the shifted coordinates read for the corresponding predetermined sub-area.

[0359] Embodiment 13. A decoder according to embodiment 12, wherein the shifter is configured to synthesize a target picture based on the picture in the following manner: according to the shift information contained in the data stream, each predetermined sub-area in a set of at least one predetermined sub-area of ​​the picture is scaled within the target picture area, wherein each predetermined sub-area is a predetermined sub-area that is shifted according to the shift information relative to a lossless copy of the picture to the target picture area.

[0360] Embodiment 14. A decoder according to embodiment 8, wherein the shifter is configured to fill a portion of the target picture area according to default filling information contained in the data stream, wherein any one of a set of at least one predetermined sub-area of ​​the picture is not shifted to the portion of the target picture area according to the shift information, and if the set of at least one predetermined sub-area does not completely cover the picture (204), any non-shifted portion of the picture is not located in the portion of the target picture area.

[0361] Embodiment 15. A decoder according to embodiment 8, wherein the decoding core is configured to reconstruct a sequence of pictures from the data stream, and the shifter is configured to apply the shift information to pictures of the sequence of pictures.

[0362] Embodiment 16. The decoder of embodiment 8 further comprising:

[0363] A renderer (238) is configured to apply a single shot projection to the target image region to form an output image.

[0364] Embodiment 17. An encoder for encoding a picture into a data stream, the encoder configured to provide to the data stream:

[0365] Shift information (206), for a set of at least one predetermined sub-areas (214) of the picture (204), the shift information (206) indicating a shift (218) of the set of at least one predetermined sub-areas within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-areas to a target picture area (216).

[0366] Embodiment 18. A network device configured to reduce a data stream (200) encoding a first picture to a reduced data stream (232) encoding a sub-region-specific picture, the sub-region-specific picture showing a predetermined sub-region of the first picture, wherein the data stream (200) comprises shift information (206), for a set of at least one predetermined sub-region of the first picture, the shift information (206) indicating a shift (218) of the set of at least one predetermined sub-region (214) within the target picture region (216) relative to a non-shifted copy of the set of at least one predetermined sub-region to a target picture region (216), wherein:

[0367] The network device is configured to modify the shift information (206) into modified shift information (206') so that in the target picture area, the following two coincide: the sub-region-specific picture copied to the target picture area by shifting a set of at least one predetermined sub-area in the sub-region-specific picture according to the modified shift information and the predetermined sub-area of ​​the first picture copied to the target picture area by shifting a set of at least one predetermined sub-area (214) of the picture (12) according to the shift information, and replace the shift information with the modified shift information when reducing the data stream, or

[0368] The modified shift information is included in a data stream associated with the predetermined sub-region of the first picture, and the shift information is included in a data stream associated with the first picture, and the network device is configured to remove the shift information when reducing the data stream and transfer the modified shift information to the reduced data stream so as to be associated with the sub-region-specific picture.

[0369] Embodiment 19. A method for decoding a data stream, wherein the data stream has a picture encoded therein, the method comprising:

[0370] reconstructing the picture from the data stream, and

[0371] A target picture is synthesized based on the picture by shifting each predetermined sub-region of a set of at least one predetermined sub-region of the picture within a target picture region according to shift information included in the data stream.

[0372] Embodiment 20. A method for encoding a picture into a data stream, the method comprising providing shift information (206) to the data stream, wherein, for a set of at least one predetermined sub-areas (214) of the picture (204), the shift information (206) indicates a shift (218) of the set of at least one predetermined sub-areas within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-areas to a target picture area (216).

[0373] Embodiment 21. A method for reducing a data stream (200) encoding a first picture into a reduced data stream (232) encoding a sub-region-specific picture, the sub-region-specific picture showing a predetermined sub-region of the first picture, wherein the data stream (200) comprises shift information (206), for a set of at least one predetermined sub-region of the first picture, the shift information (206) indicating a shift (218) of the set of at least one predetermined sub-region (214) within a target picture region relative to a non-shifted copy of the set of at least one predetermined sub-region to a target picture region (216), wherein

[0374] The method comprises: modifying the shift information (206) into modified shift information (206') so that in the target picture area, the following two coincide: the sub-region-specific picture copied to the target picture area by shifting a set of at least one predetermined sub-area in the sub-region-specific picture according to the modified shift information and the predetermined sub-area of ​​the first picture copied to the target picture area by shifting a set of at least one predetermined sub-area (214) of the picture (12) according to the shift information, and replacing the shift information with the modified shift information when reducing the data stream, or

[0375] The modified shift information is included in a data stream associated with the predetermined sub-region of the first picture, and the shift information is included in a data stream associated with the first picture, and the method includes removing the shift information when reducing the data stream and transferring the modified shift information to the reduced data stream so as to be associated with the sub-region-specific picture.

[0376] Embodiment 22. A digital storage medium having stored thereon the data stream according to embodiment 1.

[0377] Embodiment 23. A computer program having a program code for executing the method according to embodiment 19, 20 or 21 when the program code is run on a computer.

[0378] Embodiment 24. A video data stream representing a video (14), comprising:

[0379] A parameter set portion (16), indicating code processing parameter settings (20);

[0380] a payload portion (18), wherein the pictures (12) of the video are transcoded into the payload portion (18) in a manner using a first set (20a) of transcoding parameter settings (20) as parameters, wherein the payload portion includes an index (48) indexing the first set (20a),

[0381] The video data stream includes information (50), and the information (50) includes:

[0382] an indication (52) of a predetermined sub-region (22) of the picture (12); and a replacement index (54) for redirecting (72) the index (48) included by the payload portion to refer to a second set (20b) of code processing parameter settings,

[0383] The second set (20b) of code processing parameters is selected so that the reduced video data stream (62) has a reduced payload portion, and the reduced video data stream (62) is modified as follows compared to the video data stream:

[0384] Reference to the image (12) with the payload portion (18) removed (68)

[0385] a portion (70) of an area outside the predetermined sub-area (22), and

[0386] changing (78) the position indication (32) in the payload portion (18) so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region (22) rather than a perimeter of the picture (12),

[0387] In the reduced payload part, a sub-region specific picture (86) showing the predetermined sub-region (22) of the picture is encoded using the second set (20b) of code processing parameter settings as a parameter.

[0388] Embodiment 25. A video data stream representing a video (14), comprising:

[0389] A parameter set portion (16), indicating code processing parameter settings (20);

[0390] a payload portion (18), wherein the pictures (12) of the video are transcoded into the payload portion (18) in a manner using a first set (20a) of transcoding parameter settings (20) as parameters, wherein the payload portion includes an index (48) indexing the first set (20a),

[0391] The video data stream includes information (50), and the information (50) includes:

[0392] an indication (52) of a predetermined sub-region (22) of the picture (12); and a replacement parameter (56) for adjusting (88) the first set (20a) of code processing parameter settings to obtain a second set (20b) of code processing parameter settings, wherein the code processing parameter settings define a buffer size and timing (46),

[0393] The second set (20b) of code processing parameters is selected so that the reduced video data stream (62) has a reduced payload portion, and the reduced video data stream (62) is modified as follows compared to the video data stream:

[0394] Reference to the image (12) with the payload portion (18) removed (68)

[0395] a portion (70) of an area outside the predetermined sub-area (22), and

[0396] changing (78) the position indication (32) in the payload portion (18) so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region (22) rather than a perimeter of the picture (12),

[0397] In the reduced payload part, a sub-region specific picture (86) showing the predetermined sub-region (22) of the picture is encoded using the second set (20b) of code processing parameter settings as a parameter.

[0398] Embodiment 26. The video data stream according to embodiment 24 or 25, wherein the video data stream and the reduced video data stream (62) conform to HEVC.

[0399] Embodiment 27. A video data stream according to embodiment 24 or 25, wherein the parameter set part is included in an SPS NAL unit and / or a VPS NAL unit and / or a PPS NAL unit.

[0400] Embodiment 28. The video data stream of embodiment 24 or 25, wherein the code processing parameter setting defines one or more of the following:

[0401] Image size (26),

[0402] Block structure (38),

[0403] Buffer size and timing (46).

[0404] Embodiment 29. A video data stream according to embodiment 24 or 25, wherein the index (48) is contained in a slice header of a slice (34) of the payload portion (18), each slice encoding a corresponding area (36) of a picture (12), and the corresponding area (36) does not cross the boundary of the predetermined sub-area (22).

[0405] Embodiment 30. A video data stream according to embodiment 24 or 25, wherein the information is contained in a SEI message, a VUI or a parameter set extension.

[0406] Embodiment 31. A video data stream according to embodiment 24 or 25, wherein pictures of the video are encoded into the payload portion in units of patches (42), the pictures are subdivided into the patches, and the patches are arranged in a patch array of columns and rows, wherein the indication (52) indicates the predetermined sub-area as a collection of the patches.

[0407] Embodiment 32. A video data stream according to embodiment 31, wherein the pictures of the video are encoded into the payload portion in units of patches (42), so that the payload portion is subdivided in units of slices (34), each slice being encoded with a corresponding area of ​​the picture, and the corresponding area does not cross the patch boundaries (40) between the patches.

[0408] Embodiment 33. A video data stream according to embodiment 24 or 25, wherein:

[0409] The part of said first set (20a) of code processing parameter settings indexed by said index (48) for which said redirection (72) is to be performed by said replacement index and / or replaced by said replacement parameters belongs to one or more of the following:

[0410] Image size (26),

[0411] Block structure (38),

[0412] Buffer size and timing (46).

[0413] Embodiment 34. A video data stream according to embodiment 24 or 25, wherein the picture (12) of the video is coded into the payload portion (18) so that the temporal prediction across the boundary of the predetermined sub-region (22) is interrupted when the picture is coded within the predetermined sub-region (22).

[0414] Embodiment 35. An encoder for encoding a video into a video data stream, comprising:

[0415] a parameter setter (80a) configured to determine a code processing parameter setting (20) and generate a parameter set portion (16) of the video data stream indicating the code processing parameter setting;

[0416] a code processing core (80b) configured to encode pictures of the video into a payload portion of the video data stream using a first set (20a) of code processing parameter settings as parameters, wherein an index (48) included in the payload portion indexes the first set,

[0417] The encoder is configured to provide information (50) to the video data stream, the information (50) comprising:

[0418] an indication of a predetermined sub-region (22) of the picture (12); and

[0419] a replacement index (54) for redirecting said index comprised by said payload portion to reference a second set of code processing parameter settings,

[0420] The second set of code processing parameters is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream:

[0421] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0422] changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0423] In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

[0424] Embodiment 36. An encoder for encoding a video into a video data stream, comprising:

[0425] a parameter setter (80a) configured to determine a code processing parameter setting (20) and generate a parameter set portion (16) of the video data stream indicating the code processing parameter setting;

[0426] a code processing core (80b) configured to encode pictures of the video into a payload portion of the video data stream using a first set (20a) of code processing parameter settings as parameters, wherein an index (48) included in the payload portion indexes the first set,

[0427] The encoder is configured to provide information (50) to the video data stream, the information (50) comprising:

[0428] an indication of a predetermined sub-region (22) of the picture (12); and

[0429] replacement parameters (56) for adjusting the first set of code processing parameter settings to obtain a second set of code processing parameter settings, wherein

[0430] The code processing parameter settings define buffer size and timing (46),

[0431] The second set of code processing parameters is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream:

[0432] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0433] changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0434] In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

[0435] Embodiment 37. An encoder according to embodiment 35 or 36, wherein the video data stream and the reduced video data stream comply with HEVC.

[0436] Embodiment 38. An encoder according to embodiment 35 or 36, wherein the parameter set part is included in an SPS NAL unit and / or a VPS NAL unit and / or a PPS NAL unit.

[0437] Embodiment 39. An encoder according to embodiment 35 or 36, wherein the code processing parameter setting defines one or more of the following:

[0438] Image size,

[0439] Block structure,

[0440] Buffer size and timing.

[0441] Embodiment 40. An encoder according to embodiment 35 or 36, wherein the encoder is configured to insert the index into a slice header of a slice of the payload portion and encode a corresponding area of ​​the picture into each slice, wherein the corresponding area does not cross a boundary of the predetermined sub-area.

[0442] Embodiment 41. An encoder according to embodiment 35 or 36, wherein the encoder is configured to insert the information into a SEI message, a VUI, or a parameter set extension.

[0443] Embodiment 42. An encoder according to embodiment 35 or 36, wherein the encoder is configured to encode pictures of the video into the payload portion in units of patches, the pictures being subdivided into the patches, and the patches being arranged in a patch array of columns and rows, wherein the indication indicates the predetermined sub-area as a collection of the patches.

[0444] Embodiment 43. An encoder according to embodiment 42, wherein the encoder is configured to encode the pictures of the video into the payload part in units of patches, so that the payload part is subdivided in units of slices, and each slice is encoded with a corresponding area of ​​the picture, and the corresponding area does not cross the patch boundaries between the patches.

[0445] Embodiment 44. An encoder according to embodiment 35 or 36, wherein:

[0446] The part of the first set of code processing parameter settings indexed by the index for which the redirection is to be performed by the replacement index and / or replaced by the replacement parameters belongs to one or more of the following:

[0447] Image size,

[0448] Block structure,

[0449] Buffer timing.

[0450] Embodiment 45. An encoder according to embodiment 35 or 36, wherein the encoder is configured to encode the picture of the video into the payload portion so that the temporal prediction across the boundary of the predetermined sub-region (22) is interrupted when the picture is coded within the predetermined sub-region (22).

[0451] Embodiment 46. A network device for processing a video data stream, the video data stream comprising:

[0452] The parameter set part indicates the code processing parameter settings;

[0453] a payload portion, wherein the pictures of the video are transcoded into the payload portion in a manner using a first set of transcoding parameter settings as parameters, wherein the index included in the payload portion indexes the first set,

[0454] Wherein, the network device is configured as:

[0455] Information is read (64) from the video data stream, the information comprising:

[0456] an indication of a predetermined sub-region of the picture; and

[0457] a replacement index for redirecting said index comprised by said payload portion to reference a second set of code processing parameter settings,

[0458] The video data stream is reduced (66) to a reduced video data stream by making the following modifications:

[0459] performing said redirecting (72) and / or adjusting (88) so that said second set of code processing parameter settings is indexed by an index of said payload portion;

[0460] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0461] changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0462] The reduced video data stream is caused to have a reduced payload portion in which a sub-region-specific picture showing the predetermined sub-region of the picture is encoded in a manner using the second set of code processing parameter settings as a parameter.

[0463] Embodiment 47. A network device for processing a video data stream, the video data stream comprising:

[0464] The parameter set part indicates the code processing parameter settings;

[0465] a payload portion, wherein the pictures of the video are transcoded into the payload portion in a manner using a first set of transcoding parameter settings as parameters, wherein the index included in the payload portion indexes the first set,

[0466] Wherein, the network device is configured as:

[0467] Information is read (64) from the video data stream, the information comprising:

[0468] an indication of a predetermined sub-region of the picture; and

[0469] replacing parameters for adjusting the first set of code processing parameter settings to obtain a second set of code processing parameter settings, wherein the code processing parameter settings define buffer size and timing (46),

[0470] The video data stream is reduced (66) to a reduced video data stream by making the following modifications:

[0471] performing said redirecting (72) and / or adjusting (88) so that said second set of code processing parameter settings is indexed by an index of said payload portion;

[0472] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0473] changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0474] The reduced video data stream is caused to have a reduced payload portion in which a sub-region-specific picture showing the predetermined sub-region of the picture is encoded in a manner using the second set of code processing parameter settings as a parameter.

[0475] Embodiment 48. A network device according to embodiment 46 or 47, wherein the video data stream and the reduced video data stream comply with HEVC.

[0476] Embodiment 49. A network device according to embodiment 46 or 47, wherein the parameter set part is included in an SPS NAL unit and / or a VPS NAL unit and / or a PPS NAL unit.

[0477] Embodiment 50. The network device of embodiment 46 or 47, wherein the code processing parameter setting defines one or more of the following:

[0478] Image size,

[0479] Block structure,

[0480] Buffer size and timing.

[0481] Embodiment 51. A network device according to embodiment 46 or 47, wherein the network device is configured to locate the index in a slice header of a slice of the payload portion, each slice encoding a corresponding area of ​​a picture, and the corresponding area does not cross the boundary of the predetermined sub-area.

[0482] Embodiment 52. A network device according to embodiment 46 or 47, wherein the network device is configured to read the information from a SEI message, a VUI or a parameter set extension of the video data stream.

[0483] Embodiment 53. A network device according to embodiment 46 or 47, wherein the pictures of the video are coded into the payload part in units of tiles, the pictures are subdivided into the tiles, and the tiles are arranged in a tile array of columns and rows, wherein the indication indicates the predetermined sub-area as a collection of the tiles.

[0484] Embodiment 54. A network device according to embodiment 53, wherein the pictures of the video are coded into the payload part in units of patches, so that the payload part is subdivided in units of slices, each slice being encoded with a corresponding area of ​​the picture, and the corresponding area does not cross the patch boundaries between the patches.

[0485] Embodiment 55. A network device according to embodiment 46 or 47, wherein:

[0486] The part of the first set of code processing parameter settings indexed by the index for which the redirection is to be performed by the replacement index and / or replaced by the replacement parameters belongs to one or more of the following:

[0487] Image size,

[0488] Block structure,

[0489] Buffer size and timing.

[0490] Embodiment 56. A network device according to embodiment 46 or 47, wherein the picture (12) of the video is coded into the payload portion (18) so that the temporal prediction across the boundary of the predetermined sub-region (22) is interrupted when the picture is coded within the predetermined sub-region (22).

[0491] Embodiment 57. The network device of embodiment 46 or 47, wherein the network device is one of:

[0492] a video decoder capable of decoding the video data stream and the reduced video data stream,

[0493] a video decoder having a profile level sufficient to enable said video decoder to decode said reduced video data stream, but having a profile level insufficient to enable said video decoder to decode said video data stream, and

[0494] The network device is configured to forward one of the video data stream and the reduced video data stream to a video decoder according to a control signal.

[0495] Embodiment 58. A network device according to embodiment 46 or 47, wherein the video data stream comprises shift information (206), and for a set of at least one predetermined sub-areas (214) of the picture (12), the shift information (206) indicates a shift of the set of at least one predetermined sub-areas within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-areas to the target picture area, and

[0496] The network device is configured to modify the shift information into modified shift information (206') so that within the target picture area (216), the following two coincide: the sub-region-specific picture copied to the target picture area by shifting a predetermined sub-area in the sub-region-specific picture according to the modified shift information and the predetermined sub-area (22) of the picture (12) copied to the target picture area by shifting a set of at least one predetermined sub-area (214) of the picture (12) according to the shift information, and, when reducing the video data stream, replace the shift information (206) with the modified shift information (206'), or

[0497] The modified shift information (206') is included in a video data stream associated with the predetermined sub-region (22) of the picture (12), and the shift information (206) is included in a video data stream associated with the picture, and the network device is configured to remove the shift information (206) when reducing the video data stream and transfer the modified shift information (206') to the reduced video data stream so as to be associated with the sub-region-specific picture (86).

[0498] Embodiment 59. A video data stream representing a video (14), comprising:

[0499] a payload portion (18) into which the pictures (12) of the video are coded; and

[0500] a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18),

[0501] The video data stream includes information (50), and the information (50) includes:

[0502] an indication (52) of a predetermined sub-region (22) of the picture (12); and a replacement supplementary enhancement information message for replacing the supplementary enhancement information message,

[0503] The replacement supplemental enhancement information message is selected so that the reduced video data stream (62) has a reduced payload portion, and the reduced video data stream (62) is modified as follows compared to the video data stream:

[0504] Reference to the image (12) with the payload portion (18) removed (68)

[0505] a portion (70) of an area outside the predetermined sub-area (22), and

[0506] changing (78) the position indication (32) in the payload portion (18) so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region (22) rather than a perimeter of the picture (12),

[0507] In the reduced payload portion, a sub-region specific picture (86) showing the predetermined sub-region (22) of the picture is encoded in a manner such that the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the manner in which the sub-region specific picture (86) is coded into the reduced payload portion (18).

[0508] Embodiment 60. A video data stream according to embodiment 59, wherein the supplemental enhancement information belongs to buffer size and / or buffer timing data.

[0509] Embodiment 61. An encoder for encoding a video into a video data stream, comprising:

[0510] a code processing core (80b) configured to encode the pictures of the video into the payload portion of the video data stream, and

[0511] A parameter setter (80a) configured to generate a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18);

[0512] The encoder is configured to provide information (50) to the video data stream, the information (50) comprising:

[0513] an indication of a predetermined sub-region (22) of the picture (12); and

[0514] a replacement supplementary enhancement information message for replacing the supplementary enhancement information message,

[0515] The replacement supplemental enhancement information message is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream:

[0516] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0517] changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0518] In the reduced payload portion, a sub-region-specific picture displaying the sub-region of the picture is encoded in a manner such that the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the manner in which the sub-region-specific picture (86) is coded into the reduced payload portion (18).

[0519] Embodiment 62. An encoder according to embodiment 61, wherein the supplemental enhancement information belongs to buffer size and / or buffer timing data.

[0520] Embodiment 63. A network device for processing a video data stream, the video data stream comprising:

[0521] a payload portion into which pictures of the video are transcoded; and

[0522] a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18),

[0523] Wherein, the network device is configured as:

[0524] Information is read (64) from the video data stream, the information comprising:

[0525] an indication of a predetermined sub-region of the picture; and

[0526] a replacement supplementary enhancement information message for replacing the supplementary enhancement information message,

[0527] The video data stream is reduced (66) to a reduced video by making the following modification

[0528] Data flow:

[0529] replacing the supplemental enhancement information message by the replacement supplemental enhancement information message,

[0530] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0531] changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0532] The reduced video data stream has a reduced payload portion, in which a sub-region-specific picture displaying the predetermined sub-region of the picture is encoded, and the encoding method is such that: the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the method of coding the sub-region-specific picture (86) into the reduced payload portion (18).

[0533] Embodiment 64. A network device for processing a video data stream, configured to:

[0534] Receiving a video data stream, the video data stream comprising a portion of a payload portion into which pictures of a video are transcoded, wherein the portion of the payload portion corresponds to an exclusion of portions of the payload portion that reference a picture area that is outside a predetermined sub-area of ​​the picture, wherein the pictures of the video are transcoded into the payload portion in the following manner:

[0535] without excluding the use of code processing parameter settings in a parameter set portion of the video data stream as parameters, and / or

[0536] matches the supplemental enhancement information indicated by the supplemental enhancement message of the video data stream without exclusion,

[0537] The video data stream is modified by:

[0538] changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, and

[0539] The coding parameter settings in the parameter set part and / or the supplemental enhancement information message are adjusted so that, in the portion of the payload part of the video data stream, a specific portion of the predetermined sub-area of ​​the picture is displayed in the following manner:

[0540] Encode the image in the sub-region:

[0541] using the code processing parameter settings as parameters, and / or

[0542] Matches the supplemental enhancement information indicated by the adjusted supplemental enhancement information supplemental enhancement message.

[0543] Embodiment 65. According to embodiment 64, the network device is configured to also receive information about the predetermined sub-area (22) together with the video data stream, or to use the information about the predetermined sub-area (22) to limit the downloading of the video data stream so that those parts (70) in the payload part (18) that refer to the picture area outside the predetermined sub-area (22) are not downloaded.

[0544] Embodiment 66. A method for encoding a video into a video data stream, comprising:

[0545] determining a code processing parameter setting (20) and generating a parameter set portion (16) of the video data stream indicating the code processing parameter setting;

[0546] encoding pictures of the video into a payload portion of the video data stream in a manner using a first set (20a) of code processing parameter settings as parameters, the payload portion comprising an index (48) indexing the first set,

[0547] Providing information (50) for the video data stream, the information (50) comprising:

[0548] an indication of a predetermined sub-region (22) of the picture (12); and

[0549] a replacement index (54) for redirecting said index comprised by said payload portion to reference a second set of code processing parameter settings,

[0550] The second set of code processing parameters is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream:

[0551] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0552] changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0553] In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

[0554] Embodiment 67. A method for encoding a video into a video data stream, comprising:

[0555] determining a code processing parameter setting (20) and generating a parameter set portion (16) of the video data stream indicating the code processing parameter setting;

[0556] encoding pictures of the video into a payload portion of the video data stream in a manner using a first set (20a) of code processing parameter settings as parameters, the payload portion comprising an index (48) indexing the first set,

[0557] Providing information (50) for the video data stream, the information (50) comprising:

[0558] an indication of a predetermined sub-region (22) of the picture (12); and

[0559] replacement parameters (56) for adjusting the first set of code processing parameter settings to obtain a second set of code processing parameter settings, wherein

[0560] The code processing parameter settings define buffer size and timing,

[0561] The second set of code processing parameters is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream:

[0562] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0563] changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0564] In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

[0565] Embodiment 68. A method for processing a video data stream, the video data stream comprising:

[0566] The parameter set part indicates the code processing parameter settings;

[0567] a payload portion, wherein the pictures of the video are transcoded into the payload portion in a manner using a first set of transcoding parameter settings as parameters, wherein the index included in the payload portion indexes the first set,

[0568] Wherein, the method comprises:

[0569] Information is read (64) from the video data stream, the information comprising:

[0570] an indication of a predetermined sub-region of the picture; and

[0571] a replacement index for redirecting said index comprised by said payload portion to refer to a second set of code processing parameter settings and / or a replacement parameter for adjusting said first set of code processing parameter settings to obtain the second set of code processing parameter settings,

[0572] The video data stream is reduced (66) to a reduced video data stream by making the following modifications:

[0573] performing said redirecting (72) and / or adjusting (88) so that said second set of code processing parameter settings is indexed by an index of said payload portion;

[0574] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0575] changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0576] The reduced video data stream is caused to have a reduced payload portion in which a sub-region-specific picture showing the predetermined sub-region of the picture is encoded in a manner using the second set of code processing parameter settings as a parameter.

[0577] Embodiment 69. A method for encoding a video into a video data stream, comprising:

[0578] encoding pictures of the video into a payload portion of the video data stream,

[0579] generating a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18);

[0580] Providing information (50) for the video data stream, the information (50) comprising:

[0581] an indication of a predetermined sub-region (22) of the picture (12); and

[0582] a replacement supplementary enhancement information message for replacing the supplementary enhancement information message,

[0583] The replacement supplemental enhancement information message is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream:

[0584] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0585] changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0586] In the reduced payload portion, a sub-region-specific picture displaying the sub-region of the picture is encoded in a manner such that the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the manner in which the sub-region-specific picture (86) is coded into the reduced payload portion (18).

[0587] Embodiment 70. A method for processing a video data stream, the video data stream comprising:

[0588] a payload portion into which pictures of the video are transcoded; and

[0589] a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18),

[0590] Wherein, the method comprises:

[0591] Information is read (64) from the video data stream, the information comprising:

[0592] an indication of a predetermined sub-region of the picture; and

[0593] a replacement supplementary enhancement information message for replacing the supplementary enhancement information message,

[0594] The video data stream is reduced (66) to a reduced video data stream by making the following modifications:

[0595] replacing the supplemental enhancement information message by the replacement supplemental enhancement information message,

[0596] removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and

[0597] changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture,

[0598] The reduced video data stream has a reduced payload portion, in which a sub-region-specific picture displaying the predetermined sub-region of the picture is encoded, and the encoding method is such that: the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the method of coding the sub-region-specific picture (86) into the reduced payload portion (18).

[0599] Embodiment 71. A method for processing a video data stream, comprising:

[0600] Receiving a video data stream, the video data stream comprising a portion of a payload portion into which pictures of a video are transcoded, wherein the portion of the payload portion corresponds to an exclusion of portions of the payload portion that reference a picture area that is outside a predetermined sub-area of ​​the picture, wherein the pictures of the video are transcoded into the payload portion in the following manner:

[0601] without excluding the use of code processing parameter settings in a parameter set portion of the video data stream as parameters, and / or

[0602] matches the supplemental enhancement information indicated by the supplemental enhancement message of the video data stream without exclusion,

[0603] The video data stream is modified by:

[0604] changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, and

[0605] The coding parameter settings in the parameter set part and / or the supplemental enhancement information message are adjusted so that, in the portion of the payload part of the video data stream, a specific portion of the predetermined sub-area of ​​the picture is displayed in the following manner:

[0606] Encode the image in the sub-region:

[0607] using the code processing parameter settings as parameters, and / or

[0608] Matches the supplemental enhancement information indicated by the adjusted supplemental enhancement information supplemental enhancement message.

[0609] Embodiment 72. A digital storage medium having stored thereon a data stream according to embodiment 24, 25 or 59.

[0610] Embodiment 73. A computer program having a program code for executing the method according to embodiment 66 or 67 or 68 or 69 or 70 or 71 when the program code is run on a computer.

[0611] Embodiment 74. A video data stream having a sequence of pictures (302) encoded using temporal prediction such that:

[0612] When encoding a first set of one or more pictures (pictures A) into the video data stream, interrupting temporal prediction at least within a first picture sub-region (A) in order to form a set of one or more first random access points, and

[0613] When encoding a second set of one or more pictures (pictures B) into the video data stream, temporal prediction is interrupted in a second picture sub-region (B) different from the first picture sub-region (A) to form a set of one or more second random access points.

[0614] Embodiment 75. A video data stream according to embodiment 74, wherein the first sub-area and the second sub-area are adjacent to each other without overlapping.

[0615] Embodiment 76. A video data stream according to embodiment 75, wherein the first sub-region and the second sub-region form a non-overlapping and gap-free division of the sequence of pictures (302), and the division is notified (319) by a signal in the video data stream.

[0616] Embodiment 77. A video data stream according to embodiment 76, wherein, when encoding a first set of the one or more pictures (picture A) into the video data stream, temporal prediction on an area of ​​the pictures is completely interrupted so as to form a set of one or more picture-wise random access points.

[0617] Embodiment 78. The video data stream of embodiment 74, wherein:

[0618] When encoding the second set of the one or more pictures (pictures B) into the video data stream, a spatial code processing dependency on a spatial portion outside the second picture sub-region is broken within the second picture sub-region (B).

[0619] Embodiment 79. The video data stream of embodiment 74, further comprising:

[0620] A signal (318) indicates a second set of the one or more pictures (picture B).

[0621] Embodiment 80. A video data stream according to embodiment 79, wherein the signal (318) indicates the second set of one or more pictures (picture B) at least in part through a picture type signal (320) of the video data stream, and the picture type signal (320) distinguishes between picture-wise random access points and sub-region-specific random access points.

[0622] Embodiment 81. A video data stream according to embodiment 80, wherein the signal (318) indicates the second set of the one or more pictures (pictures B) through the picture type signal (320) of the video data stream, and the picture type signal (320) indicates that the second set of the one or more pictures (pictures B) is a sub-region specific random access point, and further associates the second set of the one or more pictures (pictures B) with the second picture sub-region (B).

[0623] Embodiment 82. A video data stream according to embodiment 80, wherein the picture type signal (320) of the video data stream is included in a NAL unit header of the video data stream.

[0624] Embodiment 83. According to embodiment 74, the video data stream further includes: another signal (321) for indicating, for the picture sequence, whether the temporal prediction of the second picture sub-region (B) is restricted to not extend into the picture area of ​​the picture (302) located outside the second picture sub-region when encoding the picture (302) into the video data stream, or whether the extension is allowed.

[0625] Embodiment 84. A video data stream according to embodiment 74, wherein, when a picture (317) located between a picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order is encoded into the video data stream, temporal prediction within the second picture sub-region (B) is restricted so as not to refer to a picture region (A) of a reference picture located outside the second picture sub-region (B).

[0626] Embodiment 85. A video data stream according to embodiment 74, wherein when a picture (317) located between a picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that is subsequent in decoding order is encoded into the video data stream, temporal prediction within a sub-region (B) of the second picture is restricted so as not to refer to a reference picture located upstream relative to the picture (picture B) in the second set of the one or more pictures in decoding order.

[0627] Embodiment 86. A video data stream according to embodiment 84, wherein, when a picture (317) between a picture (picture B) located in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order is encoded into the video data stream, temporal prediction is restricted within a picture area (A) located outside the second picture sub-area (B) so that no reference is made to the second picture sub-area (B) of a reference picture, and the reference picture belongs to any one of the following items: the picture (317) between the picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order; and the picture (picture B) in the second set of the one or more pictures.

[0628] Embodiment 87. The video data stream of embodiment 84, wherein:

[0629] When encoding a picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order into the video data stream, a temporal prediction is used in a picture region (A) that is outside the second picture subregion (B), the temporal prediction at least partially referring to the second picture subregion (B) of a reference picture, the reference picture respectively belonging to any of the following: the picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order; and the one picture (picture B) of the second set of one or more pictures, and

[0630] When encoding a picture (317') that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent in decoding order into the video data stream, temporal prediction is restricted within a picture area (A) that is outside the second picture sub-area (B) so as not to refer to the second picture sub-area (B) of a previous reference picture in decoding order, the previous reference picture belonging to any one of: the one picture (picture A) in the first set of the one or more pictures that are subsequent; and the picture (317') that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent.

[0631] Embodiment 88. An encoder for encoding a sequence of pictures into a video data stream using temporal prediction, the encoder configured to:

[0632] When encoding a first set of one or more pictures into the video data stream, temporal prediction is interrupted at least within a first picture sub-region to form a set of one or more first random access points, and

[0633] When encoding a second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region to form a set of one or more second random access points.

[0634] Embodiment 89. An encoder according to embodiment 88, wherein the first sub-region and the second sub-region are adjacent to each other without overlapping.

[0635] Embodiment 90. An encoder according to embodiment 89, wherein the first sub-region and the second sub-region form a non-overlapping and gap-free division of the sequence of pictures (302), and the encoder is configured to provide a signal (319) in the video data stream, wherein the signal (319) is a signal of the non-overlapping and gap-free division.

[0636] Embodiment 91. An encoder according to embodiment 88 is configured to completely interrupt temporal prediction on a region of the picture when encoding the first set of one or more pictures into the video data stream so as to form a set of picture-wise random access points.

[0637] Embodiment 92. An encoder according to embodiment 88 is configured to interrupt the spatial code processing dependency on the spatial portion outside the second picture sub-region within the second picture sub-region (B) when encoding the second set of one or more pictures into the video data stream.

[0638] Embodiment 93. An encoder according to embodiment 88 is also configured to insert a signal indicating a second set of one or more pictures into the video data stream.

[0639] Embodiment 94. According to embodiment 88, the encoder is configured to insert another signal (321) into the video data stream, wherein the other signal (321) is used to indicate, for the picture sequence, whether the temporal prediction of the second picture sub-region (B) is restricted to not extend into the picture area of ​​the picture (302) located outside the second picture sub-region when encoding the picture (302) into the video data stream, or whether the extension is allowed.

[0640] Embodiment 95. The encoder of embodiment 88, wherein the encoder is configured to:

[0641] When encoding a picture between a picture located in the second set of the one or more pictures and a picture in the first set of the one or more pictures that follows in decoding order into the video data stream, temporal prediction within the second picture sub-region is restricted so as not to refer to a picture region of a reference picture located outside the second picture sub-region.

[0642] Embodiment 96. An encoder according to embodiment 88, wherein the encoder is configured to: when encoding a picture (317) located between a picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that is subsequent in decoding order into the video data stream, restrict the temporal prediction within the second picture sub-region (B) so as not to refer to a reference picture that is located upstream relative to the picture (picture B) in the second set of the one or more pictures in decoding order.

[0643] Embodiment 97. An encoder according to embodiment 95, wherein the encoder is configured to: when encoding a picture (317) located between a picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order into the video data stream, restrict temporal prediction within a picture area (A) located outside the second picture sub-area (B) so as not to refer to the second picture sub-area (B) of a reference picture, wherein the reference picture belongs to any one of the following items: the picture (317) located between the picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order; and the picture (picture B) in the second set of the one or more pictures.

[0644] Embodiment 98. The encoder of embodiment 95, wherein the encoder is configured to:

[0645] When encoding a picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order into the video data stream, a temporal prediction is used in a picture region (A) that is outside the second picture subregion (B), the temporal prediction at least partially referring to the second picture subregion (B) of a reference picture, the reference picture respectively belonging to any of the following: the picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order; and the one picture (picture B) of the second set of one or more pictures, and

[0646] When encoding a picture that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent in decoding order into the video data stream, temporal prediction is restricted within a picture area (A) that is outside the second picture sub-area (B) so as not to refer to the second picture sub-area (B) of a previous reference picture in decoding order, the previous reference picture belonging to any one of the following: the one picture (picture A) in the first set of the one or more pictures that are subsequent; and the picture that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent.

[0647] Embodiment 99. A decoder for decoding a sequence of pictures from a video data stream using temporal prediction, the decoder supporting random access using the following set of random access points:

[0648] a set of one or more first random access points located at a first set of one or more pictures, wherein temporal prediction is interrupted at least within a first picture sub-region when encoding the first set of one or more pictures into the video data stream, and

[0649] A set of one or more second random access points is located at a second set of one or more pictures, and when encoding the second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region.

[0650] Embodiment 100. A decoder according to embodiment 99, configured to: if the current picture is a picture in the second set of one or more pictures,

[0651] The decoding and / or outputting of the sequence of pictures is restarted from the current picture, but at least one of the decoding and / or outputting of the sequence of pictures is pre-limited to the second picture sub-region.

[0652] Embodiment 101. The decoder of embodiment 100 is configured to stop the pre-restriction when encountering a first random access point in the set of first random access points.

[0653] Embodiment 102. The decoder of embodiment 99, configured to: if the current picture is a picture in the first set or the second set of the one or more pictures,

[0654] Restart decoding of the picture sequence from the current picture, but limit the output of the picture sequence until a picture of each set of one or more pictures is encountered after the restart of decoding, wherein, for each set of one or more pictures, when encoding each picture of the corresponding set of one or more pictures into the video data stream, temporal prediction is interrupted within a picture sub-region specific to the corresponding set of one or more pictures, and the sub-regions of the set of one or more pictures are different from each other and together completely cover the picture area of ​​the picture sequence.

[0655] Embodiment 103. A decoder according to embodiment 99, wherein the first sub-region and the second sub-region are adjacent to each other without overlapping, and the encoder is configured to: if the current random access point is one of the second random access points and the next random access point is one of the first access points, limit decoding to the second picture sub-region between the current and next random access points, and extend decoding from the second picture sub-region to also include the first picture sub-region.

[0656] Embodiment 104. A decoder according to embodiment 99, wherein the first sub-region and the second sub-region form a non-overlapping and gap-free division of the sequence of pictures (302), and the decoder is configured to derive the division from a signal (319) in the video data stream.

[0657] Embodiment 105. A decoder according to embodiment 99 is configured to regard the first set of one or more pictures as a set of one or more picture-wise random access points.

[0658] Embodiment 106. The decoder of embodiment 99 is configured to decode the data stream of embodiment 74.

[0659] Embodiment 107. A network device configured to receive a video data stream according to embodiment 74, wherein the video data stream has a sequence of pictures (302) encoded using temporal prediction, wherein the network device is configured to reduce the data stream to obtain a reduced video data stream, in which a sub-region specific picture (326) displaying the second picture sub-region is encoded, and the reduction is performed in the following manner: removing a portion of the video data stream encoding a picture region of the picture located outside the second picture sub-region, and replacing information (318) within the video data stream with picture type information (320), wherein the information (318) within the video data stream indicates a second set of one or more pictures as sub-region specific random access points, and the picture type information (320) indicates the second set of one or more pictures as picture-wise random access pictures.

[0660] Embodiment 108. A method for encoding a sequence of pictures into a video data stream using temporal prediction, the method comprising:

[0661] When encoding a first set of one or more pictures into the video data stream, temporal prediction is interrupted at least within a first picture sub-region to form a set of one or more first random access points, and

[0662] When encoding a second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region to form a set of one or more second random access points.

[0663] Embodiment 109. A method for decoding a sequence of pictures from a video data stream using temporal prediction, the method comprising performing random access to the video data stream using the following set of random access points:

[0664] a set of one or more first random access points located at a first set of one or more pictures, wherein temporal prediction is interrupted at least within a first picture sub-region when encoding the first set of one or more pictures into the video data stream, and

[0665] A set of one or more second random access points is located at a second set of one or more pictures, and when encoding the second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region.

[0666] Embodiment 110. A method comprising:

[0667] receiving a video data stream according to embodiment 74, in which a sequence of pictures (302) is coded using temporal prediction,

[0668] The data stream is reduced to obtain a reduced video data stream, in which a sub-region specific picture (326) displaying the second picture sub-region is encoded, the reduction being performed by removing a portion of the video data stream encoding a picture region of the picture located outside the second picture sub-region and replacing information (318) within the video data stream indicating a second set of one or more pictures as sub-region specific random access points with picture type information (320), the picture type information (320) indicating the second set of one or more pictures as picture-wise random access pictures.

[0669] Embodiment 111. A digital storage medium having stored thereon a data stream according to embodiment 74.

[0670] Embodiment 112. A computer program having a program code for performing the method according to embodiment 108, 109 or 110 when the program code is run on a computer.

[0671] With respect to the above description, it should be noted that any encoder, decoder or network device shown may be embodied or implemented in hardware, firmware or software. When implemented in hardware, the corresponding encoder, decoder or network device may be implemented, for example, in the form of an application specific integrated circuit. If implemented in firmware, the corresponding device may be implemented as a field programmable array, and if implemented in software, the corresponding device may be a processor or computer programmed to perform the described functions.

[0672] Although some aspects have been described in the context of an apparatus, it will be clear that these aspects also represent the description of the corresponding method, wherein a block or device corresponds to a method step or a feature of a method step. Similarly, the aspects described in the context of a method step also represent the description of the item or feature of the corresponding block or corresponding apparatus. Some or all of the method steps may be performed by (or using) a hardware device (such as a microprocessor, a programmable computer or an electronic circuit). In some embodiments, one or more of the most important method steps may be performed by such a device.

[0673] The coded data stream or signal of the present invention can be stored on a digital storage medium, or can be transmitted on a transmission medium such as a wireless transmission medium or a wired transmission medium (e.g., the Internet), etc. Having described inserting or encoding certain information into a data stream, this description is understood as the following disclosure: the resulting data stream includes the corresponding information, the syntax elements of the flags, etc.

[0674] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or in software. Implementation may be performed using a digital storage medium (e.g., a floppy disk, DVD, Blu-ray, CD, ROM, PROM, EPROM, EEPROM, or flash memory) having stored thereon electronically readable control signals that cooperate (or are capable of cooperating) with a programmable computer system to perform the corresponding method. Thus, the digital storage medium may be computer readable.

[0675] Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.

[0676] Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer.The program code may, for example, be stored on a machine readable carrier.

[0677] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

[0678] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0679] A further embodiment of the inventive method is therefore a data carrier (or a digital storage medium or a computer-readable medium) on which is recorded the computer program for performing one of the methods described herein. The data carrier, the digital storage medium or the recorded medium is typically tangible and / or non-transitory.

[0680] Therefore, another embodiment of the inventive method is a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may, for example, be configured to be transmitted via a data communication connection (eg, via the Internet).

[0681] A further embodiment comprises a processing means, for example a computer or a programmable logic device, configured to or adapted to perform one of the methods described herein.

[0682] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

[0683] Another embodiment according to the invention comprises an apparatus or system configured to transmit a computer program to a receiver (e.g., electronically or optically), the computer program being used to perform one of the methods described herein. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may, for example, comprise a file server for transmitting the computer program to the receiver.

[0684] In some embodiments, a programmable logic device (e.g., a field programmable gate array) can be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array can collaborate with a microprocessor to perform one of the methods described herein. Typically, the method is preferably performed by any hardware device.

[0685] The devices described herein may be implemented using hardware devices, or using computers, or using a combination of hardware devices and computers.

[0686] The apparatus described herein or any component of an apparatus described herein may be implemented at least partially in hardware and / or software.

[0687] The methods described herein may be performed using a hardware device, or using a computer, or using a combination of a hardware device and a computer.

[0688] Any component of a method described herein or an apparatus described herein may be performed at least in part by hardware and / or by software.

[0689] The above embodiments are merely illustrative of the principles of the present invention. It should be understood that modifications and variations of the arrangements and details described herein will be apparent to other persons skilled in the art. Therefore, it is intended that the present invention be limited only by the scope of the appended patent claims and not by the specific details given by way of description and explanation of the embodiments herein.

Claims

1. A data stream, in which a picture (204) is encoded, the data stream comprising: Shift information (206), for a set of at least one predetermined sub-areas (214) of the picture (204), the shift information (206) indicating a shift (218) of the set of at least one predetermined sub-areas within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-areas to a target picture area (216).

2. The data stream according to claim 1, wherein: The shift information (206) indicates the shift (218) in units of one of: Image samples, The picture is subdivided into tiles, the picture is code-processed in units of the tiles without code-processing interdependencies, and each sub-area in a set of at least one sub-area (214) is composed of the tiles.

3. The data stream according to claim 1, wherein: The set of at least one sub-region of the picture is a subset of a gap-free and non-overlapping spatial partition of the picture into an array of sub-regions.

4. The data stream according to claim 1, wherein the shift information comprises: a count of predetermined sub-regions within a set of at least one predetermined sub-region of the picture (220); a size parameter (222) defining the size of the target picture area, and for each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture, coordinates (224) of the displacement of the corresponding predetermined sub-area of ​​the picture within the target picture area; or For each predetermined sub-area in a set of at least one predetermined sub-area of ​​the picture, the shift information includes: first position information about the position of the corresponding predetermined sub-area in the target area; second information about the position of the corresponding predetermined area within the picture; and information about rotation and / or mirroring when mapping the corresponding predetermined sub-area between the target area and the picture.

5. The data stream according to claim 4, wherein: The shift information also indicates a scaling ratio of the corresponding sub-area within the target picture area (226).

6. The data stream according to claim 1, wherein: The data stream further comprises default filling information (228) indicating a default filling for filling a portion (130) of the target picture area (216), the portion (130) being neither covered by any predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture shifted according to the shift information, and if the set of at least one predetermined sub-area does not completely cover the picture (204), nor covered by any non-shifted portion of the picture.

7. The data stream according to claim 1, wherein: A picture sequence is encoded in the data stream, wherein the shift information is valid for the picture sequence.

8. A decoder for decoding a data stream encoded with a picture, the decoder comprising: a decoding core (234) configured to reconstruct the picture from the data stream, and The shifter (236) is configured to synthesize a target picture based on the picture by shifting each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture within a target picture area according to shift information contained in the data stream.

9. The decoder according to claim 8, wherein: The shifter is configured to copy any non-shifted portion of the picture into the target picture area (216) in an unshifted manner if the set of at least one predetermined sub-area does not completely cover the picture (204).

10. The decoder according to claim 8, wherein: The shift information indicates the shift of the corresponding sub-field in units of one of the following: Image samples, The picture is subdivided into tiles, the picture is code-processed in units of the tiles without code-processing interdependencies, and each sub-area in a set of at least one sub-area (214) is composed of the tiles.

11. The decoder according to claim 8, wherein: The set of at least one sub-region of the picture is a subset of a gap-free and non-overlapping spatial partition of the picture into an array of sub-regions.

12. The decoder according to claim 8, wherein: The shifter is configured as: As part of the shift information, read from the data stream: a count of predetermined sub-areas within a set of at least one predetermined sub-areas of the picture, a size parameter defining the size of the target image area, for each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture, the coordinates of the displacement of the corresponding predetermined sub-area of ​​the picture within the target picture area, Each predetermined sub-area of ​​a set of at least one predetermined sub-area of ​​the picture is shifted relative to the superposition of the picture onto the target picture area according to the shifted coordinates read for the corresponding predetermined sub-area.

13. The decoder according to claim 12, wherein: The shifter is configured to synthesize a target picture based on the picture in the following manner: according to shift information contained in the data stream, each predetermined sub-area in a set of at least one predetermined sub-area of ​​the picture is scaled within the target picture area, wherein each predetermined sub-area is a predetermined sub-area that is shifted according to the shift information relative to a lossless copy of the picture to the target picture area.

14. The decoder according to claim 8, wherein: The shifter is configured to fill a portion of the target picture area according to default filling information included in the data stream, wherein any one of a set of at least one predetermined sub-area of ​​the picture is not shifted to the portion of the target picture area according to the shift information, and if the set of at least one predetermined sub-area does not completely cover the picture (204), any non-shifted portion of the picture is also not located in the portion of the target picture area.

15. The decoder according to claim 8, wherein: The decoding core is configured to reconstruct a sequence of pictures from the data stream, and the shifter is configured to apply the shift information to pictures of the sequence of pictures.

16. The decoder of claim 8, further comprising: A renderer (238) is configured to apply a single shot projection to the target image region to form an output image.

17. An encoder for encoding a picture into a data stream, the encoder being configured to provide to the data stream: Shift information (206), for a set of at least one predetermined sub-areas (214) of the picture (204), the shift information (206) indicating a shift (218) of the set of at least one predetermined sub-areas within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-areas to a target picture area (216).

18. A network device configured to reduce a data stream (200) encoding a first picture to a reduced data stream (232) encoding a sub-region-specific picture, the sub-region-specific picture showing a predetermined sub-region of the first picture, wherein the data stream (200) comprises shift information (206), for a set of at least one predetermined sub-region of the first picture, the shift information (206) indicating a shift (218) of the set of at least one predetermined sub-region (214) within a target picture region (216) relative to a non-shifted copy of the set of at least one predetermined sub-region to a target picture region (216), wherein: The network device is configured to modify the shift information (206) into modified shift information (206') so that in the target picture area, the following two coincide: the sub-region-specific picture copied to the target picture area by shifting a set of at least one predetermined sub-area in the sub-region-specific picture according to the modified shift information and the predetermined sub-area of ​​the first picture copied to the target picture area by shifting a set of at least one predetermined sub-area (214) of the picture (12) according to the shift information, and replace the shift information with the modified shift information when reducing the data stream, or The modified shift information is included in a data stream associated with the predetermined sub-region of the first picture, and the shift information is included in a data stream associated with the first picture, and the network device is configured to remove the shift information when reducing the data stream and transfer the modified shift information to the reduced data stream so as to be associated with the sub-region-specific picture.

19. A method for decoding a data stream, wherein the data stream is encoded with a picture, the method comprising: reconstructing the picture from the data stream, and A target picture is synthesized based on the picture by shifting each predetermined sub-region of a set of at least one predetermined sub-region of the picture within a target picture region according to shift information included in the data stream.

20. A method of encoding a picture into a data stream, the method comprising providing shift information (206) to the data stream, the shift information (206) indicating, for a set of at least one predetermined sub-areas (214) of the picture (204), a shift (218) of the set of at least one predetermined sub-areas within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-areas to a target picture area (216).

21. A method for reducing a data stream (200) encoding a first picture into a reduced data stream (232) encoding a sub-region-specific picture, the sub-region-specific picture showing a predetermined sub-region of the first picture, wherein the data stream (200) comprises shift information (206) indicating, for a set of at least one predetermined sub-region of the first picture, a shift (218) of the set of at least one predetermined sub-region within a target picture region relative to a non-shifted copy of the set of at least one predetermined sub-region to a target picture region (216), wherein The method comprises: modifying the shift information (206) into modified shift information (206') so that in the target picture area, the following two coincide: the sub-region-specific picture copied to the target picture area by shifting a set of at least one predetermined sub-area in the sub-region-specific picture according to the modified shift information and the predetermined sub-area of ​​the first picture copied to the target picture area by shifting a set of at least one predetermined sub-area (214) of the picture (12) according to the shift information, and replacing the shift information with the modified shift information when reducing the data stream, or The modified shift information is included in a data stream associated with the predetermined sub-region of the first picture, and the shift information is included in a data stream associated with the first picture, and the method includes removing the shift information when reducing the data stream and transferring the modified shift information to the reduced data stream so as to be associated with the sub-region-specific picture.

22. A digital storage medium having stored thereon a data stream according to claim 1.

23. A computer program having a program code for executing the method according to claim 19, 20 or 21 when the program code is run on a computer.

24. A video data stream representing a video (14), comprising: A parameter set portion (16), indicating code processing parameter settings (20); a payload portion (18), wherein the pictures (12) of the video are transcoded into the payload portion (18) in a manner using a first set (20a) of transcoding parameter settings (20) as parameters, wherein the payload portion includes an index (48) indexing the first set (20a), The video data stream includes information (50), and the information (50) includes: an indication (52) of a predetermined sub-region (22) of the picture (12); and a replacement index (54) for redirecting (72) said index (48) included by said payload portion to refer to a second set (20b) of code processing parameter settings, The second set (20b) of code processing parameters is selected so that the reduced video data stream (62) has a reduced payload portion, and the reduced video data stream (62) is modified as follows compared to the video data stream: removing (68) a portion (70) of the payload portion (18) that refers to an area outside the predetermined sub-area (22) of the picture (12), and changing (78) the position indication (32) in the payload portion (18) so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region (22) rather than a perimeter of the picture (12), In the reduced payload part, a sub-region specific picture (86) showing the predetermined sub-region (22) of the picture is encoded using the second set (20b) of code processing parameter settings as a parameter.

25. A video data stream representing a video (14), comprising: A parameter set portion (16), indicating code processing parameter settings (20); a payload portion (18), wherein the pictures (12) of the video are transcoded into the payload portion (18) in a manner using a first set (20a) of transcoding parameter settings (20) as parameters, wherein the payload portion includes an index (48) indexing the first set (20a), The video data stream includes information (50), and the information (50) includes: an indication (52) of a predetermined sub-region (22) of the picture (12); and replacing parameters (56) for adjusting (88) the first set (20a) of code processing parameter settings to obtain a second set (20b) of code processing parameter settings, wherein the code processing parameter settings define buffer size and timing (46), The second set (20b) of code processing parameters is selected so that the reduced video data stream (62) has a reduced payload portion, and the reduced video data stream (62) is modified as follows compared to the video data stream: removing (68) a portion (70) of the payload portion (18) that refers to an area outside the predetermined sub-area (22) of the picture (12), and changing (78) the position indication (32) in the payload portion (18) so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region (22) rather than a perimeter of the picture (12), In the reduced payload part, a sub-region specific picture (86) showing the predetermined sub-region (22) of the picture is encoded using the second set (20b) of code processing parameter settings as a parameter.

26. The video data stream according to claim 24 or 25, wherein: The video data stream and the reduced video data stream (62) conform to HEVC.

27. The video data stream according to claim 24 or 25, wherein: The parameter set part is included in the SPS NAL unit and / or the VPS NAL unit and / or the PPS NAL unit.

28. The video data stream according to claim 24 or 25, wherein: The code processing parameter setting defines one or more of the following: Image size (26), Block structure (38), Buffer size and timing (46).

29. The video data stream according to claim 24 or 25, wherein: The index (48) is contained in a slice header of a slice (34) of the payload portion (18), wherein a corresponding region (36) of a picture (12) is encoded in each slice, wherein the corresponding region (36) does not cross a boundary of the predetermined sub-region (22).

30. The video data stream according to claim 24 or 25, wherein: The information is included in SEI message, VUI or parameter set extension.

31. The video data stream according to claim 24 or 25, wherein: The picture of the video is encoded into the payload part in units of tiles (42), the picture is subdivided into the tiles, and the tiles are arranged in a tile array of columns and rows, wherein the indication (52) indicates the predetermined sub-area as a collection of the tiles.

32. The video data stream according to claim 31, wherein: The pictures of the video are encoded into the payload part in units of tiles (42), so that the payload part is subdivided in units of slices (34), each slice being encoded with a corresponding area of ​​the picture, and the corresponding area does not cross the tile boundary (40) between the tiles.

33. The video data stream according to claim 24 or 25, wherein: The part of said first set (20a) of code processing parameter settings indexed by said index (48) for which said redirection (72) is to be performed by said replacement index and / or replaced by said replacement parameters belongs to one or more of the following: Image size (26), Block structure (38), Buffer size and timing (46).

34. The video data stream according to claim 24 or 25, wherein: The pictures (12) of the video are transcoded into the payload portion (18) such that temporal prediction across a boundary of the predetermined sub-region (22) is interrupted when transcoding the pictures within the predetermined sub-region (22).

35. An encoder for encoding a video into a video data stream, comprising: a parameter setter (80a) configured to determine a code processing parameter setting (20) and generate a parameter set portion (16) of the video data stream indicating the code processing parameter setting; a code processing core (80b) configured to encode pictures of the video into a payload portion of the video data stream using a first set (20a) of code processing parameter settings as parameters, wherein an index (48) included in the payload portion indexes the first set, The encoder is configured to provide information (50) to the video data stream, the information (50) comprising: an indication of a predetermined sub-region (22) of the picture (12); and a replacement index (54) for redirecting the index included by the payload portion to refer to a second set of code processing parameter settings, wherein the second set of code processing parameters is selected so that a reduced video data stream has a reduced payload portion, the reduced video data stream being modified as compared to the video data stream in the following manner: removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

36. An encoder for encoding a video into a video data stream, comprising: a parameter setter (80a) configured to determine a code processing parameter setting (20) and generate a parameter set portion (16) of the video data stream indicating the code processing parameter setting; a code processing core (80b) configured to encode pictures of the video into a payload portion of the video data stream using a first set (20a) of code processing parameter settings as parameters, wherein an index (48) included in the payload portion indexes the first set, The encoder is configured to provide information (50) to the video data stream, the information (50) comprising: an indication of a predetermined sub-region (22) of the picture (12); and replacing parameters (56) for adjusting the first set of code processing parameter settings to obtain a second set of code processing parameter settings, wherein the code processing parameter settings define buffer size and timing (46), The second set of code processing parameters is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream: removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

37. An encoder according to claim 35 or 36, wherein The video data stream and the reduced video data stream comply with HEVC.

38. An encoder according to claim 35 or 36, wherein The parameter set part is included in the SPS NAL unit and / or the VPS NAL unit and / or the PPS NAL unit.

39. An encoder according to claim 35 or 36, wherein The code processing parameter setting defines one or more of the following: Image size, Block structure, Buffer size and timing.

40. An encoder according to claim 35 or 36, wherein: The encoder is configured to insert the index into a slice header of a slice of the payload part, and encode a corresponding region of a picture into each slice, the corresponding region not crossing a boundary of the predetermined sub-region.

41. An encoder according to claim 35 or 36, wherein: The encoder is configured to insert the information into a SEI message, a VUI or a parameter set extension.

42. An encoder according to claim 35 or 36, wherein: The encoder is configured to encode a picture of the video into the payload portion in units of tiles, the picture being subdivided into the tiles, and the tiles being arranged in a tile array of columns and rows, wherein the indication indicates the predetermined sub-region as a collection of the tiles.

43. An encoder according to claim 42, wherein The encoder is configured to encode the picture of the video into the payload part in units of tiles, so that the payload part is subdivided in units of slices, each slice being encoded with a corresponding area of ​​the picture, and the corresponding area does not cross the tile boundary between the tiles.

44. An encoder according to claim 35 or 36, wherein The part of the first set of code processing parameter settings indexed by the index for which the redirection is to be performed by the replacement index and / or replaced by the replacement parameters belongs to one or more of the following: Image size, Block structure, Buffer timing.

45. An encoder according to claim 35 or 36, wherein The encoder is configured to encode the picture of the video into the payload portion such that temporal prediction across a boundary of the predetermined sub-region (22) is interrupted when coding the picture within the predetermined sub-region (22).

46. ​​A network device for processing a video data stream, the video data stream comprising: The parameter set part indicates the code processing parameter settings; a payload portion, wherein the pictures of the video are transcoded into the payload portion in a manner using a first set of transcoding parameter settings as parameters, wherein the index included in the payload portion indexes the first set, Wherein, the network device is configured as: Information is read (64) from the video data stream, the information comprising: an indication of a predetermined sub-region of the picture; and a replacement index for redirecting said index comprised by said payload portion to reference a second set of code processing parameter settings, The video data stream is reduced (66) to a reduced video data stream by making the following modifications: performing said redirecting (72) and / or adjusting (88) so that said second set of code processing parameter settings is indexed by an index of said payload portion; removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, The reduced video data stream is caused to have a reduced payload portion in which a sub-region-specific picture showing the predetermined sub-region of the picture is encoded in a manner using the second set of code processing parameter settings as a parameter.

47. A network device for processing a video data stream, the video data stream comprising: The parameter set part indicates the code processing parameter settings; a payload portion, wherein the pictures of the video are transcoded into the payload portion in a manner using a first set of transcoding parameter settings as parameters, wherein the index included in the payload portion indexes the first set, Wherein, the network device is configured as: Information is read (64) from the video data stream, the information comprising: an indication of a predetermined sub-region of the picture; and replacing parameters for adjusting the first set of code processing parameter settings to obtain a second set of code processing parameter settings, wherein the code processing parameter settings define buffer size and timing (46), The video data stream is reduced (66) to a reduced video data stream by making the following modifications: performing said redirecting (72) and / or adjusting (88) so that said second set of code processing parameter settings is indexed by an index of said payload portion; removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, The reduced video data stream is caused to have a reduced payload portion in which a sub-region-specific picture showing the predetermined sub-region of the picture is encoded in a manner using the second set of code processing parameter settings as a parameter.

48. The network device according to claim 46 or 47, wherein: The video data stream and the reduced video data stream comply with HEVC.

49. The network device according to claim 46 or 47, wherein: The parameter set part is included in the SPS NAL unit and / or the VPS NAL unit and / or the PPS NAL unit.

50. The network device according to claim 46 or 47, wherein: The code processing parameter setting defines one or more of the following: Image size, Block structure, Buffer size and timing.

51. The network device according to claim 46 or 47, wherein: The network device is configured to locate the index in a slice header of a slice of the payload portion, each slice being encoded with a corresponding region of a picture, the corresponding region not crossing a boundary of the predetermined sub-region.

52. The network device according to claim 46 or 47, wherein: The network device is configured to read the information from a SEI message, a VUI or a parameter set extension of the video data stream.

53. The network device according to claim 46 or 47, wherein: The picture of the video is coded into the payload part in units of tiles, the picture is subdivided into the tiles, and the tiles are arranged in a tile array of columns and rows, wherein the indication indicates the predetermined sub-region as a collection of the tiles.

54. The network device according to claim 53, wherein: The pictures of the video are coded into the payload part in units of tiles, so that the payload part is subdivided in units of slices, each slice being encoded with a corresponding area of ​​the picture, and the corresponding area does not cross a tile boundary between the tiles.

55. The network device according to claim 46 or 47, wherein: The part of the first set of code processing parameter settings indexed by the index for which the redirection is to be performed by the replacement index and / or replaced by the replacement parameters belongs to one or more of the following: Image size, Block structure, Buffer size and timing.

56. The network device according to claim 46 or 47, wherein: The pictures (12) of the video are transcoded into the payload portion (18) such that temporal prediction across a boundary of the predetermined sub-region (22) is interrupted when transcoding the pictures within the predetermined sub-region (22).

57. The network device according to claim 46 or 47, wherein the network device is one of the following: a video decoder capable of decoding the video data stream and the reduced video data stream, a video decoder having a profile level sufficient to enable said video decoder to decode said reduced video data stream, but having a profile level insufficient to enable said video decoder to decode said video data stream, and The network device is configured to forward one of the video data stream and the reduced video data stream to a video decoder according to a control signal.

58. The network device according to claim 46 or 47, wherein: The video data stream comprises shift information (206) indicating, for a set of at least one predetermined sub-area (2114) of the picture (12), a shift of the set of at least one predetermined sub-area within the target picture area (216) relative to a non-shifted copy of the set of at least one predetermined sub-area to the target picture area, and The network device is configured to modify the shift information into modified shift information (206') so that within the target picture area (216), the following two coincide: the sub-region-specific picture copied to the target picture area by shifting a predetermined sub-area in the sub-region-specific picture according to the modified shift information and the predetermined sub-area (22) of the picture (12) copied to the target picture area by shifting a set of at least one predetermined sub-area (214) of the picture (12) according to the shift information, and, when reducing the video data stream, replace the shift information (206) with the modified shift information (206'), or The modified shift information (206') is included in a video data stream associated with the predetermined sub-region (22) of the picture (12), and the shift information (206) is included in a video data stream associated with the picture, and the network device is configured to remove the shift information (206) when reducing the video data stream and transfer the modified shift information (206') to the reduced video data stream so as to be associated with the sub-region-specific picture (86).

59. A video data stream representing a video (14), comprising: a payload portion (18), into which the pictures (12) of the video are coded; as well as a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18), The video data stream includes information (50), and the information (50) includes: an indication (52) of a predetermined sub-region (22) of the picture (12); and A replacement supplemental enhancement information message for replacing the supplemental enhancement information message, wherein the replacement supplemental enhancement information message is selected so that a reduced video data stream (62) has a reduced payload portion, the reduced video data stream (62) being modified as follows compared to the video data stream: removing (68) a portion (70) of the payload portion (18) that refers to an area outside the predetermined sub-area (22) of the picture (12), and changing (78) the position indication (32) in the payload portion (18) so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region (22) rather than a perimeter of the picture (12), In the reduced payload portion, a sub-region specific picture (86) showing the predetermined sub-region (22) of the picture is encoded in a manner such that the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the manner in which the sub-region specific picture (86) is coded into the reduced payload portion (18).

60. The video data stream of claim 59, wherein the supplemental enhancement information is buffer size and / or buffer timing data.

61. An encoder for encoding a video into a video data stream, comprising: a code processing core (80b) configured to encode the pictures of the video into the payload portion of the video data stream, and A parameter setter (80a) configured to generate a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18); The encoder is configured to provide information (50) to the video data stream, the information (50) comprising: an indication of a predetermined sub-region (22) of the picture (12); and a replacement supplemental enhancement information message for replacing the supplemental enhancement information message, wherein the replacement supplemental enhancement information message is selected so that a reduced video data stream has a reduced payload portion, the reduced video data stream being modified as follows compared to the video data stream: removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, In the reduced payload portion, a sub-region-specific picture displaying the sub-region of the picture is encoded in a manner such that the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the manner in which the sub-region-specific picture (86) is coded into the reduced payload portion (18).

62. An encoder according to claim 61, wherein the supplemental enhancement information belongs to buffer size and / or buffer timing data.

63. A network device for processing a video data stream, the video data stream comprising: a payload portion into which pictures of the video are transcoded; as well as a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18), Wherein, the network device is configured as: Information is read (64) from the video data stream, the information comprising: an indication of a predetermined sub-region of the picture; and a replacement supplementary enhancement information message for replacing the supplementary enhancement information message, The video data stream is reduced (66) to a reduced video data stream by making the following modifications: replacing the supplemental enhancement information message by the replacement supplemental enhancement information message, removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, The reduced video data stream has a reduced payload portion, in which a sub-region-specific picture displaying the predetermined sub-region of the picture is encoded, and the encoding method is such that: the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the method of coding the sub-region-specific picture (86) into the reduced payload portion (18).

64. A network device for processing a video data stream, configured to: A video data stream is received, the video data stream comprising a portion of a payload portion into which pictures of the video are coded, wherein: The portion of the payload portion corresponds to the exclusion of those portions of the payload portion that refer to a picture area that is outside a predetermined sub-area of ​​the picture, wherein the pictures of the video are coded into the payload portion in the following manner: without excluding the use of code processing parameter settings in a parameter set portion of the video data stream as parameters, and / or matches the supplemental enhancement information indicated by the supplemental enhancement message of the video data stream without exclusion, The video data stream is modified by: changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, and adjusting the code processing parameter settings in the parameter set part and / or adjusting the supplemental enhancement information message so that, in the part of the payload part of the video data stream, a sub-region specific picture showing the predetermined sub-region of the picture is encoded in the following manner: using the code processing parameter settings as parameters, and / or Matches the supplemental enhancement information indicated by the adjusted supplemental enhancement information supplemental enhancement message.

65. The network device according to claim 64 is configured to also receive information about the predetermined sub-area (22) together with the video data stream, or to use the information about the predetermined sub-area (22) to limit the downloading of the video data stream so that those parts (70) in the payload part (18) that refer to the picture area outside the predetermined sub-area (22) are not downloaded.

66. A method for encoding a video into a video data stream, comprising: determining a code processing parameter setting (20) and generating a parameter set portion (16) of the video data stream indicating the code processing parameter setting; encoding pictures of the video into a payload portion of the video data stream in a manner using a first set (20a) of code processing parameter settings as parameters, the payload portion comprising an index (48) indexing the first set, Providing information (50) for the video data stream, the information (50) comprising: an indication of a predetermined sub-region (22) of the picture (12); and a replacement index (54) for redirecting the index included by the payload portion to refer to a second set of code processing parameter settings, wherein the second set of code processing parameters is selected so that a reduced video data stream has a reduced payload portion, the reduced video data stream being modified as compared to the video data stream in the following manner: removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

67. A method for encoding a video into a video data stream, comprising: determining a code processing parameter setting (20) and generating a parameter set portion (16) of the video data stream indicating the code processing parameter setting; encoding pictures of the video into a payload portion of the video data stream in a manner using a first set (20a) of code processing parameter settings as parameters, the payload portion comprising an index (48) indexing the first set, Providing information (50) for the video data stream, the information (50) comprising: an indication of a predetermined sub-region (22) of the picture (12); and replacing parameters (56) for adjusting the first set of code processing parameter settings to obtain a second set of code processing parameter settings, wherein the code processing parameter settings define buffer size and timing, The second set of code processing parameters is selected so that the reduced video data stream has a reduced payload portion, and the reduced video data stream is modified as follows compared to the video data stream: removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, In the reduced payload part, a sub-region specific picture showing the sub-region of the picture is encoded using the second set of code processing parameter settings as a parameter.

68. A method for processing a video data stream, the video data stream comprising: The parameter set part indicates the code processing parameter settings; a payload portion, wherein the pictures of the video are transcoded into the payload portion in a manner using a first set of transcoding parameter settings as parameters, wherein the index included in the payload portion indexes the first set, Wherein, the method comprises: Information is read (64) from the video data stream, the information comprising: an indication of a predetermined sub-region of the picture; and a replacement index and / or a replacement parameter, said replacement index being used to redirect said index comprised by said payload portion to refer to a second set of code processing parameter settings, The replacement parameters are used to adjust the first set of code processing parameter settings to obtain a second set of code processing parameter settings, The video data stream is reduced (66) to a reduced video data stream by making the following modifications: performing said redirecting (72) and / or adjusting (88) so that said second set of code processing parameter settings is indexed by an index of said payload portion; removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, The reduced video data stream is caused to have a reduced payload portion in which a sub-region-specific picture showing the predetermined sub-region of the picture is encoded in a manner using the second set of code processing parameter settings as a parameter.

69. A method for encoding a video into a video data stream, comprising: encoding pictures of the video into a payload portion of the video data stream, generating a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18); Providing information (50) for the video data stream, the information (50) comprising: an indication of a predetermined sub-region (22) of the picture (12); and a replacement supplemental enhancement information message for replacing the supplemental enhancement information message, wherein the replacement supplemental enhancement information message is selected so that a reduced video data stream has a reduced payload portion, the reduced video data stream being modified as follows compared to the video data stream: removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, In the reduced payload portion, a sub-region-specific picture displaying the sub-region of the picture is encoded in a manner such that the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the manner in which the sub-region-specific picture (86) is coded into the reduced payload portion (18).

70. A method for processing a video data stream, the video data stream comprising: a payload portion into which pictures of the video are transcoded; as well as a supplemental enhancement information message indicating supplemental enhancement information matching the manner in which the picture codes of the video are processed into the payload portion (18), Wherein, the method comprises: Information is read (64) from the video data stream, the information comprising: an indication of a predetermined sub-region of the picture; and A replacement supplemental enhancement information message for replacing the supplemental enhancement information message reduces (66) the video data stream to a reduced video data stream by making the following modifications: replacing the supplemental enhancement information message by the replacement supplemental enhancement information message, removing (68) the portion of the payload portion that references an area outside the predetermined sub-region of the picture, and changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, The reduced video data stream has a reduced payload portion, in which a sub-region-specific picture displaying the predetermined sub-region of the picture is encoded, and the encoding method is such that: the replacement supplemental enhancement information message indicates replacement supplemental enhancement information that matches the method of coding the sub-region-specific picture (86) into the reduced payload portion (18).

71. A method for processing a video data stream, comprising: Receiving a video data stream, the video data stream comprising a portion of a payload portion into which pictures of a video are transcoded, wherein the portion of the payload portion corresponds to an exclusion of portions of the payload portion that reference a picture area that is outside a predetermined sub-area of ​​the picture, wherein the pictures of the video are transcoded into the payload portion in the following manner: without excluding the use of code processing parameter settings in a parameter set portion of the video data stream as parameters, and / or matches the supplemental enhancement information indicated by the supplemental enhancement message of the video data stream without exclusion, The video data stream is modified by: changing (78) the position indication (32) in the payload portion so as to indicate the position in a manner measured relative to a perimeter of the predetermined sub-region rather than a perimeter of the picture, and adjusting the code processing parameter settings in the parameter set part and / or adjusting the supplemental enhancement information message so that, in the part of the payload part of the video data stream, a sub-region specific picture showing the predetermined sub-region of the picture is encoded in the following manner: using the code processing parameter settings as parameters, and / or Matches the supplemental enhancement information indicated by the adjusted supplemental enhancement information supplemental enhancement message.

72. A digital storage medium having stored thereon a data stream according to claim 24, 25 or 59.

73. A computer program having a program code for performing the method according to claim 66 or 67 or 68 or 69 or 70 or 71 when run on a computer.

74. A video data stream in which a sequence of pictures (302) is encoded using temporal prediction such that: When encoding a first set of one or more pictures (pictures A) into the video data stream, interrupting temporal prediction at least within a first picture sub-region (A) in order to form a set of one or more first random access points, and When encoding a second set of one or more pictures (pictures B) into the video data stream, temporal prediction is interrupted in a second picture sub-region (B) different from the first picture sub-region (A) to form a set of one or more second random access points.

75. The video data stream of claim 74, wherein: The first sub-region and the second sub-region are adjacent to each other without overlapping.

76. The video data stream of claim 75, wherein: The first sub-region and the second sub-region form a non-overlapping and gap-free division of the sequence of pictures (302), the division being signaled (319) in the video data stream.

77. The video data stream of claim 76, wherein: When encoding a first set of the one or more pictures (pictures A) into the video data stream, temporal prediction over regions of the pictures is completely interrupted in order to form a set of one or more picture-wise random access points.

78. The video data stream of claim 74, wherein: When encoding the second set of the one or more pictures (pictures B) into the video data stream, a spatial code processing dependency on a spatial portion outside the second picture sub-region is broken within the second picture sub-region (B).

79. The video data stream of claim 74, further comprising: A signal (318) indicates a second set of the one or more pictures (picture B).

80. The video data stream of claim 79, wherein: The signal (318) indicates the second set of one or more pictures (pictures B) at least in part via a picture type signal (320) of the video data stream, the picture type signal (320) distinguishing between picture-wise random access points and sub-region-specific random access points.

81. The video data stream of claim 80, wherein: The signal (318) indicates a second set of the one or more pictures (pictures B) through the picture type signal (320) of the video data stream, wherein the picture type signal (320) indicates that the second set of the one or more pictures (pictures B) is a sub-region-specific random access point and further associates the second set of the one or more pictures (pictures B) with the second picture sub-region (B).

82. The video data stream of claim 80, wherein: The picture type signal (320) of the video data stream is included in a NAL unit header of the video data stream.

83. The video data stream of claim 74, further comprising: Another signal (321) is used to indicate, for the picture sequence, whether the temporal prediction of the second picture sub-region (B) is restricted to not extend into the picture region of the picture (302) located outside the second picture sub-region when encoding the picture (302) into the video data stream, or whether the extension is allowed.

84. The video data stream of claim 74, wherein: When encoding a picture (317) located between a picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order into the video data stream, temporal prediction within the second picture sub-region (B) is restricted so as not to refer to a picture region (A) of a reference picture located outside the second picture sub-region (B).

85. A video data stream according to claim 74, wherein when a picture (317) located between a picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order is encoded into the video data stream, temporal prediction within the second picture sub-region (B) is restricted so as not to refer to a reference picture located upstream relative to the picture (picture B) in the second set of the one or more pictures in decoding order.

86. The video data stream of claim 84, wherein: When encoding a picture (317) between a picture (picture B) located in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order into the video data stream, temporal prediction is restricted in a picture area (A) located outside the second picture sub-area (B) so that no reference is made to the second picture sub-area (B) of a reference picture, wherein the reference picture belongs to any one of the following items: the picture (317) between the picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order; and the picture (picture B) in the second set of the one or more pictures.

87. The video data stream of claim 84, wherein: When encoding a picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order into the video data stream, a temporal prediction is used in a picture region (A) that is outside the second picture subregion (B), the temporal prediction at least partially referring to the second picture subregion (B) of a reference picture, the reference picture respectively belonging to any of the following: the picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order; and the one picture (picture B) of the second set of one or more pictures, and When encoding a picture (317') that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent in decoding order into the video data stream, temporal prediction is restricted within a picture area (A) that is outside the second picture sub-area (B) so as not to refer to the second picture sub-area (B) of a previous reference picture in decoding order, the previous reference picture belonging to any one of: the one picture (picture A) in the first set of the one or more pictures that are subsequent; and the picture (317') that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent.

88. An encoder for encoding a sequence of pictures into a video data stream using temporal prediction, the encoder being configured to: When encoding a first set of one or more pictures into the video data stream, temporal prediction is interrupted at least within a first picture sub-region to form a set of one or more first random access points, and When encoding a second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region to form a set of one or more second random access points.

89. An encoder according to claim 88, wherein The first sub-region and the second sub-region are adjacent to each other without overlapping.

90. The encoder of claim 89, wherein: The first sub-region and the second sub-region form a non-overlapping and gap-free partition of the sequence of pictures (302), and the encoder is configured to provide a signal (319) in the video data stream, the signal (319) being a signal of the non-overlapping and gap-free partition.

91. The encoder according to claim 88 is configured to completely interrupt temporal prediction on areas of the pictures when encoding the first set of one or more pictures into the video data stream so as to form a picture-wise set of random access points.

92. The encoder according to claim 88 is configured to interrupt the spatial code processing dependency on the spatial portion outside the second picture sub-region within the second picture sub-region (B) when encoding the second set of one or more pictures into the video data stream.

93. The encoder of claim 88, further configured to insert a signal indicative of a second set of the one or more pictures into the video data stream.

94. The encoder according to claim 88 is configured to insert another signal (321) into the video data stream, wherein the other signal (321) is used to indicate, for the picture sequence, whether the temporal prediction of the second picture sub-region (B) is restricted to not protruding into the picture area of ​​the picture (302) located outside the second picture sub-region when encoding the picture (302) into the video data stream, or whether the protrusion is allowed.

95. The encoder of claim 88, wherein: The encoder is configured as: When encoding a picture between a picture located in the second set of the one or more pictures and a picture in the first set of the one or more pictures that follows in decoding order into the video data stream, temporal prediction within the second picture sub-region is restricted so as not to refer to a picture region of a reference picture located outside the second picture sub-region.

96. The encoder of claim 88, wherein: The encoder is configured to, when encoding a picture (317) located between a picture (picture B) in the second set of one or more pictures and a picture (picture A) in the first set of one or more pictures that is subsequent in decoding order into the video data stream, restrict temporal prediction within a sub-region (B) of the second picture so as not to refer to a reference picture that is located upstream relative to the picture (picture B) in the second set of one or more pictures in decoding order.

97. An encoder according to claim 95, wherein: The encoder is configured to, when encoding a picture (317) between a picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order into the video data stream, restrict temporal prediction within a picture area (A) outside the second picture sub-area (B) so as not to refer to the second picture sub-area (B) of a reference picture, wherein the reference picture belongs to any one of the following: the picture (317) between the picture (picture B) in the second set of the one or more pictures and a picture (picture A) in the first set of the one or more pictures that follows in decoding order; and the picture (picture B) in the second set of the one or more pictures.

98. An encoder according to claim 95, wherein: The encoder is configured as: When encoding a picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order into the video data stream, a temporal prediction is used in a picture region (A) that is outside the second picture subregion (B), the temporal prediction at least partially referring to the second picture subregion (B) of a reference picture, the reference picture respectively belonging to any of the following: the picture (317) between the one picture (picture B) of the second set of one or more pictures and a picture (picture A) of the first set of one or more pictures that follows in decoding order; and the one picture (picture B) of the second set of one or more pictures, and When encoding a picture that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent in decoding order into the video data stream, temporal prediction is restricted within a picture area (A) that is outside the second picture sub-area (B) so as not to refer to the second picture sub-area (B) of a previous reference picture in decoding order, the previous reference picture belonging to any one of the following: the one picture (picture A) in the first set of the one or more pictures that are subsequent; and the picture that follows the one picture (picture A) in the first set of the one or more pictures that are subsequent.

99. A decoder for decoding a sequence of pictures from a video data stream using temporal prediction, the decoder supporting random access using the following set of random access points: a set of one or more first random access points located at a first set of one or more pictures, wherein temporal prediction is interrupted at least within a first picture sub-region when encoding the first set of one or more pictures into the video data stream, and A set of one or more second random access points is located at a second set of one or more pictures, and when encoding the second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region.

100. The decoder according to claim 99, configured to: if the current picture is a picture in the second set of one or more pictures, The decoding and / or outputting of the sequence of pictures is restarted from the current picture, but at least one of the decoding and / or outputting of the sequence of pictures is pre-limited to the second picture sub-region.

101. The decoder of claim 100, configured to stop the pre-restriction when encountering a first random access point in the set of first random access points.

102. The decoder according to claim 99, configured to: if the current picture is a picture in the first set or the second set of the one or more pictures, Restarting decoding of the sequence of pictures from the current picture, but limiting output of the sequence of pictures until a picture of each set of one or more pictures is encountered after restarting decoding, wherein For each set of one or more pictures, when encoding each picture of the corresponding set of one or more pictures into the video data stream, temporal prediction is interrupted within a picture sub-region specific to the corresponding set of one or more pictures, the sub-regions of the set of one or more pictures being different from each other and together completely covering the picture area of ​​the picture sequence.

103. The decoder of claim 99, wherein: The first sub-region and the second sub-region are adjacent to each other without overlapping, and the encoder is configured to: if a current random access point is one of the second random access points and a next random access point is one of the first access points, limit decoding to the second picture sub-region between the current and next random access points, and extend decoding from the second picture sub-region to also include the first picture sub-region.

104. The decoder of claim 99, wherein: The first sub-region and the second sub-region form a non-overlapping and gap-free partition of the sequence of pictures (302), the decoder being configured to derive the partition from a signal (319) in the video data stream.

105. The decoder of claim 99, configured to treat the first set of one or more pictures as a set of one or more picture-wise random access points.

106. The decoder of claim 99, configured to decode the data stream of claim 74.

107. A network device configured to receive a video data stream according to claim 74, wherein a sequence of pictures (302) is encoded using temporal prediction, wherein: The network device is configured to reduce the data stream to obtain a reduced video data stream, in which a sub-region-specific picture (326) displaying the second picture sub-region is encoded, the reduction being performed by removing a portion of the video data stream encoding a picture region of the picture located outside the second picture sub-region and replacing information (318) within the video data stream indicating a second set of one or more pictures as sub-region-specific random access points with picture type information (320), the picture type information (320) indicating the second set of one or more pictures as picture-wise random access pictures.

108. A method for encoding a sequence of pictures into a video data stream using temporal prediction, the method comprising: When encoding a first set of one or more pictures into the video data stream, temporal prediction is interrupted at least within a first picture sub-region to form a set of one or more first random access points, and When encoding a second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region to form a set of one or more second random access points.

109. A method for decoding a sequence of pictures from a video data stream using temporal prediction, the method comprising performing random access to the video data stream using the following set of random access points: a set of one or more first random access points located at a first set of one or more pictures, wherein temporal prediction is interrupted at least within a first picture sub-region when encoding the first set of one or more pictures into the video data stream, and A set of one or more second random access points is located at a second set of one or more pictures, and when encoding the second set of one or more pictures into the video data stream, temporal prediction is interrupted in a second picture sub-region different from the first picture sub-region.

110. A method comprising: receiving a video data stream according to claim 74, in which a sequence of pictures (302) is coded using temporal prediction, The data stream is reduced to obtain a reduced video data stream, in which a sub-region specific picture (326) displaying the second picture sub-region is encoded, the reduction being performed by removing a portion of the video data stream encoding a picture region of the picture located outside the second picture sub-region and replacing information (318) within the video data stream indicating a second set of one or more pictures as sub-region specific random access points with picture type information (320), the picture type information (320) indicating the second set of one or more pictures as picture-wise random access pictures.

111. A digital storage medium having stored thereon a data stream according to claim 74.

112. A computer program having a program code for performing the method according to claim 108, 109 or 110 when the program code is run on a computer.

Images