Methods and apparatus for parental control metadata on isobmff

Abstract

Described herein is a method of processing media content. The method includes receiving the media content and side information for the media content; and generating or modifying an ISO Base Media File Format, ISOBMFF, file associated with the media content based on the side information. The side information includes rating information relating to a playback restriction associated with the media content. The ISOBMFF file includes a rating information specific box, the rating information specific box including a representation of the rating information. Further described are a respective method of processing an ISOBMFF file, respective apparatus and computer program products.

Description

[0001] METHODS AND APPARATUS FOR PARENTAL CONTROL METADATA ON ISOBMFF

[0002] Cross-Reference to Related Applications

[0003] This application claims the benefit of priority from U.S. Provisional Application No. 63 / 526,066 filed on 11 July 2023, which is incorporated by reference herein in its entirety.

[0004] Technical Field

[0005] The present disclosure generally relates to methods of processing media content (e.g., streams). The methods include, in particular, generating or modifying an ISO Base Media File Format, ISOBMFF, file based on side information associated with the media content, for example for providing parental control metadata to media content on an ISOBMFF layer. The present disclosure further relates to methods of processing ISOBMFF files, corresponding apparatus, computer program products, and computer readable storage media.

[0006] While some embodiments will be described herein with particular reference to that disclosure, it will be appreciated that the present disclosure is not limited to such a field of use and is applicable in broader contexts.

[0007] Background

[0008] Any discussion of the background art throughout the disclosure should in no way be considered as an admission that such art is widely known or forms part of common general knowledge in the field.

[0009] Parental control and access control for media content (e.g., audio and / or video) in general is subject to regulation and faulty implementation thereof may cause serious legal issues.

[0010] Provision of means for enforcing parental control, for example for restricting playback of media content to audiences of a certain minimum age, often specific to a given country or jurisdiction, thus is an important issue in present-day media streaming frameworks.

[0011] The preferred way of signaling parental control metadata (or any other form of playback restriction or access control metadata) is together with the media (i.e., in-band). For streaming use cases, the parental control metadata is typically signaled via the manifest file. Typical user terminals playback devices have functionality for parental control, for example via local MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH) frameworks built into the user terminals, so that they can evaluate the parental control metadata included in the manifest file and apply access control (e.g., playback restrictions) accordingly.

[0012] However, usage of DASH frameworks (such as DASH.js or Shaka, for example) for streaming applications has become more popular recently. In these frameworks, evaluation of the manifest file is performed in the web layer and media segments without the manifest file are passed to the user terminal (e.g., playback device, such as HbbTV, Smart TV, or mobile device running a streaming client application or web browser) via a Media Stream Extension (MSE) interface, an HTML video element, or other media interfaces for playback. Thus, the user terminal will not have access to the manifest file in such scenarios. Accordingly, the user terminal will not be able to access and enforce parental control metadata (or any other metadata relating to playback restrictions and access control), in the sense that access to the media content at the playback device cannot be controlled in accordance with, for example, age restrictions. While access control could be provided for in the web layer where the manifest file is available, this will put additional burden on the streaming application provider and may suffer from insufficient knowledge of the actual audience to which playback is made.

[0013] There is thus a need for improved techniques for processing media content for streaming applications that ensure that playback restrictions can be applied at the playback device, even when the playback device does not have access to the manifest file.

[0014] Summary

[0015] In view of this need, the present disclosure provides methods of processing media content and methods of processing ISOBMFF files, as well as corresponding apparatus, computer programs, and computer-readable storage media, having the features of the respective independent claims.

[0016] A first aspect of the present disclosure relates to a method of processing media content. The method may include receiving the media content and side information for the media content. The method may further include generating or modifying an ISO Base Media File Format, ISOBMFF, file associated with the media content based on the side information. Therein, the side information may include rating information relating to a playback restriction associated with the media content. Further, the ISOBMFF file may include a rating information specific box, the rating information specific box including a representation of the rating information.

[0017] By including the rating information (e.g., parental control metadata) into a box (e.g., newly defined box) inside the ISOBMFF file, it can be ensured that the user-side playback device in a streaming environment can access the rating information, regardless of whether the playback device receives the manifest file. In other words, the playback device can access the rating information even in cases in which it only receives media segments via the MSE interface, the HTML video element, or other media interfaces. Thereby, the playback device can reliably apply access control for the streamed media content, for example in accordance with local device or user authentication. On the other hand, web layer based applications that provide content via the MSE interface, the HTML video element, or other media interfaces or that otherwise do not provide the manifest file to the actual playback device are relieved of having to apply access control for the streamed media content. Since the rating information specific box only needs to be transmitted to the playback device once per steaming session, the proposed method further has comparably low overhead.

[0018] In some embodiments, the playback restriction may relate to an age restriction.

[0019] In some embodiments generating or modifying the ISOBMFF file may include annotating the media content in accordance with the rating information.

[0020] In some embodiments the representation of the rating information may include an indication of a rating scheme.

[0021] In some embodiments, the rating scheme may indicate an audience to which the media content is suitable for replay.

[0022] In some embodiments the indication of the rating scheme may include a uniform resource identifier, URI.

[0023] In some embodiments, the indication of the rating scheme may include a country specific indicator or a region specific indicator.

[0024] In some embodiments, the representation of the rating information may further include an indication of a rating value. This rating value may represent an age restriction in accordance with the rating scheme. Additionally or alternatively, the rating value may relate to an age limit or age range specified by the rating scheme. In general, the rating value may indicate an audience to which the media content is suitable for replay, in accordance with the rating scheme.

[0025] In some embodiments, the representation of the rating information may include an indication of a country or region.

[0026] In some embodiments, the representation of the rating information may further include an indication of a rating value. This rating value may represent an age restriction for the country or region. Additionally or alternatively, the rating value may relate to an age limit or age range. In general, the rating value may indicate an audience to which the media content is suitable for replay in the country or region.

[0027] In some embodiments, the side information may include multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region. Therein, the rating information specific box may include multiple representations of rating information, one for each item of rating information. That is, one rating information specific box is provided for all rating schemes and, optionally, rating values.

[0028] In some embodiments, the side information may include multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region. Therein, the ISOBMFF file may include a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information.

[0029] In some embodiments, each rating information specific box may include a grouping identifier for indicating that the rating information specific box belongs to a group of rating information specific boxes, the group including all of the rating information specific boxes for the multiple items of rating information.

[0030] In some embodiments, the media content may include a track or track group. Then, the rating information specific box may be associated with the track or track group. Alternatively, the rating information specific boxes may be associated with the track or track group.

[0031] In some embodiments, the rating information specific box may be a dedicated rating box. In some embodiments, the rating information specific box may include a name identifier instantiating a descriptor class.

[0032] In some embodiments, the rating information specific box may include a 4-character code, 4CC, identifier instantiating a descriptor class.

[0033] In some embodiments, the rating information specific box may be a descriptor box and may include an indication of a descriptor name indicating that the descriptor box includes the representation of the rating information.

[0034] In some embodiments, the side information may include a Dynamic Adaptive Streaming over HTTP, DASH, DescriptorType data structure. In this case, the name identifier or 4CC identifier may correspond to a DASH element name, and the DASH element may be derived from the DescriptorType data structure.

[0035] In some embodiments, the side information may not be output alongside the ISOBMFF file for further processing.

[0036] Another aspect of the present disclosure relates to a method of processing media content. The method may include receiving the media content and side information for the media content. The method may further include generating or modifying an ISOBMFF file associated with the media content based on the side information. Therein, the side information may include property information specifying a property associated with the media content. Further, the ISOBMFF file may include a property information specific box, the property information specific box including a representation of the property information. The property associated with the media content may be customizable by a user or content creator, for example.

[0037] By including the property information into a newly defined box inside the ISOBMFF file, it can be ensured that the user-side playback device in a streaming environment can access the property information, regardless of whether the playback device also receives the manifest file. In other words, the playback device can access the property information even in cases in which it only receives media segments via the MSE interface, the HTML video element, or other media interfaces. Thereby, content creators can reliably provide the user-side playback device with customizable information on the media content, regardless of the streaming architecture.

[0038] In some embodiments, generating or modifying the ISOBMFF file may include annotating the media content in accordance with the property information. In some embodiments, the representation of the property information may include an indication of a descriptor scheme, the descriptor scheme being indicative of a type of the property.

[0039] In some embodiments, the descriptor scheme may relate to a rating scheme.

[0040] In some embodiments, the representation of the property information may further include an indication of a value, the value relating to a value within a value space defined by the descriptor scheme.

[0041] In some embodiments, the value may relate to a rating value that represents an age restriction in accordance with the rating scheme.

[0042] In some embodiments, the property information specific box may include a grouping identifier for indicating that the property information specific box belongs to a group of property information specific boxes, the group including all of a plurality of property information specific boxes with the same grouping identifier.

[0043] In some embodiments, the media content may include a track or track group. Then, the property information specific box may be associated with the track or track group.

[0044] In some embodiments, the property information specific box may include a name identifier instantiating a descriptor class. For example, the property information specific box may include a 4-character code, 4CC, identifier instantiating a descriptor class.

[0045] In some embodiments, the property information may include a Dynamic Adaptive Streaming over HTTP, DASH, DescriptorType data structure. Then, the name identifier or 4CC identifier may correspond to a DASH element name, and the DASH element (e.g., DASH element name) may be derived from the DescriptorType data structure.

[0046] In some embodiments, the side information may include multiple items of property information, each item of property information relating to a property according to a predefined descriptor scheme. Then, the property information specific box may include multiple representations of property information, one for each item of property information. Alternatively, the ISOBMFF file may include a respective property information specific box for each item of property information, with each property information specific box including a representation of the respective item of property information. In some embodiments, the indication of the descriptor scheme may include a uniform resource identifier, URI.

[0047] Another aspect of the present disclosure relates to a method of processing ISOBMFF file. The ISOBMFF file may comprise media content and a rating information specific box. The rating information specific box may include a representation of rating information that relates to a playback restriction associated with the media content. The method may include extracting the media content from the ISOBMFF file. The method may further include extracting the playback restriction from the rating information specific box of the ISOBMFF file. The method may yet further include determining whether the media content shall be replayed based on the extracted playback restriction. For example, the playback restriction may relate to an age restriction.

[0048] By including the rating information (e.g., parental control metadata) into a box (e.g., newly defined box) inside the ISOBMFF file, it can be ensured that the user-side playback device in a streaming environment can access the rating information, regardless of whether the playback device receives the manifest file. In other words, the playback device can access the rating information even in cases in which it only receives media segments via the MSE interface, the HTML video element, or other media interfaces. Thereby, the playback device can reliably apply access control for the streamed media content, for example in accordance with local user or device authentication. On the other hand, web layer based applications that provide content via the MSE interface, the HTML video element, or other media interfaces or that otherwise do not provide the manifest file to the actual playback device are relieved of having to apply access control for the streamed media content. Since the rating information specific box only needs to be transmitted to the playback device once per steaming session, the proposed method further has comparably low overhead.

[0049] In some embodiments, the representation of the rating information may include an indication of a rating scheme. Then, extracting the playback restriction may include extracting the rating scheme.

[0050] In some embodiments, the rating scheme may indicate an audience to which the media content is suitable for replay.

[0051] In some embodiments, the indication of the rating scheme may include a uniform resource identifier, URI. Additionally or alternatively, the indication of the rating scheme may include a country specific indicator or a region specific indicator. In some embodiments, the representation of the rating information may further include an indication of a rating value. Then, extracting the playback restriction may include extracting the rating value.

[0052] In some embodiments, the rating value may represent an age restriction in accordance with the rating scheme. For example, the rating value may relate to an age limit or age range specified by the rating scheme. In any case, the rating value may indicate an audience to which the media content is suitable for replay, in accordance with the rating scheme.

[0053] In some embodiments, the representation of the rating information may include an indication of a country or region. Then, extracting the playback restriction may include extracting the indication of a country or region.

[0054] In some embodiments, the representation of the rating information may further include an indication of a rating value. Then, extracting the playback restriction may include extracting the rating value.

[0055] In some embodiments, the rating value may represent an age restriction for the country or region. For example, the rating value may relates to an age limit or age range. In any case, the rating value may indicate an audience to which the media content is suitable for replay in the country or region.

[0056] In some embodiments, the side information may include multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region. Then, the rating information specific box may include multiple representations of rating information, one for each item of rating information. Further, extracting the playback restriction may include extracting the playback restriction from a representation of rating information that matches audience information of an audience by which playback of the media content is requested. Alternatively, the ISOBMFF file may include a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information. In this case, extracting the playback restriction may include extracting the playback restriction from a rating information specific box for which the representation of rating information matches audience information of an audience by which playback of the media content is requested. In some embodiments, each rating information specific box may include a grouping identifier for indicating that the rating information specific box belongs to a group of rating information specific boxes, wherein the group includes all of the rating information specific boxes for the multiple items of rating information.

[0057] In some embodiments, the media content comprises a track or track group. Then, the rating information specific box may be associated with the track or track group. If there are multiple rating information specific boxes, the rating information specific boxes may be associated with the track or track group.

[0058] In some embodiments, the rating information specific box may be a dedicated rating box.

[0059] In some embodiments, the rating information specific box may include a name identifier instantiating a descriptor class. For example, the rating information specific box may include a 4-character code, 4CC, identifier instantiating a descriptor class.

[0060] In some embodiments, the rating information specific box may be a descriptor box and may include an indication of a descriptor name indicating that the descriptor box includes the representation of the rating information.

[0061] Another aspect of the present disclosure relates to a method of processing an ISOBMFF file. The ISOBMFF file may include media content (e.g., tracks or track groups) and a property information specific box. The property information specific box may include a representation of property information that relates to a property associated with the media content. The method may include extracting the media content from the ISOBMFF file. The method may further include extracting the property from the property information specific box of the ISOBMFF file. The method may yet further include outputting an indication of the property.

[0062] By including the property information into a newly defined box inside the ISOBMFF file, it can be ensured that the user-side playback device in a streaming environment can access the property information, regardless of whether the playback device also receives the manifest file. In other words, the playback device can access the property information even in cases in which it only receives media segments via the MSE interface, the HTML video element, or other media interfaces. Thereby, content creators can reliably provide the user-side playback device with customizable information on the media content, regardless of the streaming architecture. According to another aspect, an apparatus for processing media content is provided. The apparatus may include a processor and a memory coupled to the processor and storing instructions for the processor. The processor may be configured to perform all steps of the methods according to preceding aspects and their embodiments.

[0063] According to a further aspect, a computer program is described. The computer program may comprise executable instructions for performing the methods or method steps outlined throughout the present disclosure when executed by a computing device (e.g., processor).

[0064] According to another aspect, a computer-readable storage medium is described. The storage medium may store a computer program adapted for execution on a computing device (e.g., processor) and for performing the methods or method steps outlined throughout the present disclosure when carried out on the computing device.

[0065] It should be noted that the methods and systems including its preferred embodiments as outlined in the present disclosure may be used stand-alone or in combination with the other methods and systems disclosed in this document. Furthermore, all aspects of the methods and systems outlined in the present disclosure may be arbitrarily combined. In particular, the features of the claims may be combined with one another in an arbitrary manner.

[0066] It will be appreciated that apparatus features and method steps may be interchanged in many ways. In particular, the details of the disclosed method(s) can be realized by the corresponding apparatus, and vice versa, as the skilled person will appreciate. Moreover, any of the above statements made with respect to the method(s) (and, e.g., their steps) are understood to likewise apply to the corresponding apparatus (and, e.g., their blocks, stages, units), and vice versa.

[0067] Brief Description of the Drawings

[0068] Example embodiments of the disclosure will now be described, by way of example only, with reference to the accompanying drawings in which:

[0069] Fig. 1 schematically illustrates an example of a method of processing media content according to embodiments of the disclosure;

[0070] Fig. 2 schematically illustrates an example of a method of processing an ISOBMFF file according to embodiments of the disclosure; Fig. 3 schematically illustrates an example of another method of processing an ISOBMFF file according to embodiments of the disclosure; and

[0071] Fig- 4 is a block diagram schematically illustrating an example of an apparatus implementing methods according to embodiments of the disclosure.

[0072] Detailed Description

[0073] In the following, example embodiments of the disclosure will be described with reference to the appended figures. Identical elements in the figures may be indicated by identical reference numbers, and repeated description thereof may be omitted.

[0074] The International Organization for Standardization (ISO) includes and specifies a Base Media File format, generally known as ISOBMFF. In particular, this ISOBMFF is specified by ISO / IEC 14496-12 MPEG-4 Part 12 by the ISO. Generally speaking, ISOBMFF is a container file format that defines a general structure for time-based multimedia files such as video and / or audio. It is understood that ISOBMFF in the context of the present disclosure refers to the Base Media File format as specified by ISO / IEC 14496-12 MPEG-4 Part 12 or subsequent standards that are based on this standard.

[0075] Broadly speaking, the present disclosure provides techniques for ensuring enforceability of access control at playback devices even in streaming use cases in which the MSE interface, the HTML video element, or other media interfaces are used for providing the media segments or media files to the playback device, leaving the playback device without access to the manifest file. To this end, techniques according to the present disclosure insert access control metadata (e.g., rating information) into the ISOBMFF file associated with the media content, noting that relevant parts of the ISOBMFF file will be provided to the playback device together with the media segments.

[0076] Encoder-Side Processins

[0077] Rating Information Specific Box in the ISOBMFF File

[0078] Fig- 1 is a flowchart illustrating an example of a method 100 of processing media content according to embodiments of the disclosure. This method may be performed, for example, at a multiplexer (e.g., ISOBMFF multiplexer) at the encoder-side of the streaming chain. At step S110, the media content and side information for the media content are received as an input. The side information includes rating information relating to a playback restriction associated with the media content, or any other information on access control that should be implemented (e.g., enforced) at the user terminal (e.g., playback device). For example, the playback restriction may relate to an age restriction.

[0079] At step SI 20, an ISOBMFF file associated with the media content is generated or modified based on the side information. The (resulting) ISOBMFF file comprises a rating information specific box. This rating information specific box includes a representation of the rating information. Thereby, the media content may be said to be annotated in accordance with the rating information. In some implementations, the rating information specific box may be included in the Movie box of the ISOBMFF file or a track box, for example.

[0080] The ISOBMFF file may then be output for further processing (including, for example, transmission, storage, segmentation for purposes of streaming, etc.). For example, the ISOBMFF file may be output as a segmented media stream. Importantly, the side information is not output alongside the ISOBMFF file for further processing.

[0081] Since the ISOBMFF file will be passed to the user terminal also in streaming use cases that utilize the MSE interface, the HTML video element, or other media interfaces, the user terminal will be able to analyze the rating information (or any other information on access control that should be implemented) and apply access control accordingly. Examples of methods of processing a (segment) of an ISOBMFF file at the playback device side will be described below with reference to Fig. 2 and Fig. 3.

[0082] A non-limiting example of a definition of a rating information specific box included in the ISOBMFF file at step S120 is as follows:

[0083] Box Type: ' rate '

[0084] Container: UserDataBox, AudioElementBox,

[0085] PreselectionTrackGroupEntryBox or instance of TrackGroupEntryBox

[0086] Mandatory: No Quantity: Zero or one / more (depends on syntax)

[0087] This RatingBox labels a track (as a non-limiting example of media content) with its rating. As noted above, the rating information specific box (e.g., as defined above) includes a representation of the rating information. Several non-limiting examples for content and / or syntax of this representation will be given below.

[0088] In one implementation example, the representation contains an indication of a rating scheme, e.g., in the form of or comprising a uniform resource identifier (URI), or it contains a country or region code, in both cases possibly followed by a value (e.g., rating value). In some cases, the indication of the rating scheme may also comprise a country specific indicator or a region specific indicator.

[0089] If only the indication of the rating scheme (e.g., URI) is present, then the rating of the media content may be defined by that rating scheme (e.g., URI). That is, the rating scheme (e.g., URI) may directly indicate an audience to which the media content is suitable (or legally allowed) for replay.

[0090] On the other hand, if a value (e.g., rating value) or indication of a value (e.g., rating value) follows the rating scheme (e.g., URI), then the naming scheme for the value is identified by the rating scheme (e.g., URI). For instance, the rating value may represent an age restriction in accordance with the rating scheme (e.g., as defined by the rating scheme). As another example, the rating value may relate to an age limit or age range specified by the rating scheme. In any case, the rating value may indicate an audience to which the media content is suitable (or legally allowed) for replay, in accordance with the rating scheme.

[0091] In cases where a country or region code (or in general, an indication of a country or region) occurs, then the rating is defined by the following integer value (e.g., rating value) indicating for example the recommended minimum age in years of the audience. Generally, the rating value in this case may represent an age restriction for the country or region, or relate to an age limit or age range. In any case, the rating value may indicate an audience to which the media content is suitable (or legally allowed) for replay in the country or region.

[0092] A non-limiting example of a syntax for a representation including the indication of the rating scheme (e.g., URI) followed by a value (e.g., rating value) is as follows: aligned ( 8 ) class RatingBox extends FullBox ( ' rate ' , version = 0 , 0 ) { utf 8string schemeURI ; utf 8string value ;

[0093] Box [] / / further Boxes as specif ied by the schemeURI }

[0094] A non-limiting example of a syntax for a representation including the indication of a country or region or alternatively, the indication of the rating scheme (e.g., URI), followed by a value (e.g., rating value) is as follows: aligned ( 8 ) class RatingBox extends FullBox ( ' rate ' , version = 0 , 0 ) { if ( f lgas & 0x000001 ) { unsigned int ( 24 ) regionCountryCode

[0095] } else { utf 8string schemeURI ;

[0096] } utf 8string value ;

[0097] Box [] / / further Boxes as specif ied by the schemeURI }

[0098] More than one representation of rating information may occur for certain media content (e.g., for or in a track or track group), with different contents but with appropriate semantics (e.g., multiple schemes that each define a rating that is authoritative in a respective region, for multiple different regions). These different representations may be jointly included in a single rating information specific box, or alternatively, there may be one such rating information specific box for each of the representations.

[0099] Referring to the method 100 of Fig. 1, the side information received at step SI 10 may include multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region. In this case, the rating information specific box at step S120 may include multiple representations of rating information, one for each item of rating information. Alternatively, the ISOBMFF file modified or generated at step S120 may include a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information.

[0100] A non-limiting example of a syntax for a rating information specific box including multiple representations (in this example, each including an indication of a rating scheme (here, URI) followed by a value (e.g., rating value)) is as follows: aligned ( 8 ) class RatingBox extends FullBox (1rate1, version = 0 , 0 ) { while ( 1 ) { / / until end of box utf 8string schemeURI ; utf 8string value ;

[0101] }

[0102] }

[0103] Another non-limiting example of a syntax for a rating information specific box including multiple representations (in this example, each including an indication of a country or region or alternatively, an indication of rating scheme (e.g., URI), followed by a value (e.g., rating value)) is as follows: aligned ( 8 ) class RatingBox extends FullBox ( ' rate ' , version = 0 , 0 ) { while ( 1 ) { / / until end of box if ( f lgas & 0x000001 ) { unsigned int ( 24 ) regionCountryCode

[0104] } else { utf 8string schemeURI ;

[0105] } utf 8string value ;

[0106] }

[0107] }

[0108] If the ISOBMFF file includes multiple rating information specific boxes, each rating information specific box may include a grouping identifier. This grouping identifier may indicate that the rating information specific box belongs to a group of rating information specific boxes, the group including all of the rating information specific boxes for the multiple items of rating information included in the side information.

[0109] A non-limiting example of the semantics for the above syntax examples is as follows: schemeURI declares either the identifier of the rating scheme, if no value follows, the identifier of the naming scheme for the following value, or a country code as specified in ISO 3166 [x] or group of countries according to ETSI TS 101 162 [x], regionCountryCode is a country code as specified in ISO 3166 [x] or group of countries according to ETSI TS 101 162 [x], value is a name from the declared scheme, if no value is indicated, an empty string.

[0110] It is understood that the media content may comprise a track or track group. Accordingly, the rating information specific box (or rating information specific boxes, if more than one such box is present in the ISOBMFF file) may be associated with the track or track group.

[0111] Property Information Specific Box in the ISOBMFF File

[0112] In the above definition example and syntax examples, the rating information specific box is a dedicated rate box (e.g., Box Type: ' rate ' or the like). In addition to the concept of dedicated rate boxes, the present disclosure further foresees property information specific boxes including one or more representations of property information associated with the media content.

[0113] Returning to method 100 of Fig. 1, this alternative concept may be implemented as follows. Deviating from the above, the side information received at step SI 10 may include property information that specifies a property associated with the media content. The property associated with the media content may be customizable by a user or content creator, for example. As will be described in more detail below, one example of such property relates to rating information, so that the property information specific box may be used for conveying parental control metadata, or the like.

[0114] Further deviating from the above, the ISOBMFF file at step S120 may comprises a property information specific box that includes a representation of the property information.

[0115] Accordingly, generating or modifying the ISOBMFF file at step S120 may be said to comprise or amount to annotating the media content in accordance with the property information.

[0116] A non-limiting example of a definition of a property information specific box included in the ISOBMFF file is as follows:

[0117] Box Type: ' desc '

[0118] Container: UserDataBox, AudioElementBox,

[0119] PreselectionTrackGroupEntryBox or instance of TrackGroupEntryBox

[0120] Mandatory: No

[0121] Quantity: Zero or one / more depends of syntax)

[0122] This DescriptorBox may label a track (as a non-limiting example of media content) with its rating, or with any other kind of customizable property information.

[0123] The property information specific box may comprises a name identifier instantiating a descriptor class. For example, the property information specific box may comprise a 4- character code, 4CC, identifier instantiating a descriptor class.

[0124] Further, the property information received as part of the side information at step SI 10 may comprise a DASH DescriptorType data structure. Then, the name identifier or 4CC identifier may correspond to a DASH element name, and the DASH element or DASH element name may be derived from the DescriptorType data structure.

[0125] As noted above, the property information specific box (e.g., as defined above) includes a representation of the property information. In general, this representation of the property information may include an indication of a descriptor scheme (e.g., corresponding to or comprising an URI), where the descriptor scheme is indicative of a type of the property. Optionally, the representation of the property information may further include an indication of a value, where the value relates to a value within a value space defined by the descriptor scheme.

[0126] More than one of these representations of property information may occur for certain media content (e.g., for or in a track or track group), with different contents but with appropriate semantics. These different representations may be jointly included in a single property information specific box, or alternatively, there may be one such property information specific box for each of the representations in the ISOBMFF file.

[0127] Referring to the method 100 of Fig. 1, the side information received at step SI 10 may include multiple items of property information, with each item of property information relating to a property according to a predefined descriptor scheme. In this case, the property information specific box at step S120 may include multiple representations of property information, one for each item of property information. Alternatively, the ISOBMFF file modified or generated at step SI 20 may include a respective property information specific box for each item of property information, with each property information specific box including a representation of the respective item of property information.

[0128] It is again understood that the media content may comprise a track or track group and that accordingly, the property information specific box (or property information specific boxes, if more than one such box is present in the ISOBMFF file) may be associated with the track or track group.

[0129] The property information specific box (e.g., DescriptorBox) defined above is suitable for conveying any property of the media content, as required by implementations and use cases. One particular field of application for the property information specific box is for conveying rating information. In this case, the aforementioned descriptor scheme may relate to a rating scheme (e.g., a rating scheme as described above for the rating information specific box). In this case, the (optional) value may relate to a rating value that represents an age restriction in accordance with the rating scheme (e.g., as described above for the rating information specific box).

[0130] That is, the representation of the property information in this case may contain an indication of a rating scheme, e.g., in the form of or comprising an uniform resource identifier (URI), possibly followed by an (optional) value (e.g., rating value). In some cases, the indication of the rating scheme may also comprise a country specific indicator or a region specific indicator.

[0131] If only the indication of the rating scheme (e.g., URI) is present, then the rating may be defined by that rating scheme (e.g., URI). That is, as above, the rating scheme (e.g., URI) may directly indicate an audience to which the media content is suitable (or legally allowed) for replay. On the other hand, if a value (e.g., rating value) or indication of a value (e.g., rating value) follows the rating scheme (e.g., URI), then the naming scheme for the value is identified by the rating scheme (e.g., URI). For instance, the rating value may represent an age restriction in accordance with the rating scheme (e.g., as defined by the rating scheme). As another example, the rating value may relate to an age limit or age range specified by the rating scheme. In any case, the rating value may indicate an audience to which the media content is suitable (or legally allowed) for replay, in accordance with the rating scheme.

[0132] In cases where a country or region code (or in general, an indication of a country or region) occurs, then the rating is defined by the following integer value (e.g., rating value) indicating for example the recommended minimum age in years of the audience. Generally, the rating value in this case may represent an age restriction for the country or region, or relate to an age limit or age range. In any case, the rating value may indicate an audience to which the media content is suitable (or legally allowed) for replay in the country or region.

[0133] Non-limiting examples for content and / or syntax of the aforementioned representation will be given below.

[0134] A non-limiting example of a syntax for a representation of property information including the indication of the rating scheme (e.g., URI) followed by a value (e.g., rating value) is as follows: aligned ( 8 ) class DescriptorBox extends FullBox ( ' desc ' , version = 0 , 0 ) { utf 8string descriptorName ; utf 8string schemeURI ; utf 8string value ; unsigned int ( 31 ) descriptorGroupId ;

[0135] Box [] / / further Boxes as specif ied by the descriptorName / schemeURI

[0136] }

[0137] As above, anticipating the situation that the ISOBMFF file includes multiple property information specific boxes (e.g., of the same descriptor type), each property information specific box may include a grouping identifier (e.g., descriptorGroupId as in the above example). This grouping identifier may indicate that the property information specific box belongs to a group of property information specific boxes. Grouping of descriptors (e.g., property information specific boxes) may be beneficial in cases where an element carrying the descriptor must be disregarded as long as at least one descriptor in the descriptor group with their schemeURI and values is identified to be supported. This identification may be based for example on the MPEG-DASH “EssentialProperty” descriptor per ISO 23009-1, section 5.8.4.8.

[0138] It is understood that the above syntax example may be extended in the same way as the first of the syntax examples provided above for the rating information specific box. For example, the syntax may be modified or extended to additionally or alternatively include an indication of a country or region and / or, to include multiple representations of property information, etc..

[0139] A non-limiting example of the semantics for the above syntax example is as follows: descriptorName declares a name for the class of descriptor. schemeURI declares either the identifier of the rating scheme, if no value follows, the identifier of the naming scheme for the following value, or a country code as specified in ISO 3166 [x] or group of countries according to ETSI TS 101 162 [x], value is a name from the declared scheme, if no value is indicated, an empty string descriptorGroupId is an identifier suitable to group multiple instances of DescriptorBox as employed by the value if schemeURI.

[0140] As described above, the property information specific box may be used for conveying rating information. In other words, the rating information specific box may be an instantiation of a property information specific box, in which case the rating information specific box comprises a name identifier instantiating the descriptor class (e.g., via a 4CC identifier). Or in yet other words, the rating information specific box may be a descriptor box and may comprise an indication of a descriptor name indicating that the descriptor box includes the representation of the rating information.

[0141] Although not explicitly described, it is understood that the present disclosure further relates to defining a virtual base class and inheriting specific descriptors (including for example the rating descriptor) from the base class. User-Side Processing

[0142] Fig- 2 is a flowchart illustrating an example of a method 200 of processing a (possibly segmented) ISOBMFF file according to embodiments of the disclosure. This method may be performed, for example, at a user terminal (e.g., playback device or receiver) at the user-side of the streaming chain. The ISOBMFF file may be the ISOBMFF file output by method 100 of Fig. 1. Accordingly, the ISOBMFF file may comprise media content and a rating information specific box. The rating information specific box includes a representation of rating information that relates to a playback restriction associated with the media content. As above, the playback restriction may relate to an age restriction, for example.

[0143] As step S210, the media content is extracted from the ISOBMFF file. The ISOBMFF file may be received beforehand, as file or as a segmented media stream, to give non-limiting examples.

[0144] At step S220, the playback restriction is extracted from the rating information specific box of the ISOBMFF file.

[0145] At step S230, it is determined whether the media content (e.g., track or track group) shall be replayed based on the extracted playback restriction.

[0146] The rating information specific box and representation of the rating information may correspond to those described above for encoder-side processing, and extraction of the playback restriction at step S220 may proceed as required by the structure of the rating information specific box or representation of the rating information.

[0147] For example, if the representation of the rating information includes an indication of a rating scheme, extracting the playback restriction at step S220 may comprise extracting the rating scheme.

[0148] Further, if the representation of the rating information further includes an indication of a rating value, extracting the playback restriction at step S220 may comprise extracting the rating value.

[0149] Further, if the representation of the rating information includes an indication of a country or region, extracting the playback restriction at step S220 may comprise extracting the indication of the country or region. Further, if the representation of the rating information further includes an indication of a rating value, extracting the playback restriction at step S220 may comprise extracting the rating value.

[0150] Further, if the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region, and if the rating information specific box includes multiple representations of rating information, one for each item of rating information, extracting the playback restriction at step S220 may comprise extracting the playback restriction from a representation of rating information that matches audience information of an audience by which playback of the media content is requested.

[0151] Alternatively, if the ISOBMFF file includes a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information, extracting the playback restriction at step S220 may comprise extracting the playback restriction from a rating information specific box for which the representation of rating information matches audience information of an audience by which playback of the media content is requested.

[0152] Fig- 3 is a flowchart illustrating another example of a method 300 of processing a (possibly segmented) ISOBMFF file according to embodiments of the disclosure. This method may be performed, for example, at a user terminal (e.g., playback device or receiver) at the user-side of the streaming chain. The ISOBMFF file may be the ISOBMFF file output by method 100 of Fig. 1. Accordingly, the ISOBMFF file in this case comprises media content and a property information specific box. The property information specific box includes a representation of property information that relates to a property associated with the media content.

[0153] At step S310, the media content is extracted from the ISOBMFF file. The ISOBMFF file may be received beforehand, as or with a bitstream, for example.

[0154] At step S320, the property is extracted from the property information specific box of the ISOBMFF file.

[0155] Finally, at step S330, an indication of the extracted property is output.

[0156] The property information specific box and representation of the property information may correspond to those described above for encoder-side processing, and extraction of the property at step S320 may proceed as required by the structure of the property information specific box or representation of the property information.

[0157] Apparatus

[0158] While methods and processing chains have been described above, it is understood that the present disclosure likewise relates to apparatus (e.g., computer apparatus or apparatus having processing capability in general) for implementing these methods and processing chains (or techniques in general).

[0159] An example of such apparatus 400 is schematically illustrated in Fig. 4. The apparatus 400 comprises a processor 410 and a memory 420 coupled to the processor 410. The memory 420 may store instructions for execution by the processor 410. The processor 410 may be adapted to implement / perform methods described throughout the disclosure, in particular methods of processing media content (e.g., methods that modify / generate ISOBMFF files or evaluate ISOBMFF files). The apparatus 400 may receive one or more inputs 440 (e.g., media content, side information for the media content, ISOBMFF files, etc.) and generate or output one or more outputs 450 (e.g., an ISOBMFF file, etc.).

[0160] Interpretation

[0161] Aspects of the systems described herein may be implemented in an appropriate computer- based media processing network environment (e.g., server or cloud environment) for processing digital or digitized media files. Portions of these systems may include one or more networks that comprise any desired number of individual machines, including one or more routers (not shown) that serve to buffer and route the data transmitted among the computers. Such a network may be built on various different network protocols, and may be the Internet, a Wide Area Network (WAN), a Local Area Network (LAN), or any combination thereof.

[0162] One or more of the components, blocks, processes or other functional components may be implemented through a computer program that controls execution of a processor-based computing device of the system. It should also be noted that the various functions disclosed herein may be described using any number of combinations of hardware, firmware, and / or as data and / or instructions embodied in various machine-readable or computer-readable media, in terms of their behavioral, register transfer, logic component, and / or other characteristics. Computer-readable media in which such formatted data and / or instructions may be embodied include, but are not limited to, physical (non-transitory), non-volatile storage media in various forms, such as optical, magnetic or semiconductor storage media.

[0163] Specifically, it should be understood that embodiments may include hardware, software, and electronic components or modules that, for purposes of discussion, may be illustrated and described as if the majority of the components were implemented solely in hardware. However, one of ordinary skill in the art, and based on a reading of this detailed description, would recognize that, in at least one embodiment, the electronic-based aspects may be implemented in software (e.g., stored on non-transitory computer-readable medium) executable by one or more electronic processors, such as a microprocessor and / or application specific integrated circuits (“ASICs”). As such, it should be noted that a plurality of hardware and software-based devices, as well as a plurality of different structural components, may be utilized to implement the embodiments. For example, computer-implemented neural networks described herein can include one or more electronic processors, one or more computer-readable medium modules, one or more input / output interfaces, and various connections (e.g., a system bus) connecting the various components.

[0164] While one or more implementations have been described by way of example and in terms of the specific embodiments, it is to be understood that one or more implementations are not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements as would be apparent to those skilled in the art. Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

[0165] Also, it is to be understood that the phraseology and terminology used herein are for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof are meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings.

[0166] Enumerated Example Embodiments

[0167] Various Aspects and implementations of the invention may also be appreciated from the following enumerated example embodiments (EEEs), which are not claims.

[0168] EEE 1. A method of processing media content, the method comprising: receiving the media content and side information for the media content; and generating or modifying an ISO Base Media File Format, ISOBMFF, file associated with the media content based on the side information, wherein the side information includes rating information relating to a playback restriction associated with the media content; and wherein the ISOBMFF file comprises a rating information specific box, the rating information specific box including a representation of the rating information.

[0169] EEE 2. The method according to EEE 1, wherein the playback restriction relates to an age restriction.

[0170] EEE 3. The method according to any one of the preceding EEEs, wherein generating or modifying the ISOBMFF file comprises annotating the media content in accordance with the rating information.

[0171] EEE 4. The method according to any one of the preceding EEEs, wherein the representation of the rating information includes an indication of a rating scheme.

[0172] EEE 5. The method according to EEE 4, wherein the rating scheme indicates an audience to which the media content is suitable for replay.

[0173] EEE 6. The method according to EEE 4 or 5, wherein the indication of the rating scheme comprises a uniform resource identifier, URI.

[0174] EEE 7. The method according to EEE 4 or 5, wherein the indication of the rating scheme comprises a country specific indicator or a region specific indicator.

[0175] EEE 8. The method according to any one of the preceding EEEs, wherein the representation of the rating information further includes an indication of a rating value.

[0176] EEE 9. The method according to EEE 8, wherein the rating value represents an age restriction in accordance with the rating scheme.

[0177] EEE 10. The method according to EEE 8 or 9, wherein the rating value relates to an age limit or age range specified by the rating scheme.

[0178] EEE 11. The method according to EEE 8, wherein the rating value indicates an audience to which the media content is suitable for replay, in accordance with the rating scheme. EEE 12. The method according to any one of EEEs 1 to 3, wherein the representation of the rating information includes an indication of a country or region.

[0179] EEE 13. The method according to EEE 12, wherein the representation of the rating information further includes an indication of a rating value.

[0180] EEE 14. The method according to EEE 13, wherein the rating value represents an age restriction for the country or region.

[0181] EEE 15. The method according to EEE 13 or 14, wherein the rating value relates to an age limit or age range.

[0182] EEE 16. The method according to EEE 13, wherein the rating value indicates an audience to which the media content is suitable for replay in the country or region.

[0183] EEE 17. The method according to any one of the preceding EEEs, wherein the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region; and wherein the rating information specific box includes multiple representations of rating information, one for each item of rating information.

[0184] EEE 18. The method according to any one of EEEs 1 to 16, wherein the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region; and wherein the ISOBMFF file includes a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information.

[0185] EEE 19. The method according to EEE 18, wherein each rating information specific box includes a grouping identifier for indicating that the rating information specific box belongs to a group of rating information specific boxes, the group including all of the rating information specific boxes for the multiple items of rating information.

[0186] EEE 20. The method according to any one of EEEs 1 to 17, wherein the media content comprises a track or track group; and wherein the rating information specific box is associated with the track or track group. EEE 2 The method according to EEE 18 or 19, wherein the media content comprises a track or track group; and wherein the rating information specific boxes are associated with the track or track group.

[0187] EEE 22. The method according to any one of the preceding EEEs, wherein the rating information specific box is a dedicated rating box.

[0188] EEE 23. The method according to any one of EEEs 1 to 21, wherein the rating information specific box comprises a name identifier instantiating a descriptor class.

[0189] EEE 24. The method according to any one of EEEs 1 to 21, wherein the rating information specific box comprises a 4-character code, 4CC, identifier instantiating a descriptor class.

[0190] EEE 25. The method according to any one of EEEs 1 to 21, 23, or 24, wherein the rating information specific box is a descriptor box and comprises an indication of a descriptor name indicating that the descriptor box includes the representation of the rating information.

[0191] EEE 26. The method according to any one of the preceding EEEs, wherein the side information comprises a Dynamic Adaptive Streaming over HTTP, DASH, DescriptorType data structure.

[0192] EEE 27. The method according to EEE 26 when depending on EEE 23 or 24, wherein the name identifier or 4CC identifier corresponds to a DASH element name, and wherein the DASH element is derived from the DescriptorType data structure.

[0193] EEE 28. The method of any of one of the preceding EEEs, wherein the side information is not output alongside the ISOBMFF file for further processing.

[0194] EEE 29. A method of processing media content, the method comprising: receiving the media content and side information for the media content; and generating or modifying an ISO Base Media File Format, ISOBMFF, file associated with the media content based on the side information, wherein the side information includes property information specifying a property associated with the media content; and wherein the ISOBMFF file comprises a property information specific box, the property information specific box including a representation of the property information.

[0195] EEE 30. The method according to EEE 29, wherein generating or modifying the ISOBMFF file comprises annotating the media content in accordance with the property information. EEE 31. The method according to EEE 29 or 30, wherein the representation of the property information includes an indication of a descriptor scheme, the descriptor scheme being indicative of a type of the property.

[0196] EEE 32. The method according to EEE 31, wherein the descriptor scheme relates to a rating scheme.

[0197] EEE 33. The method according to any one of EEEs 29 to 32, wherein the representation of the property information further includes an indication of a value, the value relating to a value within a value space defined by the descriptor scheme.

[0198] EEE 34. The method according to EEE 33 when depending on EEE 32, wherein the value relates to a rating value that represents an age restriction in accordance with the rating scheme.

[0199] EEE 35. The method according to any one of EEEs 29 to 34, wherein the property information specific box includes a grouping identifier for indicating that the property information specific box belongs to a group of property information specific boxes, the group including all of a plurality of property information specific boxes with the same grouping identifier.

[0200] EEE 36. The method according to any one of EEEs 29 to 35, wherein the media content comprises a track or track group; and wherein the property information specific box is associated with the track or track group.

[0201] EEE 37. The method according to any one of EEEs 29 to 36, wherein the property information specific box comprises a name identifier instantiating a descriptor class.

[0202] EEE 38. The method according to any one of EEEs 29 to 36, wherein the property information specific box comprises a 4-character code, 4CC, identifier instantiating a descriptor class.

[0203] EEE 39. The method according to any one of EEEs 29 to 38, wherein the property information comprises a Dynamic Adaptive Streaming over HTTP, DASH, DescriptorType data structure.

[0204] EEE 40. The method according to EEE 39 when depending on EEE 37 or 38, wherein the name identifier or 4CC identifier corresponds to a DASH element name, and wherein the DASH element is derived from the DescriptorType data structure. EEE 41. The method according to any one of EEEs 29 to 40, wherein the side information includes multiple items of property information, each item of property information relating to a property according to a predefined descriptor scheme; and wherein the property information specific box includes multiple representations of property information, one for each item of property information.

[0205] EEE 42. The method according to any one of EEEs 29 to 40, wherein the side information includes multiple items of property information, each item of property information relating to a property according to a predefined descriptor scheme; and wherein the ISOBMFF file includes a respective property information specific box for each item of property information, with each property information specific box including a representation of the respective item of property information.

[0206] EEE 43. The method according to EEE 31, wherein the indication of the descriptor scheme comprises a uniform resource identifier, URI.

[0207] EEE 44. A method of processing an ISO Base Media File Format, ISOBMFF, file, wherein the ISOBMFF file comprises media content and a rating information specific box, the rating information specific box including a representation of rating information that relates to a playback restriction associated with the media content, the method comprising: extracting the media content from the ISOBMFF file; extracting the playback restriction from the rating information specific box of the ISOBMFF file; and determining whether the media content shall be replayed based on the extracted playback restriction.

[0208] EEE 45. The method according to EEE 44, wherein the playback restriction relates to an age restriction.

[0209] EEE 46. The method according to EEE 44 or 45, wherein the representation of the rating information includes an indication of a rating scheme; and wherein extracting the playback restriction comprises extracting the rating scheme.

[0210] EEE 47. The method according to EEE 46, wherein the rating scheme indicates an audience to which the media content is suitable for replay.

[0211] EEE 48. The method according to EEE 46 or 47, wherein the indication of the rating scheme comprises a uniform resource identifier, URI. EEE 49. The method according to EEE 46 or 47, wherein the indication of the rating scheme comprises a country specific indicator or a region specific indicator.

[0212] EEE 50. The method according to any one of EEEs 44 to 49, wherein the representation of the rating information further includes an indication of a rating value; and wherein extracting the playback restriction comprises extracting the rating value.

[0213] EEE 51. The method according to EEE 50, wherein the rating value represents an age restriction in accordance with the rating scheme.

[0214] EEE 52. The method according to EEE 50 or 51, wherein the rating value relates to an age limit or age range specified by the rating scheme.

[0215] EEE 53. The method according to EEE 50, wherein the rating value indicates an audience to which the media content is suitable for replay, in accordance with the rating scheme.

[0216] EEE 54. The method according to EEE 44 or 45, wherein the representation of the rating information includes an indication of a country or region; and wherein extracting the playback restriction comprises extracting the indication of a country or region.

[0217] EEE 55. The method according to EEE 54, wherein the representation of the rating information further includes an indication of a rating value; and wherein extracting the playback restriction comprises extracting the rating value.

[0218] EEE 56. The method according to EEE 55, wherein the rating value represents an age restriction for the country or region.

[0219] EEE 57. The method according to EEE 55 or 56, wherein the rating value relates to an age limit or age range.

[0220] EEE 58. The method according to EEE 55, wherein the rating value indicates an audience to which the media content is suitable for replay in the country or region.

[0221] EEE 59. The method according to any one of EEEs 44 to 58, wherein the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region; wherein the rating information specific box includes multiple representations of rating information, one for each item of rating information; and wherein extracting the playback restriction comprises extracting the playback restriction from a representation of rating information that matches audience information of an audience by which playback of the media content is requested.

[0222] EEE 60. The method according to any one of EEEs 44 to 58, wherein the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region; wherein the ISOBMFF file includes a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information; wherein extracting the playback restriction comprises extracting the playback restriction from a rating information specific box for which the representation of rating information matches audience information of an audience by which playback of the media content is requested.

[0223] EEE 61. The method according to EEE 60, wherein each rating information specific box includes a grouping identifier for indicating that the rating information specific box belongs to a group of rating information specific boxes, wherein the group includes all of the rating information specific boxes for the multiple items of rating information.

[0224] EEE 62. The method according to any one of EEEs 44 to 59, wherein the media content comprises a track or track group; and wherein the rating information specific box is associated with the track or track group.

[0225] EEE 63. The method according to EEE 60 or 61, wherein the media content comprises a track or track group; and wherein the rating information specific boxes are associated with the track or track group.

[0226] EEE 64. The method according to any one of EEEs 44 to 63, wherein the rating information specific box is a dedicated rating box.

[0227] EEE 65. The method according to any one of EEEs 44 to 63, wherein the rating information specific box comprises a name identifier instantiating a descriptor class.

[0228] EEE 66. The method according to any one of EEEs 44 to 63, wherein the rating information specific box comprises a 4-character code, 4CC, identifier instantiating a descriptor class. EEE 67. The method according to any one of EEEs 44 to 63, 65, or 66, wherein the rating information specific box is a descriptor box and comprises an indication of a descriptor name indicating that the descriptor box includes the representation of the rating information.

[0229] EEE 68. A method of processing an ISO Base Media File Format, ISOBMFF, file, wherein the ISOBMFF file comprises media content and a property information specific box, the property information specific box including a representation of property information that relates to a property associated with the media content, the method comprising: extracting the media content from the ISOBMFF file; extracting the property from the property information specific box of the ISOBMFF file; and outputting an indication of the property.

[0230] EEE 69. An apparatus, comprising a processor and a memory coupled to the processor and storing instructions for the processor, wherein the processor is adapted to carry out the method according to any one of EEEs 1 to 68.

[0231] EEE 70. A program comprising instructions that, when executed by a processor, cause the processor to carry out the method according to any one of EEE s 1 to 68.

[0232] EEE 71. A computer-readable storage medium storing the program of EEE 70.

[0233] EEE 72. A method of processing media streams, the method including: receiving one or more media streams and side information for the one or more media streams, the one or more media streams comprising media content comprising one or more tracks; generating an ISO Base Media File Format, ISOBMFF, file based on the one or more media streams and the side information; and outputting the generated ISOBMFF file for further processing.

[0234] EEE 73. The method of EEE 72, wherein the side information is indicative of rating information, the rating information comprising a rating scheme and associated value specifying that the one or more media streams or one or more of their components is suitable for presentation to audiences for which that rating is known to be appropriate.

[0235] EEE 74. The method of EEE 72 or 73, wherein generating the ISOBMFF file includes annotating the one or more media streams, the one or more tracks or one or more groups of tracks with the side information indicative of rating information.

[0236] EEE 75. The method of EEE 74, wherein the group of tracks comprises tracks groups, alternate groups or switch groups.

[0237] EEE 76. The method of EEE 74 or 75, wherein generating the ISOBMFF file includes, for each instance of rating information, adding a rating information specific box indicating the employed rating scheme and a rating value specific to the rating scheme, both in combination being indicative of the associated media stream or one or more of their components being suitable for presentation to audiences for which that rating is known to be appropriate.

[0238] EEE 77. The method of EEE 76, wherein generating the ISOBMFF includes, for multiple instances of rating information, adding one rating information specific box iterating all rating information.

[0239] EEE 78. The method of EEE 76 or 77, wherein the rating scheme comprises a uniform resource identifier.

[0240] EEE 79. The method of EEE 76 or 77, wherein the rating scheme comprises a country- or region-specific indicator.

[0241] EEE 80. The method of EEE 78 or 79, wherein the rating value comprises an entry of the allowed value space or any other range within a parameter space specified by the rating scheme indicative of the level of rating.

[0242] EEE 81. The method of EEE 72, wherein the side information is indicative of generalized (e.g., customizable, or assignable by the user) structured side information, the generalized structured side information comprising a scheme identifier and optional associated value specifying a property of the one or more media streams or one or more media components, with the scheme identifier being indicative of the kind of the property and the optional value being indicative of the amount within the value space specified by the scheme identifier.

[0243] EEE 82. The method of EEE 81, wherein the side information further comprises a grouping identifier, the grouping identifier being suitable to group multiple instances of the side information.

[0244] EEE 83. The method of EEE 81 or 82, wherein the side information further comprises a name identifier instantiating a descriptor class.

[0245] EEE 84. The method of EEE 81 or 82, wherein the side information further comprises a 4- character-code, “4CC”, identifier instantiating a descriptor class. EEE 85. The method of any of EEEs 81 to 84, wherein the generalized side information corresponds to DASH DescriptorType data structure.

[0246] EEE 86. The method of EEE 83 or 84 in dependence on EEE 85, wherein the name identifier or 4CC identifier corresponds to a DASH element name, where the DASH element is derived from DescriptorType.

[0247] EEE 87. The method of any of one of EEEs 81 to 86, wherein generating the ISOBMFF file includes annotating the one or more media streams, the one or more tracks or one or more groups of tracks with the generalized structured side information.

[0248] EEE 88. The method of EEE 87, wherein the group of tracks comprises tracks groups, alternate groups or switch groups.

[0249] EEE 89. The method of EEE 87 or 88, wherein the ISOBMFF file includes, for each instance of the generalized structured side information, a generalized structured side information specific box indicating the generalized structured side information.

[0250] EEE 90. The method of EEE 87 or 88, wherein the ISOBMFF includes, for multiple instances of generalized structured side information, a generalized structured side information specific box iterating all generalized structured side information instances.

[0251] EEE 91. The method of EEE 89 or 90, wherein the scheme comprises a uniform resource identifier, “URI”.

Claims

Claims1. A method of processing media content, the method comprising: receiving the media content and side information for the media content; and generating or modifying an ISO Base Media File Format, ISOBMFF, file associated with the media content based on the side information, wherein the side information includes rating information relating to a playback restriction associated with the media content; and wherein the ISOBMFF file comprises a rating information specific box, the rating information specific box including a representation of the rating information.

2. The method according to claim 1, wherein the playback restriction relates to an age restriction.

3. The method according to any one of the preceding claims, wherein generating or modifying the ISOBMFF file comprises annotating the media content in accordance with the rating information.

4. The method according to any one of the preceding claims, wherein the representation of the rating information includes an indication of a rating scheme.

5. The method according to claim 4, wherein the rating scheme indicates an audience to which the media content is suitable for replay.

6. The method according to claim 4 or 5, wherein the indication of the rating scheme comprises a uniform resource identifier, URI.

7. The method according to claim 4 or 5, wherein the indication of the rating scheme comprises a country specific indicator or a region specific indicator.

8. The method according to any one of the preceding claims, wherein the representation of the rating information further includes an indication of a rating value.

9. The method according to claim 8, wherein the rating value represents an age restriction in accordance with the rating scheme.

10. The method according to claim 8 or 9, wherein the rating value relates to an age limit or age range specified by the rating scheme.

11. The method according to claim 8, wherein the rating value indicates an audience to which the media content is suitable for replay, in accordance with the rating scheme.

12. The method according to any one of claims 1 to 3, wherein the representation of the rating information includes an indication of a country or region.

13. The method according to claim 12, wherein the representation of the rating information further includes an indication of a rating value.

14. The method according to claim 13, wherein the rating value represents an age restriction for the country or region.

15. The method according to claim 13 or 14, wherein the rating value relates to an age limit or age range.

16. The method according to claim 13, wherein the rating value indicates an audience to which the media content is suitable for replay in the country or region.

17. The method according to any one of the preceding claims, wherein the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region; and wherein the rating information specific box includes multiple representations of rating information, one for each item of rating information.

18. The method according to any one of claims 1 to 16, wherein the side information includes multiple items of rating information, each item of rating information relating to areplay restriction according to a respective predefined rating scheme and / or for a respective country or region; and wherein the ISOBMFF file includes a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information.

19. The method according to claim 18, wherein each rating information specific box includes a grouping identifier for indicating that the rating information specific box belongs to a group of rating information specific boxes, the group including all of the rating information specific boxes for the multiple items of rating information.

20. The method according to any one of claims 1 to 17, wherein the media content comprises a track or track group; and wherein the rating information specific box is associated with the track or track group.

21. The method according to claim 18 or 19, wherein the media content comprises a track or track group; and wherein the rating information specific boxes are associated with the track or track group.

22. The method according to any one of the preceding claims, wherein the rating information specific box is a dedicated rating box.

23. The method according to any one of claims 1 to 21, wherein the rating information specific box comprises a name identifier instantiating a descriptor class.

24. The method according to any one of claims 1 to 21, wherein the rating information specific box comprises a 4-character code, 4CC, identifier instantiating a descriptor class.

25. The method according to any one of claims 1 to 21, 23, or 24, wherein the rating information specific box is a descriptor box and comprises an indication of a descriptor name indicating that the descriptor box includes the representation of the rating information.

26. The method according to any one of the preceding claims, wherein the side information comprises a Dynamic Adaptive Streaming over HTTP, DASH, DescriptorType data structure.

27. The method according to claim 26 when depending on claim 23 or 24, wherein the name identifier or 4CC identifier corresponds to a DASH element name, and wherein the DASH element is derived from the DescriptorType data structure.

28. The method of any of one of the preceding claims, wherein the side information is not output alongside the ISOBMFF file for further processing.

29. A method of processing media content, the method comprising: receiving the media content and side information for the media content; and generating or modifying an ISO Base Media File Format, ISOBMFF, file associated with the media content based on the side information, wherein the side information includes property information specifying a property associated with the media content; and wherein the ISOBMFF file comprises a property information specific box, the property information specific box including a representation of the property information.

30. The method according to claim 29, wherein generating or modifying the ISOBMFF file comprises annotating the media content in accordance with the property information.

31. The method according to claim 29 or 30, wherein the representation of the property information includes an indication of a descriptor scheme, the descriptor scheme being indicative of a type of the property.

32. The method according to claim 31, wherein the descriptor scheme relates to a rating scheme.

33. The method according to any one of claims 29 to 32, wherein the representation of the property information further includes an indication of a value, the value relating to a value within a value space defined by the descriptor scheme.

34. The method according to claim 33 when depending on claim 32, wherein the value relates to a rating value that represents an age restriction in accordance with the rating scheme.

35. The method according to any one of claims 29 to 34, wherein the property information specific box includes a grouping identifier for indicating that the property information specific box belongs to a group of property information specific boxes, the group including all of a plurality of property information specific boxes with the same grouping identifier.

36. The method according to any one of claims 29 to 35, wherein the media content comprises a track or track group; and wherein the property information specific box is associated with the track or track group.

37. The method according to any one of claims 29 to 36, wherein the property information specific box comprises a name identifier instantiating a descriptor class.

38. The method according to any one of claims 29 to 36, wherein the property information specific box comprises a 4-character code, 4CC, identifier instantiating a descriptor class.

39. The method according to any one of claims 29 to 38, wherein the property information comprises a Dynamic Adaptive Streaming over HTTP, DASH, DescriptorType data structure.

40. The method according to claim 39 when depending on claim 37 or 38, wherein the name identifier or 4CC identifier corresponds to a DASH element name, and wherein the DASH element is derived from the DescriptorType data structure.

41. The method according to any one of claims 29 to 40, wherein the side information includes multiple items of property information, each item of property information relating to a property according to a predefined descriptor scheme; and wherein the property information specific box includes multiple representations of property information, one for each item of property information.

42. The method according to any one of claims 29 to 40, wherein the side information includes multiple items of property information, each item of property information relating to a property according to a predefined descriptor scheme; and wherein the ISOBMFF file includes a respective property information specific box for each item of property information, with each property information specific box including a representation of the respective item of property information.

43. The method according to claim 31, wherein the indication of the descriptor scheme comprises a uniform resource identifier, URI.

44. A method of processing an ISO Base Media File Format, ISOBMFF, file, wherein the ISOBMFF file comprises media content and a rating information specific box, the rating information specific box including a representation of rating information that relates to a playback restriction associated with the media content, the method comprising: extracting the media content from the ISOBMFF file; extracting the playback restriction from the rating information specific box of the ISOBMFF file; and determining whether the media content shall be replayed based on the extracted playback restriction.

45. The method according to claim 44, wherein the playback restriction relates to an age restriction.

46. The method according to claim 44 or 45, wherein the representation of the rating information includes an indication of a rating scheme; and wherein extracting the playback restriction comprises extracting the rating scheme.

47. The method according to claim 46, wherein the rating scheme indicates an audience to which the media content is suitable for replay.

48. The method according to claim 46 or 47, wherein the indication of the rating scheme comprises a uniform resource identifier, URI.

49. The method according to claim 46 or 47, wherein the indication of the rating scheme comprises a country specific indicator or a region specific indicator.

50. The method according to any one of claims 44 to 49, wherein the representation of the rating information further includes an indication of a rating value; and wherein extracting the playback restriction comprises extracting the rating value.

51. The method according to claim 50, wherein the rating value represents an age restriction in accordance with the rating scheme.

52. The method according to claim 50 or 51, wherein the rating value relates to an age limit or age range specified by the rating scheme.

53. The method according to claim 50, wherein the rating value indicates an audience to which the media content is suitable for replay, in accordance with the rating scheme.

54. The method according to claim 44 or 45, wherein the representation of the rating information includes an indication of a country or region; and wherein extracting the playback restriction comprises extracting the indication of a country or region.

55. The method according to claim 54, wherein the representation of the rating information further includes an indication of a rating value; and wherein extracting the playback restriction comprises extracting the rating value.

56. The method according to claim 55, wherein the rating value represents an age restriction for the country or region.

57. The method according to claim 55 or 56, wherein the rating value relates to an age limit or age range.

58. The method according to claim 55, wherein the rating value indicates an audience to which the media content is suitable for replay in the country or region.

59. The method according to any one of claims 44 to 58, wherein the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region; wherein the rating information specific box includes multiple representations of rating information, one for each item of rating information; and wherein extracting the playback restriction comprises extracting the playback restriction from a representation of rating information that matches audience information of an audience by which playback of the media content is requested.

60. The method according to any one of claims 44 to 58, wherein the side information includes multiple items of rating information, each item of rating information relating to a replay restriction according to a respective predefined rating scheme and / or for a respective country or region; wherein the ISOBMFF file includes a respective rating information specific box for each item of rating information, with each rating information specific box including a representation of the respective item of rating information; wherein extracting the playback restriction comprises extracting the playback restriction from a rating information specific box for which the representation of rating information matches audience information of an audience by which playback of the media content is requested.

61. The method according to claim 60, wherein each rating information specific box includes a grouping identifier for indicating that the rating information specific box belongs to a group of rating information specific boxes, wherein the group includes all of the rating information specific boxes for the multiple items of rating information.

62. The method according to any one of claims 44 to 59, wherein the media content comprises a track or track group; and wherein the rating information specific box is associated with the track or track group.

63. The method according to claim 60 or 61, wherein the media content comprises a track or track group; and wherein the rating information specific boxes are associated with the track or track group.

64. The method according to any one of claims 44 to 63, wherein the rating information specific box is a dedicated rating box.

65. The method according to any one of claims 44 to 63, wherein the rating information specific box comprises a name identifier instantiating a descriptor class.

66. The method according to any one of claims 44 to 63, wherein the rating information specific box comprises a 4-character code, 4CC, identifier instantiating a descriptor class.

67. The method according to any one of claims 44 to 63, 65, or 66, wherein the rating information specific box is a descriptor box and comprises an indication of a descriptor name indicating that the descriptor box includes the representation of the rating information.

68. A method of processing an ISO Base Media File Format, ISOBMFF, file, wherein the ISOBMFF file comprises media content and a property information specific box, the property information specific box including a representation of property information that relates to a property associated with the media content, the method comprising: extracting the media content from the ISOBMFF file; extracting the property from the property information specific box of the ISOBMFF file; and outputting an indication of the property.

69. An apparatus, comprising a processor and a memory coupled to the processor and storing instructions for the processor, wherein the processor is adapted to carry out the method according to any one of claims 1 to 68.

70. A program comprising instructions that, when executed by a processor, cause the processor to carry out the method according to any one of claims 1 to 68.

71. A computer-readable storage medium storing the program of claim 70.

Images