Media resource sending method, receiving method and interaction method based on HTTP (Hyper Text Transport Protocol) server

Abstract

The invention relates to the technical field of multimedia contents, in particular to an HTTP (Hyper Text Transport Protocol)-based media resource receiving and transmitting method. The method comprises the steps that media description information files corresponding to all universal packaging units in media resources are generated on the HTTP server, and the media description information files comprise media consumption signaling information corresponding to all the universal packaging units; according to the received first indication information, selecting a media description information file corresponding to the universal packaging unit requested by the user from the HTTP server and transmitting the selected media description information file; and according to the received second indication information, selecting and transmitting the resource of the universal encapsulation unit requested by the user from the HTTP server. According to the invention, the HTTP service is realized based on the new-generation media transmission protocol, and the description and interaction of the media consumption information are realized by using the media description information file, so that the dynamic acquisition and adaptive transmission of the media content are realized.

Description

Technical Field

[0001] The present invention relates to the technical field of multimedia content, and in particular to a method for transmitting media resources based on HTTP. Background Art

[0002] With the rapid development of the Internet, the demand for network transmission is growing, especially the transmission volume of media content such as video and audio is increasing rapidly. However, traditional network architecture faces some bottlenecks and challenges in catering to large-scale media content transmission, such as network congestion, high latency, insufficient bandwidth and other problems. These problems directly lead to a decline in user experience, especially under high load conditions. In order to overcome these challenges, Content Delivery Network (CDN) technology came into being. The concept of CDN was first proposed in the 1990s, when the number of Internet users began to grow rapidly, but the network infrastructure was not perfect enough, so users often encountered delays and congestion when accessing websites. The main goal of CDN is to quickly transmit content from the source server to a server closer to the user by deploying distributed servers worldwide, thereby reducing the distance and time of data transmission, thereby improving access speed and response time.

[0003] In order to adapt to the CDN architecture, protocols such as Dynamic Adaptive Streaming over HTTP (DASH) and HTTP Live Streaming (HLS) have carried out a series of related work to achieve more efficient media content transmission and data interaction between clients and CDN. DASH introduces the concept of Media Presentation Description (MPD), which provides details such as the structure, segmentation information, and bitrate adaptation strategy of the media content. Through the MPD file, the client can select the appropriate bitrate and media segment according to the current network conditions and device capabilities to ensure a smooth media playback experience. This design enables the client to dynamically select appropriate content on the CDN, thereby alleviating network congestion and improving user experience. Similarly, the HLS protocol also adopts a similar mechanism and introduces the concepts of Media Playlist and Media Segment. In this way, HLS allows the client to automatically switch different bitrates according to network conditions and obtain media segments from different servers, thereby achieving high-quality media playback.

[0004] In recent years, the new generation of media transmission protocols (Smart Media Transport, SMT; MPEG Media Tranport, MMT) have made rapid progress in technological evolution and innovation, and have received widespread attention from academia and industry. Compared with traditional DASH and HLS, the new generation of media transmission protocols have unique advantages in many aspects. The new generation of media transmission protocols not only supports a variety of media types, but also introduces fine-grained functional partitioning, making the functional modules of the protocol more modular and easy to maintain, and can be configured and combined according to different scenarios. However, the new generation of media transmission protocols cannot currently support the media description access required for CDN services like DASH and HLS. Summary of the invention

[0005] In view of the problem that SMT cannot be accessed on an HTTP server at present, the present invention provides a sending method, a receiving method and an interaction method for media resources based on an HTTP server.

[0006] The technical solution adopted by the present invention to solve the technical problem is:

[0007] A method for sending media resources based on an HTTP server, the sending method comprising:

[0008] Generating a media description information file corresponding to all the general encapsulation units in the media resource on the HTTP server, wherein the media description information file includes media consumption signaling information corresponding to each general encapsulation unit;

[0009] According to the received first indication information, selecting and transmitting from the HTTP server a media description information file corresponding to the universal encapsulation unit requested by the user;

[0010] According to the received second indication information, the resource of the general encapsulation unit requested by the user is selected from the HTTP server and transmitted.

[0011] Preferably, the media description information file includes at least one of the following signaling structures:

[0012] a signaling structure for indicating a resource identifier of a media resource; and / or

[0013] A signaling structure for indicating the type of each media resource; and / or

[0014] A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or

[0015] A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or

[0016] A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

[0017] Preferably, the method for selecting the resource of the general encapsulation unit requested by the user comprises:

[0018] Based on the HTTP protocol, select the resource under the URL of the universal encapsulation unit requested by the user from the HTTP server; wherein, the URL corresponding to the universal encapsulation unit is obtained by the receiving end based on the URL template, serial number or consumption presentation time corresponding to the universal encapsulation unit in the media consumption signaling.

[0019] Preferably, the first indication information is used to indicate a user's request for a media description information file;

[0020] The second indication information is determined based on the media consumption signaling information corresponding to each universal encapsulation unit, and is used to indicate a user's request for resources of the universal encapsulation unit;

[0021] The first indication information and the second indication information can be distinguished according to the parameters they contain.

[0022] A method for receiving media resources based on an HTTP server, the method comprising:

[0023] The receiving end obtains the media description information files corresponding to all the common encapsulation units in the media resource from the HTTP server based on the first indication information;

[0024] The receiving end parses the media description information file to obtain media consumption signaling information corresponding to each general encapsulation unit;

[0025] The receiving end determines second indication information based on the media consumption signaling information to obtain resources of the general encapsulation unit from the HTTP server;

[0026] Decode and present the resources of the generic encapsulation unit.

[0027] Preferably, the media description information file includes at least one of the following signaling structures:

[0028] a signaling structure for indicating a resource identifier of a media resource; and / or

[0029] A signaling structure for indicating the type of each media resource; and / or

[0030] A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or

[0031] A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or

[0032] A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

[0033] Preferably, the method of requesting the HTTP server for resources of the universal encapsulation unit to be obtained includes:

[0034] Based on the media consumption signaling information, obtain the URL template, serial number or consumption presentation time corresponding to each universal encapsulation unit;

[0035] The URL of the universal encapsulation unit that the user wants to obtain is determined based on the URL template, the serial number or the consumption presentation time, and the resource corresponding to the universal encapsulation unit is requested from the HTTP server based on the URL.

[0036] Preferably, the first indication information is used to indicate a user's request for a media description information file;

[0037] The second indication information is determined based on the media consumption signaling information corresponding to each universal encapsulation unit, and is used to indicate a user's request for resources of the universal encapsulation unit;

[0038] The first indication information and the second indication information can be distinguished according to the parameters they contain.

[0039] A method for interacting with media resources based on an HTTP server, the method comprising:

[0040] Generate a media description information file corresponding to all common encapsulation units in the media resource on the HTTP server;

[0041] The receiving end sends first indication information to the HTTP server to request the media description information file;

[0042] The HTTP server selects and transmits the corresponding media description information file to the receiving end;

[0043] The receiving end receives and parses the media description information file to obtain media consumption signaling information corresponding to each universal encapsulation unit, and the receiving end determines and sends second indication information based on the media consumption signaling information to request the resources of the universal encapsulation unit to be obtained;

[0044] The HTTP server receives the second indication information, finds and transmits the resource of the general encapsulation unit that the user wants to obtain from the HTTP server.

[0045] The receiving end receives, decodes and presents the resources of the general encapsulation unit.

[0046] Preferably, the media description information file includes at least one of the following signaling structures:

[0047] a signaling structure for indicating a resource identifier of a media resource; and / or

[0048] A signaling structure for indicating the type of each media resource; and / or

[0049] A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or

[0050] A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or

[0051] A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

[0052] Preferably, the method for requesting the resource of the universal encapsulation unit to be obtained includes:

[0053] Based on the media consumption signaling information, obtain the URL template, serial number or consumption presentation time corresponding to each universal encapsulation unit;

[0054] The URL of the universal encapsulation unit that the user wants to obtain is generated based on the URL template, the serial number or the consumption presentation time, and the resource corresponding to the universal encapsulation unit is requested from the HTTP server based on the URL.

[0055] Beneficial effects of the present invention: The present invention implements CDN or HTTP services based on a new generation of media transmission protocols, and uses a media description information file to implement description and interaction of media consumption information. The media description information file allows data exchange between a client and an HTTP server to achieve dynamic acquisition and adaptive transmission of media content. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 Shown is a flow chart of a sending method according to an embodiment of the present invention;

[0057] Figure 2 Shown is a schematic diagram of an embodiment of a media description information file of the present invention;

[0058] Figure 3 Shown is a flow chart of a receiving method according to an embodiment of the present invention;

[0059] Figure 4 Shown is a flow chart of an interaction method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0060] The present invention will be further described below with reference to the accompanying drawings and specific embodiments, but they are not intended to limit the present invention.

[0061] In order to have a deeper understanding of the technical solution of the present invention, the relevant technical terms are first explained. A media resource (Asset) refers to any multimedia data used to establish multimedia presentation. It is a logical collection of content fragments that encapsulate coded media data and have the same media resource identifier. The content fragment is named Common Encapsulation Unit (CEU), and the coded media data contained therein can be sequential or non-sequential. Sequential data refers to coded media data with an inherent timeline, requiring data units to be decoded and presented synchronously at a specified time, such as audio and video content. In contrast, non-sequential data refers to data types that do not have an inherent timeline when decoding and presenting media content, such as text and picture information. In addition, in the same media resource, there cannot be any overlap in presentation time between CEUs containing sequential data.

[0062] In the current SMT / MMT protocol, in order to transmit media content, the PA message (a media resource information file) is used to describe the consumption signaling related to the media resources, and the SMTP / MMTP data packet containing the PA message or CEU content is transmitted in UDP mode. However, the CDN service or HTTP service does not support pulling the consumption signaling based on the SMT / MMT protocol, so that the CEU resources cannot be further obtained. Therefore, in order to solve this problem, the present invention proposes a method for sending media resources based on HTTP protocol transmission, using a PA message description file to store relevant signaling information of a general encapsulation unit / media processing unit, so that the client can parse based on the PA message description file, and thus can obtain the URL link of the CEU resource to be obtained based on the parsed information, and finally request to obtain it from the HTTP server based on the URL link.

[0063] like Figure 1 As shown, the present invention proposes a method for sending media resources based on an HTTP server, and the sending method includes:

[0064] Generate a media description information file corresponding to all the general encapsulation units in the media resource on the HTTP server, wherein the media description information file includes media consumption signaling information corresponding to each general encapsulation unit;

[0065] According to the received first indication information, selecting and transmitting from the HTTP server a media description information file corresponding to the universal encapsulation unit requested by the user;

[0066] According to the received second indication information, the resource of the general encapsulation unit requested by the user is selected from the HTTP server and transmitted.

[0067] This embodiment implements CDN or HTTP service based on the new generation media transmission protocol, and uses the media description information file to realize the description and interaction of media consumption information. The media description information file will allow data exchange between the client and the HTTP server, thereby realizing dynamic acquisition and adaptive transmission of media content.

[0068] In one embodiment of the present invention, a CDN server can be used to replace an HTTP server. Therefore, any HTTP server described herein can be implemented using a CDN server or other related servers capable of implementing the HTTP protocol, and each server will not be described one by one here.

[0069] The following is a detailed description of an embodiment of the above sending method: A method for sending media resources based on an HTTP server, the sending method comprising:

[0070] A media description information file corresponding to all the general encapsulation units in the media resource is generated on the HTTP server, wherein the media description information file includes media consumption signaling information corresponding to each general encapsulation unit.

[0071] Specifically, the media description information file, namely the PA message description file, is stored in the HTTP server in binary form, and the resources corresponding to the CEU are also stored in the HTTP server. The design of the media description information file is based on the PA message signaling defined in the SMT / MMT protocol, and is a structured description mechanism for presenting media consumption signaling information corresponding to media resources. Media consumption signaling describes signaling messages related to SMT data packet consumption. A PA message description file contains a complete PA message, and a PA message contains a PA table, an MP table, and a media presentation layer information table. Among them, the PA table contains signaling tables of all other tables, and each signaling table carries information related to the media data packet, such as the composition, storage location, type, internal media resource attributes, presentation information description, etc. of the media resources. The MP table is used to transmit other messages for processing media data packets.

[0072] PA messages use the HTTP protocol as a carrier to facilitate the effective integration of content distribution network (CDN) services or HTTP services. In theory, HTTP protocol transmission can cover all signaling carried by the PA message description file. It is worth noting that this implementation method mainly shows an implementation example based on the SMT protocol, but a similar PA message signaling structure also exists in the MMT protocol. Unless otherwise specified, the same PA message description file can be used in the MMT scenario.

[0073] In the aforementioned generation step, the server generates a PA message description file corresponding to all CEUs in the media resource, and stores the PA message description file and the CEUs of all assets in the HTTP server (such as a CDN server). Specifically, the syntax of the PA message is shown in Table 1, and the PA message contains multiple tables, such as a PA table and an MP table.

[0074] Table 1 PA message syntax

[0075]

[0076] Syntax definition:

[0077] message_id: indicates the ID of the PA message.

[0078] version: indicates the version of the PA message.

[0079] length: indicates the length of the PA message in bytes. The length is calculated from the beginning of the next field to the last byte of the PA message.

[0080] number_of_tables: indicates the number of signaling tables included in the PA message.

[0081] table_id: Indicates the table identifier contained in the PA message. This is a copy of the table_id field contained in the payload of the PA message.

[0082] table_version: indicates the version of the table contained in the PA message.

[0083] table_length: A copy of the table length field contained in the payload of the PA message.

[0084] table(): An SMTP signaling table entity. The table in the payload is in the same order as the table_id in the extension field. A PA table can be used as an instance of table().

[0085] In the sending method, according to the received first indication information, a media description information file corresponding to the universal encapsulation unit requested by the user is selected from the HTTP server and transmitted.

[0086] In one embodiment, the receiving end sends a first indication message to the HTTP server based on the HTTP protocol, requesting the media description information file to which the universal encapsulation unit to be obtained belongs, namely, the PA message description file. After receiving the indication message containing the URL, the HTTP server responds to the URL and sends the corresponding media description information file to the receiving end.

[0087] In another embodiment, the first indication information is used to indicate the user's request for the media description information file; the first indication information may be an indication message in a URL format, such as "https: / / example.com / pa.bin"; or other formats that can obtain the media description information file based on the HTTP protocol may be used, which is not limited here.

[0088] In the sending method, according to the received second indication information, the resources of the universal encapsulation unit requested by the user are selected and transmitted from the HTTP server. After the receiving end receives the corresponding PA message description file from the server based on the first indication information, the PA message of the PA message description file is parsed to obtain the PA table shown in Table 2 below. Other signaling tables, such as the MP table, can be parsed through the PA table. The MP table has information about the media data packet containing all media resources. Based on the information of the signaling table related to CEU in the parsed MP table, the receiving end determines and sends the second indication information to the server to obtain the desired CEU resources.

[0089] Table 2 Syntax of PA table

[0090]

[0091]

[0092] Syntax definition:

[0093] table_id: The identifier of the PA table.

[0094] version: The version of the PA table. As soon as it is received, the newer version will overwrite the older one.

[0095] length: Contains the length of the PA table in bytes, i.e. the length from the next field to the last byte of the MP table. The value '0' is invalid in this field.

[0096] number_of_table: The number of tables that provide information for the current PA table.

[0097] signalling_information_table_id: Identifier of the table that provides information for the current PA table.

[0098] signalling_information_table_version: The version of the table that provides information for the current PA table.

[0099] SMT_general_location_info: When SMT_general_location_info is in location, it provides information about the location of the resource; when SMT_general_location_info is in alternative_location, it provides location information of alternative resources.

[0100] alternative_location_flag: A value of '1' indicates that the receiving entity can obtain the address of an alternative resource.

[0101] location_type: indicates the location information type of the SMT data stream.

[0102] The media resource Asset is a logical collection of content fragments that encapsulate coded media data and have the same media resource identifier. The content fragments usually refer to the common encapsulation unit CEU. The resource ID syntax element group in Table 3 provides the identifier of the media resource Asset.

[0103] Table 3 Resource ID syntax

[0104]

[0105] Syntax definition:

[0106] asset_id_scheme: Provides an Asset identifier mechanism. The specific value is to be defined.

[0107] asset_id_length: Provides the byte length of the asset_id.

[0108] asset_id_byte: One byte in asset_id.

[0109] As mentioned above, the PA table in Table 2 contains the relevant signaling information of the MP table in Table 4 below. A complete MP table has information about media data packets containing all media resources. The syntax of the MP table is as follows:

[0110] Table 4 Syntax of MP table

[0111]

[0112]

[0113] Syntax definition:

[0114] table_id: The identifier of the MP table. A complete MP table and its subsets should use different table identifiers. The subset number of the MP table is implicitly represented by this field.

[0115] version: The version of the MP table. As soon as it is received, the newer version overwrites the older one.

[0116] length: Contains the length of the MP table in bytes, i.e. the length from the next field to the last byte of the MP table. The value '0' is invalid in this field.

[0117] MP_table_mode: It indicates the mode of MP table subset processing when MP table subset is used.

[0118] asset_id: The resource identifier of the media resource.

[0119] asset_type: The type of the media asset. This is described in a four-character code ("4CC") type registered in MP4REG (http: / / www.mp4ra.org).

[0120] asset_size: describes the size of the media resource.

[0121] MP_table_descriptors: Provides descriptors for MP tables.

[0122] MP_table_descriptors_length: Contains the length of the descriptor syntax loop.

[0123] MP_table_descriptors_byte: Represents a byte in the descriptor loop.

[0124] number_of_assets: Indicates the number of assets for which the MP table provides information.

[0125] packet_id: Indicates the identifier of the SMTP session in the SMTP packet header.

[0126] asset_clock_relation_id: Provides a clock relationship identifier for this media asset.

[0127] asset_timescale_flag: indicates whether to provide "asset-timescale" information. If the flag is set to '1', the asset timescale field is included. If the flag is set to '0', the asset timescale is 90000 (90kHz).

[0128] asset_timescale: Provides unit time information for all timestamps, which are used to represent the number of units of the resource within one second.

[0129] location_count: Provides the number of resource location information. Set to '1' when a resource is delivered via a single location. When distribution is done to a microprocessor device contained in an asset that is delivered via multiple channels, '1' is not set. When a resource is sent to multiple locations, the SMTP receiving entity should receive all CEUs for that resource from all indicated locations.

[0130] SMT_general_location_info: Provides information about the location of resources.

[0131] asset_descriptors_length: The number of bytes counted from the start of the next field to the end of the resource descriptors statement loop.

[0132] asset_descriptors_byte: One byte in the resource descriptor.

[0133] The MP table contains multiple media resources (Asset), each of which can be identified by the Identifier_mapping in Table 5. The Identifier_mapping syntax group element provides a mapping between a content identifier and an SMTP packet substream. Among them, the SMTP packet substream refers to a subset of the SMTP packet stream with the same packet_id. The content identifier can be provided in different formats, such as a media resource identifier, a uniform resource locator, etc.

[0134] In the SMT signaling transmission of the HTTP protocol, identifier_type==0x00 in Identifier_mapping is generally taken, indicating that the asset is identified by the asset_id structure in Table 3. Among them, asset_type can be used to indicate the type of each media resource Asset, such as audio, video and the corresponding encoding method.

[0135] The identifier mapping syntax is shown in the following table:

[0136] Table 5 Identifier mapping syntax

[0137]

[0138] Syntax definition:

[0139] identifier_type: occupies 8 bits and indicates the type of identifier used to map packet_id. See Table 6 for the allowed mapping types:

[0140] Table 6: Identifier types allowed for mapping

[0141]

[0142]

[0143] In addition, SMT_general_location_info in the MP table represents the general location information of the smart media, which is used to provide location information to the payload data of the specified data item. It indicates the type of data carried in the data stream and the transmission method, such as unidirectional broadcast network, IP network, and corresponding port number, etc. In other words, the URL template of the CEU under each Asset can be defined through SMT_general_location_info in the MP table.

[0144] In one embodiment of the present invention, in the SMT signaling transmission under the HTTP protocol, when the location_type value is defined as '0x05' in the SMT_general_location_info in the MP table, it indicates that the location type of the CEU is a uniform resource locator (URL), that is, the user can obtain the specific storage location of the CEU on the HTTP server based on the URL. The syntax of SMT_general_location_info is shown in Table 7 below:

[0145] Table 7 SMT_general_location_info syntax

[0146]

[0147]

[0148] The meanings of some fields in the syntax structure are as follows:

[0149] location_type: Location type field, indicating the location information of the SMT data stream. Some of its values ​​are shown in Table 8 below.

[0150] Table 8 location_type values

[0151]

[0152] URL_length: The length of the URL in bytes. The trailing null byte should not be counted. SMTP is an application layer protocol, similar to HTTP and other protocols, which can use uniform resource locators to pull data.

[0153] URL_byte: One byte of URL data. The trailing null byte should not be counted.

[0154] In one embodiment of the present invention, after the receiving end parses the PA message description file, it can obtain a specific URL according to the URL template in SMT_general_location_info and the ceu_sequence_number corresponding to the CEU to be requested. The user can then determine the second indication information through the URL to request the required CEU resource from the server. Specifically, each Asset contains multiple CEU resources, each CEU represents a segment of audio or video data, and the sequence number of each CEU can be identified by ceu_sequence_number.

[0155] In order to meet the needs of personalized consumption, in a media resource, media resources can be graded according to characteristics such as media content type and importance, so the MUR (media unit relationship) descriptor is proposed. The present invention can use the MUR_descriptor shown in Table 9 below to provide media resource classification information, which includes the sequence number of each CEU under each classification, represented by ceu_sequence_number. The client can request the corresponding CEU resource from the HTTP server according to the descriptor and its own needs.

[0156] Table 9 MUR descriptor syntax

[0157]

[0158]

[0159] descriptor_tag: Identifier used to mark the type of descriptor.

[0160] descriptor_length: The length of the identifier in bytes.

[0161] edit_id: A flag indicating the media resource rating.

[0162] edit_id_number: The number of CEUs included in this media resource classification.

[0163] ceu_sequence_number: the sequence number of the ceu, indicating the ceu corresponding to the edit id flag.

[0164] In one embodiment, if a user wants to consume all CEU resources under a certain media hierarchy described by MUR_descriptor, the client can obtain the URL of each CEU according to all CEU_sequence_numbers and URL templates under the hierarchy, and request CEU resources from the server in sequence through the second instruction information, that is, each time the second instruction information is sent, the corresponding CEU resource can be requested.

[0165] In another embodiment, for the CEU that the user wants to obtain, the CEU timestamp descriptor may be used to provide the presentation time of the first AU of the corresponding CEU. Specifically, the presentation time and ceu_sequence_number of the first AU of each CEU may be determined according to the CEU timestamp descriptor CEU_timestamp_descriptor shown in Table 10. For example, when the user wants to consume CEU resources with a presentation time in a certain time period, the user may obtain the URL of each CEU according to all ceu_sequence_numbers in the time period and the URL template defined in SMT_general_location_info, and determine the second indication information according to the URL to sequentially request the corresponding CEU resources from the server.

[0166] Table 10 CEU timestamp descriptor syntax

[0167]

[0168] descriptor_tag: Identifier used to mark the type of descriptor.

[0169] descriptor_length: The length of the identifier in bytes.

[0170] ceu_sequence_number: indicates the sequence number of the CEU corresponding to the descriptor.

[0171] ceu_presentation_time: indicates the presentation time of the first AU of the specified CEU, expressed in 64-bit NTP timestamp format.

[0172] In one embodiment, based on Tables 1-10 described above, a media description information file is proposed, and the media description information file includes at least one of the following signaling structures:

[0173] a signaling structure for indicating a resource identifier of a media resource; and / or

[0174] A signaling structure for indicating the type of each media resource; and / or

[0175] A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or

[0176] A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or

[0177] A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

[0178] Specifically, the PA information description file may include a signaling structure defined in the following Table 11. The specific description of each signaling structure has been listed as an example in the previous Tables 1-10, but it is not the sole limitation of the present invention.

[0179] Table 11 Main signaling structure under HTTP protocol

[0180]

[0181] In one embodiment, a method for selecting a resource of a universal encapsulation unit requested by a user includes: based on the HTTP protocol, selecting a resource under the URL of the universal encapsulation unit requested by the user from an HTTP server; wherein the URL corresponding to the universal encapsulation unit is obtained by the receiving end based on the URL template and sequence number corresponding to the universal encapsulation unit in the media consumption signaling. For example, when the URL template in the SMT_general_location_info syntax is "ceu-%08d.mp4" or "http: / / example.com / ceu-%08d.mp4", the URL corresponding to the CEU with ceu_sequence_number of 155 is "ceu-00000155.mp4" or "http: / / example.com / ceu-00000155.mp4" respectively. Afterwards, the client can determine the second indication information according to the URL to request the server to obtain the corresponding CEU resource. After receiving the second indication information, the server responds to the indication information in the URL format, searches for and sends the corresponding CEU resource to the client.

[0182] In another embodiment, a method for selecting a resource of a universal encapsulation unit requested by a user comprises: based on the HTTP protocol, selecting a resource under the URL of the universal encapsulation unit requested by the user from an HTTP server; wherein the URL corresponding to the universal encapsulation unit is obtained by the receiving end based on the URL template, sequence number or consumption presentation time corresponding to the universal encapsulation unit in the media consumption signaling. For example, the ceu_sequence_number of the required CEU can be determined according to the CEU_timestamp_descriptor. When the user wants to consume CEU resources with a presentation time in a certain time period, the URL of each CEU can be determined according to all ceu_sequence_numbers in the time period and the URL template defined in SMT_general_location_info. For the method of requesting to obtain multiple CEUs, the receiving end determines a second indication information in a URL format according to each URL, and requests the server to obtain the corresponding CEU resources respectively. After receiving each second indication information, the server responds to the URL indication information and sends the corresponding CEU resources to the client respectively. For example, after the receiving end sends the first second indication information, the server responds to the indication information and sends the corresponding CEU resource to the receiving end; then, the receiving end continues to send the next second indication information to the server to sequentially request to obtain the next CEU resource.

[0183] Figure 2 An embodiment is shown, in which the receiving end receives the PA message description file of the media resource through an HTTP request. According to the MP table stored in the PA message description file, the location information of the media resource, as well as the key information such as the sequence number ceu_sequence_number and presentation time of the CEU in the Asset can be obtained. For example, the current receiving end requests a CEU with a ceu_sequence_number of 155. According to the asset_location field, the format tag defined in IEEE 1003.1-2008 is followed, that is, the format: %0[width]d. Therefore, the URL of the CEU is "ceu-00000155.mp4" or "http: / / example.com / ceu-00000155.mp4". The receiving end can send a request message to the server according to the URL to request the corresponding CEU. After receiving the request message, the HTTP server responds and returns the corresponding CEU.

[0184] In one embodiment of the present invention, the first indication information is used to indicate a user's request for a media description information file; the second indication information is determined based on the media consumption signaling information corresponding to each universal encapsulation unit, and is used to indicate the user's request for resources of the universal encapsulation unit; wherein the first indication information and the second indication information can be distinguished based on the parameters they contain.

[0185] Specifically, for a PA message description file request, the HTTP server will directly use an HTTP response message to return the corresponding PA message description file. For a general encapsulation unit request associated with a specific URL, the HTTP server will locate the corresponding CEU based on the requested URL and use an HTTP response message to send the CEU requested by the user to the user. In an HTTP service session, the user should first request to obtain the media description information file and then request the corresponding media encapsulation processing unit. Different request types can be distinguished based on the parameters contained in the request message. For example, "https: / / example.com / pa.bin" is used to indicate the first indication information, which is used to request a PA message description file, and "https: / / example.com / ceu-00000155.mp4" is used to indicate the second indication information, which is used to request a CEU with a sequence number of 155. The first indication information contains the "pa" content, indicating that the request is for a PA message description file; the second indication information contains the "ceu" content, indicating that the request is for a CEU resource, so as to distinguish different types of request messages. It should be noted that this embodiment uses "pa" and "ceu" to distinguish different types of request messages, which is a specific embodiment and does not represent the only method for distinguishing request messages of request types. Any other method that can distinguish these two different types of request messages is included in the method of this embodiment and is not listed here one by one.

[0186] The present invention also proposes Figure 3 A method for receiving media resources based on an HTTP server is shown, the receiving method comprising:

[0187] The receiving end obtains the media description information files corresponding to all the common encapsulation units in the media resource from the HTTP server based on the first indication information;

[0188] The receiving end parses the media description information file to obtain the media consumption signaling information corresponding to each general encapsulation unit;

[0189] The receiving end determines the second indication information based on the media consumption signaling information to obtain the resources of the general encapsulation unit from the HTTP server;

[0190] Decode and present resources of common encapsulation unit.

[0191] Specifically, in the method for receiving media resources, the user first sends a first indication message to the server to obtain a PA message description file. Then the PA message description file is parsed to obtain the relevant signaling information of the general encapsulation unit / media processing unit, and finally based on the signaling information and the second indication message, the corresponding CEU resource is requested from the server, and decoded and presented. In order to implement HTTP service in a new generation of media transmission protocols, the present invention proposes a new media description information format to support the description and interaction of media consumption information. The media description information will allow data exchange between the client and the HTTP server to achieve dynamic acquisition and adaptive transmission of media content.

[0192] The present invention further proposes an embodiment, the media description information file includes at least one of the following signaling structures, each of which corresponds to the main signaling structure under the HTTP protocol defined in Table 11, and the specific interpretation of each signaling structure is shown in Tables 1 to 10:

[0193] a signaling structure for indicating a resource identifier of a media resource; and / or

[0194] A signaling structure for indicating the type of each media resource; and / or

[0195] A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or

[0196] A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or

[0197] A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

[0198] In another embodiment, a method for requesting a HTTP server for resources of a universal encapsulation unit that the user wants to obtain includes: obtaining a URL template, a serial number, or a consumption presentation time corresponding to each universal encapsulation unit based on media consumption signaling information; determining a URL of the universal encapsulation unit that the user wants to obtain based on the URL template, the serial number, or the consumption presentation time, and requesting the HTTP server for resources corresponding to the universal encapsulation unit based on the URL.

[0199] Specifically, after the receiving end parses the PA message description file, it can determine the specific URL according to the URL template in SMT_general_location_info and the ceu_sequence_number or CEU_timestamp_descriptor corresponding to the CEU to be requested. Then the user can determine the second indication information through the URL to request the required CEU resource from the server. More specifically, each Asset contains multiple CEU resources, each CEU represents a segment of audio or video data, and each CEU can be identified by ceu_sequence_number.

[0200] In another embodiment, the first indication information is used to indicate a user's request for a media description information file; the second indication information is determined based on the media consumption signaling information corresponding to each universal encapsulation unit, and is used to indicate a user's request for a resource of the universal encapsulation unit; wherein the first indication information and the second indication information can be distinguished according to the parameters they contain. The method for distinguishing the first indication information and the second indication information according to the parameters in the receiving method is the same as the corresponding content in the sending method, and is not repeated here.

[0201] like Figure 4 The present invention further proposes an interactive method for media resources based on an HTTP server, the interactive method comprising:

[0202] Generate media description information files corresponding to all common encapsulation units in the media resources on the HTTP server;

[0203] The receiving end sends first indication information to the HTTP server to request the media description information file;

[0204] The HTTP server selects and transmits the corresponding media description information file to the receiving end;

[0205] The receiving end receives and parses the media description information file to obtain the media consumption signaling information corresponding to each universal encapsulation unit, and the receiving end determines and sends the second indication information based on the media consumption signaling information to request the resource of the universal encapsulation unit to be obtained;

[0206] The HTTP server receives the second indication information, finds and transmits the resource of the general encapsulation unit that the user wants to obtain from the HTTP server.

[0207] The interactive method includes a method for processing media resources at the server end and the receiving end, and mainly uses a media description file to exchange data between the receiving end and the HTTP server to achieve dynamic acquisition and adaptive transmission of media content.

[0208] In another embodiment, in the interactive method, the media description information file includes at least one of the following signaling structures, each of which corresponds to the main signaling structure under the HTTP protocol defined in Table 11, and the specific interpretation of each signaling structure is shown in Tables 1 to 10:

[0209] a signaling structure for indicating a resource identifier of a media resource; and / or

[0210] A signaling structure for indicating the type of each media resource; and / or

[0211] A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or

[0212] A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or

[0213] A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

[0214] In another embodiment, a method for requesting resources of a universal encapsulation unit to be obtained includes: obtaining a URL template, a serial number, or a consumption presentation time corresponding to each universal encapsulation unit based on the media consumption signaling information; generating a URL of the universal encapsulation unit that the user wants to obtain based on the URL template, the serial number, or the consumption presentation time, and requesting the resources corresponding to the universal encapsulation unit from an HTTP server based on the URL. The method for obtaining resources of the universal encapsulation unit in the interactive method is the same as that in the sending method and the receiving method, and will not be described one by one here.

[0215] It should be noted that the PA table in the present invention has the same structural definition as that in the MMT protocol. In a specific implementation, the "SMT" characters containing the "SMT" field need to be replaced with "MMT" characters.

[0216] The above description is only a preferred embodiment of the present invention, and does not limit the implementation mode and protection scope of the present invention. For those skilled in the art, it should be aware that all solutions obtained by equivalent substitutions and obvious changes made using the description and illustrations of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for sending media resources based on an HTTP server, characterized in that: The sending method comprises: Generating a media description information file corresponding to all the general encapsulation units in the media resource on the HTTP server, wherein the media description information file includes media consumption signaling information corresponding to each general encapsulation unit; According to the received first indication information, selecting and transmitting from the HTTP server a media description information file corresponding to the universal encapsulation unit requested by the user; According to the received second indication information, the resource of the general encapsulation unit requested by the user is selected from the HTTP server and transmitted.

2. The method for sending media resources based on an HTTP server according to claim 1, characterized in that: The media description information file includes at least one of the following signaling structures: a signaling structure for indicating a resource identifier of a media resource; and / or A signaling structure for indicating the type of each media resource; and / or A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

3. The method for sending media resources based on an HTTP server according to claim 1 or 2, characterized in that: The method for selecting the resource of the general encapsulation unit requested by the user includes: Based on the HTTP protocol, select the resource under the URL of the universal encapsulation unit requested by the user from the HTTP server; wherein, the URL corresponding to the universal encapsulation unit is obtained by the receiving end based on the URL template, serial number or consumption presentation time corresponding to the universal encapsulation unit in the media consumption signaling.

4. The method for sending media resources based on an HTTP server according to claim 1 or 2, characterized in that: The first indication information is used to indicate a user's request for a media description information file; The second indication information is determined based on the media consumption signaling information corresponding to each universal encapsulation unit, and is used to indicate a user's request for resources of the universal encapsulation unit; The first indication information and the second indication information can be distinguished according to the parameters they contain.

5. A method for receiving media resources based on an HTTP server, characterized in that: The receiving method comprises: The receiving end obtains the media description information files corresponding to all the common encapsulation units in the media resource from the HTTP server based on the first indication information; The receiving end parses the media description information file to obtain media consumption signaling information corresponding to each general encapsulation unit; The receiving end determines second indication information based on the media consumption signaling information to obtain resources of the general encapsulation unit from the HTTP server; Decode and present the resources of the generic encapsulation unit.

6. The method for receiving media resources based on an HTTP server according to claim 5, characterized in that: The media description information file includes at least one of the following signaling structures: a signaling structure for indicating a resource identifier of a media resource; and / or A signaling structure for indicating the type of each media resource; and / or A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

7. The method for receiving media resources based on an HTTP server according to claim 5 or 6, characterized in that: The method of requesting the HTTP server for resources of the universal encapsulation unit to be obtained includes: Based on the media consumption signaling information, obtain the URL template, serial number or consumption presentation time corresponding to each universal encapsulation unit; The URL of the universal encapsulation unit that the user wants to obtain is determined based on the URL template, the serial number or the consumption presentation time, and the resource corresponding to the universal encapsulation unit is requested from the HTTP server based on the URL.

8. The method for receiving media resources based on an HTTP server according to claim 5 or 6, characterized in that: The first indication information is used to indicate a user's request for a media description information file; The second indication information is determined based on the media consumption signaling information corresponding to each universal encapsulation unit, and is used to indicate a user's request for resources of the universal encapsulation unit; The first indication information and the second indication information can be distinguished according to the parameters they contain.

9. A method for interacting with media resources based on an HTTP server, characterized in that: The interaction method comprises: Generate a media description information file corresponding to all common encapsulation units in the media resource on the HTTP server; The receiving end sends first indication information to the HTTP server to request the media description information file; The HTTP server selects and transmits the corresponding media description information file to the receiving end; The receiving end receives and parses the media description information file to obtain media consumption signaling information corresponding to each universal encapsulation unit, and the receiving end determines and sends second indication information based on the media consumption signaling information to request the resources of the universal encapsulation unit to be obtained; The HTTP server receives the second indication information, finds and transmits the resource of the general encapsulation unit that the user wants to obtain from the HTTP server; The receiving end receives, decodes and presents the resources of the general encapsulation unit.

10. The method for interacting with media resources based on an HTTP server according to claim 9, characterized in that: The media description information file includes at least one of the following signaling structures: a signaling structure for indicating a resource identifier of a media resource; and / or A signaling structure for indicating the type of each media resource; and / or A signaling structure for indicating a URL template that specifies a common encapsulation unit in each media resource; and / or A signaling structure for providing information about the hierarchy of media resources and the serial number of each common encapsulation unit at each hierarchy; and / or A signaling structure used to provide the sequence number of each common encapsulation unit and the presentation time of the first access unit corresponding to the common encapsulation unit.

11. The method for interacting with media resources based on an HTTP server according to claim 9 or 10, characterized in that: The method of requesting the resources of the desired general encapsulation unit includes: Based on the media consumption signaling information, obtain the URL template, serial number or consumption presentation time corresponding to each universal encapsulation unit; The URL of the universal encapsulation unit that the user wants to obtain is generated based on the URL template, the serial number or the consumption presentation time, and the resource corresponding to the universal encapsulation unit is requested from the HTTP server based on the URL.

Images