Coded multisource media format (CMMF) instantiation for transport of media data

Abstract

An example apparatus for retrieving media data includes a memory configured to store media data; and a processing system comprising a decoder implemented in circuitry, the processing system configured to: retrieve a manifest file indicative of a plurality of network locations for at least a first section of media data and a second section of media data, each of the plurality of network locations hosted by a separate physical server device; retrieving at least a first portion of the first section from a first one of the network locations; retrieving at least a second portion of the second section from a second one of the network locations; and providing at least a first portion of the first segment and at least a second portion of the second segment to a decoder.

Description

(19) State Intellectual Property Office (12) Invention Patent Application (10) Application Publication Number (43) Application Publication Date (21) Application Number 202480048625.7 (22) Application Date 2024.08.08 (30) Priority Data 63 / 518,302 2023.08.08 US 18 / 796,817 2024.08.07 US (85) PCT International Application Entering National Phase Date 2026.01.22 (86) PCT International Application Application Data PCT / US2024 / 041531 2024.08.08 (87) PCT International Application Publication Data WO2025 / 035006 EN 2025.02.13 (71) Applicant: Qualcomm Incorporated, California, USA (72) Inventors: T. Stockhammer, I. Buazz, A. Bieber (74) Patent Agency: Beijing Liu Shen Law Firm, 11105 Patent Attorney: An Zhifei (51) Int.Cl. H04L 65 / 611 (2006.01) H04L 65 / 612 (2006.01) H04L 65 / 65 (2006.01) H04L 65 / 70 (2006.01) H04L 65 / 80 (2006.01) H04L 67 / 1097 (2006.01) H04N 21 / 84 (2006.01) H04N 21 / 845 (2006.01) H04L 67 / 02 (2006.01) (54) Invention Title: Instantiation of Decoded Multi-Source Media Format (CMMF) for Transmitting Media Data (57) Abstract: An example device for retrieving media data includes: a memory configured to store media data; and a processing system including a decoder implemented in circuitry, the processing system being configured to: retrieve a manifest file indicating a plurality of network locations for at least a first segment and a second segment of media data, each of the plurality of network locations being hosted by a separate physical server device; retrieve at least a first portion of the first segment from the first network location; retrieve at least a second portion of the second segment from the second network location; and provide at least the first portion of the first segment and at least the second portion of the second segment to the decoder. Claims: 4 pages Description: 57 pages Drawings: 30 pages CN 121605623 A 2026.03.03 CN 1 21 60 56 23 A

Claims

1. A method for retrieving media data, the method comprising: The retrieval instructions include a list of multiple network locations for at least a first segment and a second segment of the media data, each of the multiple network locations being hosted by a separate physical server device. Retrieve at least a first portion of the first segment from a first network location among the plurality of network locations; Retrieve at least a second portion of the second segment from a second network location among the plurality of network locations; as well as The at least first portion of the first segment and the at least second portion of the second segment are provided to the decoder.

2. The method of claim 1, wherein retrieving the at least first portion of the first segment comprises: The method further includes sending a first request for at least a first portion of the first segment to a first uniform resource location (URL).

3. The method of claim 2, wherein the at least first portion includes an application object comprising media data, and wherein the third portion includes a repair object for repairing the application object according to forward error correction (FEC) in the event of loss of a portion of the application object.

4. The method according to claim 2, wherein the method further comprises: Forward error correction (FEC) decoding is used to combine the at least first part and the third part.

5. The method of claim 2, wherein the manifest file includes source stream information of the media stream, the media stream includes the at least first portion of the first segment, and the manifest file further includes: The source stream identifier, the identifier of the object corresponding to the at least first part of the first segment and included in the source stream, the transport object identifier (TOI) of the object, the size of the object, the content type of the object indicating the media type of the object, the encoding information of the object, the message digest of the object, the associated Uniform Resource Identifier (URI) of the object, the Uniform Resource Locator (URL) of the object, and the availability start time indicating when the object can be retrieved.

6. The method of claim 2, wherein the manifest file includes repair flow information of the repair flow, the repair flow including the third portion of the first segment, and the manifest file further includes: The identifier of the source stream corresponding to the repair stream, the identifier of the object of the source stream corresponding to the at least first part of the first segment, the identifier of the repair object of the repair stream corresponding to the object of the source stream, the forward error correction (FEC) object transmission information of the repair object including the FEC encoded identifier, the data that associates the transport session identifier (TSI) with the transport object identifier (TOI) of the repair object, the media type of the repair object, the number of symbols included in the repair object, the Uniform Resource Locator (URL) of the repair object, and the availability start time indicating when the repair object can be retrieved.

7. The method of claim 1, wherein the manifest file includes data indicating the expiration time when the manifest file needs to be updated, the method further comprising: The inventory file is updated according to the stated expiration date.

8. The method according to claim 1, wherein the method further comprises: Transmit one or more Application Data Units (ADUs) for media data received in a media streaming session of the first segment.

9. An apparatus for retrieving media data, the apparatus comprising: A memory configured to store media data; and A processing system, comprising a decoder implemented in a circuit, is configured to: The retrieval instructions include a list of multiple network locations for at least a first segment and a second segment of the media data, each of the multiple network locations being hosted by a separate physical server device. Retrieve at least a first portion of the first segment from a first network location among the plurality of network locations; Retrieve at least a second portion of the second segment from a second network location among the plurality of network locations; as well as The decoder is provided with at least the first portion of the first segment and at least the second portion of the second segment.

10. The device of claim 9, wherein, in order to retrieve the at least first portion of the first segment, the processing system is configured to: transmit a first request for the at least first portion of the first segment to a first uniform resource location (URL), and the processing system is further configured to: transmit a second request for a third portion of the first segment to a second URL.

11. The device of claim 10, wherein the at least first portion includes an application object comprising media data, and wherein the third portion includes a repair object for repairing the application object according to forward error correction (FEC) in the event of loss of a portion of the application object.

12. The device of claim 10, wherein the manifest file includes source stream information of the media stream, the media stream including the at least first portion of the first segment, and the manifest file further includes: The source stream identifier, the identifier of the object corresponding to the at least first part of the first segment and included in the source stream, the transport object identifier (TOI) of the object, the size of the object, the content type of the object indicating the media type of the object, the encoding information of the object, the message digest of the object, the associated Uniform Resource Identifier (URI) of the object, the Uniform Resource Locator (URL) of the object, and the availability start time indicating when the object can be retrieved.

13. The device of claim 10, wherein the manifest file includes repair flow information of a repair flow, the repair flow including the third portion of the first segment, and the manifest file further includes: The identifier of the source stream corresponding to the repair stream, the identifier of the object of the source stream corresponding to the at least first part of the first segment, the identifier of the repair object of the repair stream corresponding to the object of the source stream, the forward error correction (FEC) object transmission information of the repair object including the FEC encoded identifier, the data that associates the transport session identifier (TSI) with the transport object identifier (TOI) of the repair object, the media type of the repair object, the number of symbols included in the repair object, the Uniform Resource Locator (URL) of the repair object, and the availability start time indicating when the repair object can be retrieved.

14. The apparatus of claim 9, wherein the inventory file includes data indicating an expiration time when the inventory file needs to be updated, and wherein the processing system is further configured to update the inventory file according to the expiration time.

15. The apparatus of claim 9, wherein the processing system is further configured to: transmit feedback packets for one or more application data units (ADUs) of media data for a media streaming session receiving the first segment.

16. A method for transmitting media data, the method comprising: Forward error correction (FEC) encoding is performed on at least a first portion of the first segment to form a first FEC-encoded first portion of the first segment, and forward error correction (FEC) encoding is performed on at least a second portion of the second segment to form a second FEC-encoded second portion of the second segment; The first portion encoded by FEC is stored in the first physical server device; The second part, encoded by FEC, is stored in the second physical server device; as well as A manifest file is generated, the manifest file indicating that the first FEC-encoded first portion can be obtained from the first physical server device, and the second FEC-encoded second portion can be obtained from the second physical server device.

17. The method of claim 16, further comprising: The manifest file is transmitted to the first physical server device and the second physical server device.

18. The method of claim 16, wherein performing FEC encoding on the at least first portion of the first segment comprises: The method further includes: forming an object for at least a first portion of the first segment and a repair object for a third portion of the first segment, wherein the method further includes: storing the repair object to a third physical server device.

19. The method of claim 18, wherein the manifest file includes source stream information of the media stream, the media stream including the at least first portion of the first segment, and the manifest file further includes: The source stream identifier, the identifier of the object corresponding to the at least first part of the first segment and included in the source stream, the transport object identifier (TOI) of the object, the size of the object, the content type of the object indicating the media type of the object, the encoding information of the object, the message digest of the object, the associated Uniform Resource Identifier (URI) of the object, the Uniform Resource Locator (URL) of the object, and the availability start time indicating when the object can be retrieved.

20. The method of claim 18, wherein the manifest file includes repair flow information of the repair flow, the repair flow including the third portion of the first segment, and the manifest file further includes: The identifier of the source stream corresponding to the repair stream, the identifier of the object of the source stream corresponding to the at least first part of the first segment, the identifier of the repair object of the repair stream corresponding to the object of the source stream, the forward error correction (FEC) object transmission information of the repair object including the FEC encoded identifier, the data that associates the transport session identifier (TSI) with the transport object identifier (TOI) of the repair object, the media type of the repair object, the number of symbols included in the repair object, the Uniform Resource Locator (URL) of the repair object, and the availability start time indicating when the repair object can be retrieved.

21. The method of claim 16, wherein the manifest file includes data indicating the expiration time when the manifest file needs to be updated.

22. The method of claim 16, further comprising: Receive feedback packets from the client device for one or more application data units (ADUs) of media data for a media streaming session that transmits the first segment to the client device.

23. An apparatus for transmitting media data, the apparatus comprising: A memory configured to store media data; and A processing system, implemented in a circuit and configured to: Forward error correction (FEC) encoding is performed on at least a first portion of the first segment to form a first FEC-encoded first portion of the first segment, and forward error correction (FEC) encoding is performed on at least a second portion of the second segment to form a second FEC-encoded second portion of the second segment; The first portion encoded by FEC is stored in the first physical server device; The second part, encoded by FEC, is stored in the second physical server device; as well as A manifest file is generated, the manifest file indicating that the first FEC-encoded first portion can be obtained from the first physical server device, and the second FEC-encoded second portion can be obtained from the second physical server device.

24. The apparatus of claim 23, wherein the processing system is further configured to transmit the manifest file to the first physical server device and the second physical server device.

25. The apparatus of claim 23, wherein, in order to perform FEC encoding on the at least first portion of the first segment, the processing system is configured to: form an object for the at least first portion of the first segment and a repair object for a third portion of the first segment, and wherein the processing system is further configured to: store the repair object to a third physical server device.

26. The device of claim 25, wherein the manifest file includes source stream information of the media stream, the media stream including the at least first portion of the first segment, and the manifest file further includes: The source stream identifier, the identifier of the object corresponding to the at least first part of the first segment and included in the source stream, the transport object identifier (TOI) of the object, the size of the object, the content type of the object indicating the media type of the object, the encoding information of the object, the message digest of the object, the associated Uniform Resource Identifier (URI) of the object, the Uniform Resource Locator (URL) of the object, and the availability start time indicating when the object can be retrieved.

27. The device of claim 25, wherein the manifest file includes repair flow information of a repair flow, the repair flow including the third portion of the first segment, and the manifest file further includes: The identifier of the source stream corresponding to the repair stream, the identifier of the object of the source stream corresponding to the at least first part of the first segment, the identifier of the repair object of the repair stream corresponding to the object of the source stream, the forward error correction (FEC) object transmission information of the repair object including the FEC encoded identifier, the data that associates the transport session identifier (TSI) with the transport object identifier (TOI) of the repair object, the media type of the repair object, the number of symbols included in the repair object, the Uniform Resource Locator (URL) of the repair object, and the availability start time indicating when the repair object can be retrieved.

28. The device of claim 23, wherein the inventory file includes data indicating the expiration date when the inventory file needs to be updated.

29. The method of claim 23, wherein the processing system is further configured to: receive from the client device a feedback packet of one or more application data units (ADUs) for media data of a media streaming session that transmits the first segment to the client device.

Images