Sending device, receiving device and their programs, and transmission system

By converting CMAF file groups into broadcast signals with MMTP packets and back into CMAF files, the challenge of viewing 4K/8K satellite broadcasting on devices without demodulators is addressed, enabling compliant content playback on Android and iOS platforms.

JP7734008B2Active Publication Date: 2025-09-04NIPPON HOSO KYOKAI
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021114082
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-07-09
Publication Date
2025-09-04
Estimated Expiration
2041-07-09

AI Technical Summary

Technical Problem

Devices using platforms like Android and iOS lack demodulators capable of processing broadcast signals conforming to ARIB STD-B60 and TR39, making it difficult to view content transmitted by new 4K/8K satellite broadcasting systems that use MMT as the media transport method.

Method used

A transmission device converts CMAF file groups into broadcast signals by generating MMTP packets with identification information, and a receiving device extracts and converts these packets back into CMAF files, enabling content playback on devices without demodulators.

Benefits of technology

Content transmitted by broadcast signals can be viewed compliantly with CMAF standards, allowing devices without demodulators to access and play back 4K/8K satellite broadcasting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007734008000001
    Figure 0007734008000001
  • Figure 0007734008000002
    Figure 0007734008000002
  • Figure 0007734008000003
    Figure 0007734008000003
Patent Text Reader

Abstract

To view a content transmitted with a broadcasting signal, by a method in accordance with CMAF.SOLUTION: A transmitting device 2 comprises: a timed data generation unit 23 which extracts identification information out of the file name of a fragment file 110 and generates a TD / MMTP packet 210 being an MMTP packet including timed data and identification information of the fragment file 110; and a multiplexing unit 26 which multiplexes the TD / MMTP packet 210 and generates a broadcasting signal 200.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a transmitting device, a receiving device and a program therefor, and a transmission system. [Background technology]

[0002] In December 2018, new 4K / 8K satellite broadcasting conforming to ARIB technical specifications STD-B60 and TR-B39 (see Non-Patent Documents 1 and 2) was launched as a digital broadcasting service in Japan. The new 4K8K satellite broadcasting uses MMT (MPEG Media Transport) as the international standard for a new media transport method based on IP (Internet Protocol). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] "Media Transport Method Using MMT in Digital Broadcasting", ARIB STD-B60 [Non-patent document 2] "Advanced Wideband Satellite Digital Broadcasting Operational Standards (Volume 3)", ARIB-TR-B39 [Non-patent document 3] “Common media application format for segmented media”, ISO-IEC 23000-19 Summary of the Invention [Problem to be solved by the invention]

[0004] In a digital broadcasting system, a transmitter sends out a broadcasting signal that conforms to a specific transmission standard, and a dedicated receiver equipped with a demodulator (tuner) demodulates the received broadcasting signal to make the content viewable. For example, the new 4K8K satellite broadcasting system sends out broadcasting signals that conform to ARIB STD-B60 and TR39.

[0005] Meanwhile, devices using platforms such as Android (registered trademark) and iOS have become widespread as a means of viewing content. CMAF (Common Media Application Format, see Non-Patent Document 3), a standard for streaming distribution, is used to distribute content to these devices. Furthermore, many of these devices do not have a demodulator capable of demodulating broadcast signals.

[0006] The present invention has been devised in view of the above-mentioned circumstances, and aims to provide a sending device, a receiving device and a program therefor, and a transmission system that can make content transmitted by a broadcast signal in a transmission system viewable in a manner that complies with CMAF. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems, one aspect of the present invention is a transmission device that converts a group of files holding data for streaming distribution into a broadcast signal and transmits it, wherein the group of files holds timed data divided from an asset and includes a plurality of fragment files each having a file name containing identification information for the timed data, and is configured to include a timed data generation unit that extracts the identification information from the file names of the fragment files and generates an MMTP packet containing the timed data of the fragment files and the identification information, and a multiplexing unit that multiplexes the MMTP packets to generate the broadcast signal.

[0008] In addition, in order to solve the above-mentioned problem, as one aspect of an embodiment, the present invention provides a receiving device that receives a broadcast signal generated from a group of files holding data for streaming distribution and converts it into said group of files, wherein said group of files holds timed data divided from an asset and includes a plurality of fragment files to which file names containing identification information for the timed data are assigned, and wherein said broadcast signal includes MMTP packets containing the timed data extracted from the fragment files and the identification information extracted from the file names of the fragment files, and wherein said device is configured to include a timed data conversion unit that extracts the timed data and the identification information from the MMTP packets, assigns file names containing the identification information to the timed data, and converts it into said fragment files.

[0009] As one aspect of the embodiment, the present invention can also be realized by a program for causing a computer to function as the above-described receiving device. The present invention can also be realized in a transmission system including the above-described sending device and receiving device. [Effects of the Invention]

[0010] According to the present invention, content transmitted by a broadcast signal can be viewed in a manner that complies with CMAF. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic configuration diagram of a broadcasting system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of the transmission device of FIG. [Figure 3] FIG. 2 is a block diagram showing the configuration of the receiving device of FIG. [Figure 4] FIG. 2 is a diagram illustrating the structure of a group of CMAF files used in FIG. 1. [Figure 5] FIG. 2 is a diagram showing the structure of a broadcast signal used in FIG. 1. [Figure 6]FIG. 2 is a diagram showing the structure of the MMT-SI used in FIG. 1. [Figure 7] FIG. 2 is a diagram illustrating the general structure of an MMTP packet used in FIG. 1. [Figure 8] FIG. 2 is a diagram illustrating an example of a TD / MMTP packet used in FIG. 1. [Figure 9] 2 is a diagram illustrating an example of an NTD / MMTP packet used in FIG. 1. FIG. [Figure 10] FIG. 2 is a diagram illustrating an example of MMT-SI used in FIG. 1. [Figure 11] 2 is a diagram showing the structure of a PA message that stores an MP table used in FIG. 1. FIG. [Figure 12] 1. FIG. 4 is a diagram showing the structure of a data transmission message that stores a data directory management table used in FIG. [Figure 13] FIG. 2 is a diagram showing the relationship between the tables included in the MMT-SI used in FIG. 1 and the MPU. [Figure 14] 10 is a flowchart illustrating an operation of the transmission device according to the embodiment. [Figure 15] 4 is a flowchart illustrating an operation of the receiving device according to the embodiment. [Figure 16] FIG. 2 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the receiving device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are intended to embody the technical concept of the present invention, and unless otherwise specified, the present invention is not limited to the following. Furthermore, in each embodiment, the same means are given the same reference numerals, and their description may be omitted.

[0013] [Broadcasting system overview] 1, a broadcasting system 1, which is an example of a transmission system, includes a transmission device 2 and a reception device 3. The broadcasting system 1 performs digital broadcasting, and transmits a broadcasting signal 200 conforming to ARIB STD-B60 and TR39 between the transmission device 2 and the reception device 3.

[0014] The transmission device 2 converts a group of files holding data for streaming distribution into a broadcast signal 200 and transmits it. A group of files (hereinafter referred to as "CMAF file group 100") conforming to CMAF, a standard for streaming distribution of content, is input to the transmission device 2 as a group of files holding data for streaming distribution. The CMAF file group 100 is made up of a plurality of files containing data that constitute the content. The transmission device 2 multiplexes the data contained in the CMAF file group 100 onto a broadcast signal 200 and transmits it to the receiving device 3 via the broadcast network 5. The transmission device 2 multiplexes the broadcast signal 200 in such a manner that the receiving device 3 can convert the broadcast signal 200 into the CMAF file group 100.

[0015] The transmission device 2 multiplexes the CMAF file group 100 using a known multiplexing method, but in this embodiment, the multiplexing method is MMT. In other words, the transmission device 2 generates MMTP packets from the data included in the CMAF file group 100 and multiplexes them to generate the broadcast signal 200. The transmission device 2 can be configured, for example, from a computer installed in the broadcast station.

[0016] The receiving device 3 receives a broadcast signal 200 generated from a group of files holding data for streaming distribution, and converts the signal into a group of files holding data for streaming distribution. The receiving device 3 receives a broadcast signal 200 from the transmitting device 2 via a broadcast network 5. The receiving device 3 converts the broadcast signal 200 into a CMAF file group 100 and deploys it on a distribution server. As an example, the receiving device 3 can be a computer built into a television receiving device installed in a home or the like. 1, the distribution server 36 of the receiving device 3 can be accessed by the presentation device 4 via the network 6. A URL is assigned to all data included in the CMAF file group 100. When the presentation device 4 accesses the URL, the file is distributed from the distribution server to the presentation device 4.

[0017] The presentation device 4 may be a terminal that employs a platform such as Android (registered trademark) or iOS and is capable of viewing content files to which CMAF is applied, such as a smartphone or tablet terminal. The presentation device 4 sends a request to the distribution server of the receiving device 3 and downloads the CMAF file group 100. Although only one receiving device 3 and one presentation device 4 are shown in FIG. 1, a plurality of receiving devices 3 and a plurality of presentation devices 4 can be provided.

[0018] The configurations of the transmitting device 2 and the receiving device 3 will be described below. [Delivery device] As shown in FIG. 2, the transmission device 2 includes an input unit 21, an extraction unit 22, a timed data generation unit 23, a non-timed data generation unit 24, a control message generation unit 25, a multiplexing unit 26, and a transmission unit 27. Although not shown in the figure, the transmission device 2 can be configured from a computer equipped with a CPU (Central Processing Unit), memory, input / output I / F (Interface), communication I / F, etc. The CPU executes a program stored in the memory, thereby realizing the functional configuration shown in Fig. 2.

[0019] (CMAF files) A group of CMAF files 100 constituting content is input to the input unit 21 of the transmission device 2. The group of CMAF files 100 may be input to the transmission device 2 from another device (not shown) via a communication network or the like, or may be created by a computer constituting the transmission device 2. As shown in FIG. 4, the CMAF file group 100 includes a fragment file 110, a manifest file 130, and an initialization file 150.

[0020] A fragment file 110 holds timed data separated from an asset and is given a file name that includes identification information for the timed data. An asset refers to a series of data, such as video and audio, that make up content. Timed data is data that has been separated (chunked) into units of several frames from an asset, and refers to data with a specified presentation time. CMAF aims to reduce latency in streaming distribution by transmitting chunked fragment files 110 using Chunked Transfer, an extension of HTTP.

[0021] A file name is assigned to each fragment file 110 that makes up the CMAF file group 100. The file name contains information (identification information) that can identify the fragment file 110. The file name contains, for example, an asset ID and a sequence number as identification information. The asset ID is an identifier for the asset to which the fragment file 110 belongs, and the sequence number is a number that indicates the order of the fragment file 110 in the asset.

[0022] The manifest file 130 holds non-timed data, including rules for naming the fragment files 110. Non-timed data means data for which a presentation time is not specified. The manifest file 130 holds non-timed data, such as configuration information for the fragment files 110. The presentation device 4 (see FIG. 1) can play back content by continuously downloading the fragment files 110 in accordance with the manifest file 130. As shown in FIG. 4, the manifest file 130 holds, as one piece of configuration information for the fragment files 110, filename rules 131 that define the rules for filenames given to the fragment files 110.

[0023] The initialization file 150 holds metadata required to initialize the encoding process of the fragment file 110. The fragment file 110 and the initialization file 150 are also each given a file name.

[0024] (broadcast signal) The transmitting device 2 converts the CMAF file group 100 shown in FIG. As shown in Fig. 5, the broadcast signal 200 is generated by multiplexing a sequence of MMTP packets. When the broadcast signal 200 is sent to the broadcast network 5, the sequence of MMTP packets is placed in the payload of an IP packet to be converted into an IP packet, and the IP packet is then placed in the payload of a TLV packet to be converted into a TLV packet; however, illustration and detailed explanation are omitted here.

[0025] 5, the broadcast signal 200 includes MMTP packets (hereinafter also referred to as "TD / MMTP packets 210") containing timed data such as video and audio, and MMTP packets (hereinafter also referred to as "NTD / MMTP packets 230") containing non-timed data such as applications. Furthermore, the MMTP packet sequence includes MMTP packets (hereinafter referred to as "MMT-SI 250") consisting of control information (signaling).

[0026] As shown in Figure 2, the transmission device 2 generates an MMTP packet sequence of the broadcast signal 200 shown in Figure 5 from a CMAF file group 100 (see Figure 4) through processing by an extraction unit 22, a timed data generation unit 23, a non-timed data generation unit 24, a control message generation unit 25, and a multiplexing unit 26. Extraction unit 22 extracts the file naming rules for fragment files 110 from manifest file 130. Extraction unit 22 extracts file naming rules 131 for fragment files 110 from manifest file 130 (see FIG. 4) of CMAF file group 100 input to input unit 21.

[0027] (File name rules) The manifest file 130 may be in XML format and conforms to the MPEG-DASH (Dynamic Adaptive Streaming over HTTP) specifications. In this case, for example, the filename rule 131 for the fragment files 110 is written as follows: {asset_id}{number}.{ext} Here, {asset_id} is the asset ID, {number} is the sequence number, and {ext} is the extension that indicates the file type. In other words, filename rule 131 specifies that the file name should be expressed in the order of asset ID, sequence number, and extension. As mentioned above, fragment file 110 is a file that holds timed data obtained by dividing an asset. There may be multiple assets for each video and audio, in which case {asset_id} is unique for each asset.

[0028] For example, the same asset ID is assigned to fragment files 110 divided from one asset that makes up video data. Fragment files 110 that belong to the same asset are then assigned consecutive sequence numbers according to the playback order. In other words, the combination of the asset ID and sequence number makes it possible to identify the asset to which timed data held in a fragment file 110 belongs and the order within the asset.

[0029] An example of file name rules 131 written in XML format in manifest file 130 is shown below. <segmenttemplate media="”asset1_$Number$.m4s”"> ···· ···· < / segmenttemplate> Here, the filename rule 131 is written as the media attribute of the SegmentTemplate property. "asset1_" corresponds to the asset ID ({asset_id}), "$Number$" corresponds to the sequence number ({number}), and ".m4s" corresponds to the extension ({ext}).

[0030] The timed data generation unit 23 extracts identification information from the file name of the fragment file 110 and generates an MMTP packet including the timed data and identification information of the fragment file 110. The timed data generation unit uses file name rules 131 to extract identification information (asset ID and sequence number) from the file name of the fragment file. As shown in Figure 7, an MMTP packet consists of an MMTP payload PL, which is the data body, and an MMTP header HD, which indicates information about the MMTP payload PL. 8, the timed data generator 23 generates a TD / MMTP packet 210 from the fragment file 110. The MMTP payload PL of the TD / MMTP packet 210 includes an MPU (Media Processing Unit) 211. The MPU 211 is made up of MPU metadata 212, movie fragment metadata 213, and an MFU (Media Fragment Unit) 214.

[0031] The timed data generator 23 extracts the timed data held in each fragment file 110 and stores it as an MFU 214. As will be described below, the timed data generator 23 adds MPU metadata 212 and movie fragment metadata 213 to the MFU 214 to generate an MPU 211.

[0032] The timed data generating unit 23 refers to the file naming rule 131 extracted by the extracting unit 22 and acquires the asset ID and sequence number (see FIG. 4) from the file name of the fragment file 110. 8, the timed data generation unit 23 adds the extracted asset ID to the MPU metadata 212. The timed data generation unit 23 adds a sequence number as a movie fragment sequence number (movie_fragment_sequence_number) to the movie fragment metadata 213. Here, the movie fragment sequence number is a number that indicates the order within the asset of the MFU 214.

[0033] The timed data generator 23 further adds an MPU sequence number (mpu_sequence_number) to the MPU metadata 212. The MPU sequence number is a number that indicates the order of the MPUs 211 within the same asset. The timed data generator 23 writes timed_flag=1 in the MMTP payload PL, which means that the data included in the MMTP payload PL is timed data. The timed data generator 23 sequentially generates TD / MMTP packets 210 from a plurality of fragment files 110 belonging to each asset.

[0034] The non-timed data generator 24 generates an MMTP packet including the non-timed data held in the manifest file 130 . Specifically, the non-timed data generator 24 (see FIG. 2) generates an NTD / MMTP packet 230 (see FIG. 5) from the manifest file 130 and the initialization file 150 of the CMAF file group 100. Like the TD / MMTP packet 210, the NTD / MMTP packet 230 is composed of an MMTP payload PL, which is the data body, and an MMTP header HD that indicates information about the MMTP payload PL (see FIG. 7). 9, the MMTP payload PL of the NTD / MMTP packet 230 includes an MPU 231. The MPU 231 is composed of MPU metadata 232 and an MFU 234. The non-timed data generation unit 24 acquires data held in the manifest file 130, stores it as an MFU 234, and adds MPU metadata 232 to generate an MPU 231. Similarly, the non-timed data generation unit 24 acquires data held in the initialization file 150, stores it as an MFU 234, and adds MPU metadata 232 to generate an MPU 231.

[0035] The non-timed data generating unit 24 adds an item ID (item_id) for individually identifying the MPU 231 to the MPU metadata. The non-timed data generator 24 writes timed_flag=0 in the MMTP payload PL, which means that the data included in the MMTP payload PL is non-timed data.

[0036] Control message generator 25 generates a control message that includes at least a portion of the identification information included in the file name of fragment file 110. Specifically, control message generator 25 generates MMT-SI 250 (see FIG. 6), which is a control message, based on TD / MMTP packet 210 and NTD / MMTP packet 230 generated by timed data generator 23 and non-timed data generator 24. MMT-SI 250 can be generated in accordance with ARIB STD-B60 and TR39, and therefore detailed description thereof will be omitted below as appropriate.

[0037] As mentioned above, MMT-SI 250 is an MMTP packet made up of control information (signaling). MMT-SI 250 is made up of an MMTP payload PL, which is the data body, and an MMTP header HD, which indicates information about the MMTP payload PL (see Figure 6). As shown in Figure 10, MMT-SI250 consists of three layers: messages MA, tables TA, and descriptors DS. Messages MA store tables TA and descriptors DS. Tables TA contain elements and attributes of timed data and non-timed data, while descriptors DS describe more detailed information. As shown in FIG. 6, MMT-SI 250 includes a PA message 251, a Data Transmission message 255, and the like as messages MA. The PA message 251 stores, for example, an MP table 252 as a table TA. A table related to data transmission is stored as a table TA in the data transmission message 255. The data transmission message 255 stores, for example, a data directory management table 256, a data asset management table 257, and the like.

[0038] As shown in FIG. 11, a PA message 251 that stores an MP table 252 is stored in the MMTP payload PL of an MMTP packet. The MP table 252 indicates what components (assets) the content is made up of. The MP table 252 includes information such as a list of assets that make up the content (asset list), the location of the assets on the network (asset location), etc.

[0039] The control message generator 25 writes the asset ID in the MP table 252. The control message generator 25 further writes the MPU sequence number of the MPU 211 belonging to the asset in the MPU timestamp descriptor of the MP table 252. The MPU timestamp descriptor is a descriptor DS (see FIG. 10), and is information indicating the presentation time of the MPU 211. By writing the asset ID that identifies the asset and the MPU sequence number that indicates the MPU 211 that belongs to the asset in the MP table 252, the receiving device 3 can read what assets and MPUs 211 the content is made up of.

[0040] As shown in FIG. 12, a data transfer message 255 storing a data directory management table 256 is stored in the MMTP payload of an MMTP packet. The data directory management table 256 is a table that describes the directory structure of the files that make up the application. Control message generator 25 writes the file names (file_name) of manifest file 130 and initialization file 150 that have been packetized into NTD / MMTP packets 230 by non-timed data generator 24 into data directory management table 256 .

[0041] 13, the data asset management table 257 is a table that lists the configuration of the MPUs 211 in the asset and information about each MPU 211. Although not shown in the figure, the data asset management table 257, like the data directory management table 256, is also stored in the data transmission message 255 of the MMTP payload. As shown in FIG. 13, the data asset management table 257 contains information for linking other tables (data directory management table 256, MP table 252) with the MPU 231 of the TD / MMTP packet 210 and NTD / MMTP packet 230.

[0042] For example, an item ID is written in the data asset management table 257. As described above, the item ID is an identifier of the MPU 231 of the NTD / MMTP packet 230, and is also written in the MPU metadata 232 of the NTD / MMTP packet 230. The data asset management table 257 also includes a node tag (Node_tag) as information for linking with the data directory management table 256. The node tag indicates a label that identifies a directory or file as the node tag of the directory or file.

[0043] The data asset management table 257 also includes a component tag (component_tag) as information for linking with the MP table 252. The component tag indicates a label for identifying a component (asset).

[0044] The multiplexing unit 26 multiplexes the MMTP packets generated by the timed data generating unit to generate a broadcast signal 200. The multiplexing unit 26 further multiplexes the control messages generated by the control message generating unit 25 to generate a broadcast signal 200. The multiplexing unit 26 further multiplexes the MMTP packets generated by the non-timed data generating unit 24 to generate a broadcast signal 200. The multiplexing unit 26 multiplexes the TD / MMTP packet 210, the NTD / MMTP packet 230, and the MMT-SI 250 to generate an MMTP packet sequence (see FIG. 5). The multiplexing unit 26 loads the MMTP packet sequence onto the payload of an IP packet to generate an IP packet.

[0045] The sending unit 27 loads the IP packet onto the payload of a TLV packet to convert it into a TLV packet, and sends it to the broadcast network 5 as a broadcast signal 200 as shown in FIG.

[0046] [Receiver] As shown in FIG. 3, the receiving device 3 includes a receiving unit 31, a packet filter 32, a non-timed data conversion unit 33, an extraction unit , a timed data conversion unit 35, and a distribution server . The receiving unit 31 receives the broadcast signal 200 transmitted from the transmission device 2 via the broadcast network 5 .

[0047] The packet filter 32 separates the MMTP packet sequence carried on the broadcast signal 200 and extracts the TD / MMTP packet 210, the NTD / MMTP packet 230, and the MMT-SI 250.

[0048] The non-timed data conversion unit 33 converts the MMTP packets containing non-timed data into a manifest file 130 . Specifically, the non-timed data conversion unit 33 converts the NTD / MMTP packets 230 extracted by the packet filter 32 into the manifest file 130 and the initialization file 150 that make up the CMAF file group 100 . The non-timed data conversion unit 33 extracts the data stored as the MFU 234 in the MMTP payload PL of the NTD / MMTP packet 230 and files it. The non-timed data conversion unit 33 obtains a file name (file_name) corresponding to the filed data from the data directory management table 256 (see FIG. 12), and assigns this as the file name to the created file. As shown in FIG. 13, the data directory management table 256, which lists file names, and the data asset management table 257, which lists item IDs (item_id) that identify the MPU 231 of the NTD / MMTP packet 230, are linked by a node tag (Node_tag). The non-timed data conversion unit 33 can assign file names by referencing the node tag and item ID. As described above, in the transmission device 2, the file names of the manifest file 130 and the initialization file 150 are assigned as file names (file_name) of the NTD / MMTP packets 230. Therefore, the manifest file 130 and the initialization file 150 input to the transmission device 2 can be restored from the NTD / MMTP packets 230 by processing in the non-timed data conversion unit 33.

[0049] As described above, the manifest file 130 holds filename rules 131 that define the filenames to be given to the fragment files 110 (see FIG. 4). The extraction unit 34 (filename rule extraction unit) extracts the filename rule 131 from the manifest file 130. As shown in FIG. 3, the extracting unit 34 extracts the file naming rule 131 from the manifest file 130 converted by the non-timed data converting unit 33.

[0050] The timed data conversion unit 35 extracts the timed data and identification information from an MMTP packet containing the timed data extracted from the fragment file 110 and the identification information extracted from the file name of the fragment file 110, and converts the timed data into a fragment file 110 by assigning a file name containing the identification information to the timed data. The timed data conversion unit 35 converts the TD / MMTP packets 210 extracted by the packet filter 32 into fragment files 110 that make up the CMAF file group 100. The timed data conversion unit 35 references the asset ID and MPU sequence number in the MP table 252, and sequentially processes the MPUs 211 that belong to each asset that makes up the content.

[0051] The timed data conversion unit 35 extracts the timed data stored as the MFU 214 (see FIG. 8) in the MMTP payload of the TD / MMTP packet 210 and converts it into a file. As described above, the fragment files 110 that make up the CMAF file group 100 are given file names that include an asset ID and a sequence number (see FIG. 4). The timed data conversion unit 35 references the file naming rules 131 extracted by the extraction unit 34, acquires the asset ID from the MPU metadata 212, and acquires the sequence number from the movie fragment metadata 213. The timed data conversion unit 35 assigns file names that include the asset ID and sequence number to the created files in accordance with the file naming rules 131.

[0052] The timed data conversion unit 35 sequentially processes the MPU 211 included in the TD / MMTP packet 210, thereby restoring the fragment files 110 that make up the CMAF file group 100. Non-timed data conversion unit 33 and timed data conversion unit 35 store the created manifest file 130, initialization file 150, and fragment file 110 in distribution server 36. Distribution server 36 distributes these files to presentation device 4 (see FIG. 1) in response to a request from presentation device 4.

[0053] [Operation of the transmission device] The transmission device 2 can start processing when the CMAF file group 100 is input to the input unit 21. Note that input of all files that make up the CMAF file group 100 does not have to be complete; for example, processing may start when the manifest file 130 and the initialization file 150 are input. As shown in FIG. 14, the extraction unit 22 extracts the file naming rules 131 for the fragment files 110 from the manifest file 130 of the input CMAF file group 100 (step S01).

[0054] The timed data generation unit 23 generates a TD / MMTP from the fragment file 110 (step S02). At that time, the timed data generation unit 23 refers to the filename rule 131, extracts the asset ID and sequence number from the filename of the fragment file 110, adds the asset ID to the MPU metadata 212, and adds the sequence number to the movie fragment metadata 213 as a movie fragment sequence number.

[0055] The non-timed data generator 24 generates the NTD / MMTP from the manifest file 130 and the initialization file 150 (step S03). The control message generator 25 generates the MMT-SI 250 (step S04). At this time, the control message generator 25 adds an asset ID to the MP table 252, and adds the file names of the manifest file 130 and the initialization file 150 to the data directory management table 256. The multiplexing unit 26 multiplexes the TD / MMTP, NTD / MMTP, and MMT-ST to generate the broadcast signal 200 (step S05). The sending unit 27 sends the broadcast signal 200 to the receiving device 3 via the broadcast network 5 (step S06).

[0056] [Operation of receiving device] As shown in FIG. 15, when the receiving device 3 receives the broadcast signal 200, the packet filter 32 separates the broadcast signal 200 (step S11). The non-timed data converter 33 converts the NTD / MMTP packet 230 into the manifest file 130 and the initialization file 150 (step S12). The extraction unit 34 extracts the filename rule 131 of the fragment file 110 from the manifest file 130 (step S13).

[0057] The timed data conversion unit 35 converts the TD / MMTP packet 210 into a fragment file 110 (step S14). At that time, the timed data conversion unit 35 refers to the filename rule 131, extracts the asset ID from the MPU metadata 212, and extracts the movie fragment sequence number from the movie fragment metadata 213. The timed data conversion unit 35 assigns a filename including the asset ID and sequence number to the fragment file 110 in accordance with the filename rule 131. The non-timed data converter 33 and the timed data converter 35 store the created CMAF file group 100 in the distribution server 36 (step S15).

[0058] [Hardware configuration] The computer 900 includes a CPU 901 , a memory 902 , an input / output I / F 903 , a communication I / F 904 , and a media I / F 905 .

[0059] The CPU 901 of the computer 900 executes a program loaded onto the memory 902 to realize the functions of the receiving device 3. Alternatively, the CPU 901 may load a program related to the target processing from another device via a network. The CPU 901 receives input from an input device 910 via an input / output I / F 903. The input device 910 may be, for example, a mouse or a keyboard, or, in the case where the receiving device 3 is a television receiving device, may be a remote controller. The CPU 901 controls output devices such as a display and a distribution server 36 via the input / output I / F 903.

[0060] The communication I / F 904 receives data from other devices such as the transmission device 2 (see FIG. 1) via the broadcast network 5 and outputs the data to the CPU 901. The media I / F 905 reads a program or data stored in the recording medium 912 and outputs it to the CPU 901 via the memory 902. The CPU 901 loads a program related to a target process from the recording medium 912 onto the memory 902 via the media I / F 905, and executes the loaded program. The recording medium 912 can be an optical recording medium such as a CD-ROM or a DVD, a magnetic recording medium, a magneto-optical recording medium, a semiconductor memory, or the like.

[0061] [Actions and Effects] As described above, the transmission device 2 and the reception device 3 in the broadcasting system 1 according to the embodiment have the following configuration. (1) The transmitting device 2 converts a CMAF file group 100, which is a group of files that hold data for streaming distribution, into a broadcast signal 200 and transmits it. The CMAF file group 100 holds timed data divided from an asset, and includes a plurality of fragment files 110 given file names that include identification information for the timed data. The sending device 2 is a timed data generation unit (23) that extracts identification information from the file name of the fragment file (110) and generates a TD / MMTP packet (210) that is an MMTP packet including the timed data and identification information of the fragment file (110); and a multiplexing unit 26 that multiplexes the TD / MMTP packets 210 to generate a broadcast signal 200.

[0062] When transmitting device 2 generates TD / MMTP packet 210 from fragment file 110, it includes the identification information assigned to the file name, which allows receiving device 3 to obtain the identification information of fragment file 110 along with the timed data held in fragment file 110. Receiving device 3 assigns a file name including the identification information of fragment file 110 to the acquired timed data and files it, making it possible to easily restore fragment file 110 from TD / MMTP packet 210.

[0063] (2) The CMAF file group 100 includes a manifest file 130 that holds non-timed data including a filename rule 131 that is a rule for naming the files given to the fragment files 110 . The sending device 2 includes an extracting unit 22 that extracts the filename rule 131 from the manifest file 130 . The timed data generator 23 extracts the identification information from the filename of the fragment file 110 using the filename rules.

[0064] By the extraction unit 22 extracting the file name rule 131 recorded in the manifest file 130, the timed data generation unit 23 can easily extract identification information from the fragment file 110 by referring to the file name rule 131.

[0065] (3) The identification information includes an identifier of the asset to which the timed data held in the fragment file 110 belongs, and a sequence number indicating the order of the timed data in the asset. Since the identification information includes an asset ID and a sequence number, it is possible to easily identify the timed data held in the fragment file 110 from the file name of the fragment file 110.

[0066] (4) The transmission device 2 includes a control message generator 25 that generates an MMT-SI 250 (control message) that includes an asset ID (at least a part of the identification information). The multiplexing unit 26 further multiplexes the MMT-SI 250 to generate a broadcast signal 200.

[0067] The PA table of the MMT-SI 250 includes an asset ID, which is part of the identification information, and an MPU sequence number, which identifies the MPU 211 that configures the TD / MMTP packet 210. This allows the receiving device 3 to sequentially convert fragment files 110 from the TD / MMTP packet 210 by referring to the PA table.

[0068] (5) The transmission device 2 includes a non-timed data generation unit 24 that generates an NTD / MMTP packet 230, which is an MMTP packet including non-timed data held in the manifest file 130. The multiplexing unit 26 further multiplexes the NTD / MMTP packets 230 to generate the broadcast signal 200 .

[0069] By transmitting manifest file 130 in addition to fragment file 110 as MMTP packets in transmission device 2, receiving device 3 can also extract filename rule 131 from manifest file 130 and assign filenames to fragment files 110 in accordance with filename rule 131. This makes it possible to restore CMAF file group 100 input to transmission device 2 from broadcast signal 200.

[0070] (6) The receiving device 3 receives the broadcast signal 200 generated from the CMAF file group 100 that holds the data for streaming distribution, and converts it into the CMAF file group 100. The CMAF file group 100 holds timed data divided from an asset, and includes a plurality of fragment files 110 given file names that include identification information for the timed data. The broadcast signal 200 includes a TD / MMTP packet 210 containing timed data extracted from the fragment file 110 and identification information extracted from the file name of the fragment file 110. The receiving device 3 includes a timed data conversion unit 35 that extracts timed data and identification information from the TD / MMTP packet 210, and converts the timed data into a fragment file 110 by giving the timed data a file name including the identification information.

[0071] As described above, the sending device 2 generates the TD / MMTP packet 210 including the identification information assigned to the file name of the fragment file 110, so the receiving device 3 can obtain the identification information of the fragment file 110 from the TD / MMTP packet 210 along with the timed data held in the fragment file 110. Furthermore, by assigning a file name including the identification information to the timed data acquired by the receiving device 3 and filing it, the fragment file 110 can be easily restored from the MMTP packet.

[0072] (7) The CMAF file group 100 includes a manifest file 130 that holds non-timed data including a filename rule 131 for fragment files. The broadcast signal 200 is generated by multiplexing TD / MMTP packets 210 containing timed data as well as NTD / MMTP packets 230 containing non-timed data. The receiving device 3 a non-timed data converter 33 that converts a TD / MMTP packet 210 containing non-timed data into a manifest file 130; The manifest file 130 includes an extraction unit 34 (filename rule extraction unit) that extracts the filename rule 131 of the fragment file 110 from the manifest file 130. The timed data conversion unit 35 uses the file name rule 131 to extract the identification information from the TD / MMTP packet 210 .

[0073] By transmitting manifest file 130 as an MMTP packet as well, transmitting device 2 can extract filename rule 131 of fragment file 110 from manifest file 130 on the receiving device 3 side, and assign the filename of fragment file 110 to the timed data extracted from TD / MMTP packet 210 in accordance with filename rule 131. This makes it possible to restore CMAF file group 100 input to transmitting device 2.

[0074] (8) The same effect can be achieved with a program for causing the computer 900 to function as the receiving device 3 described above. (9) The same effect can be achieved with the broadcasting system 1 (transmission system) that includes the above-described sending device 2 and receiving device 3.

[0075] In the embodiment described above, an example was described in which the transmission device 2 starts the processing shown in Fig. 14 when the manifest file 130 and initialization file 150 of the CMAF file group 100 are input, but this is not limiting. For example, a data carousel function that performs periodic processing may be added to the transmission device 2 so that the processing shown in Fig. 14 is performed periodically. This allows the reception device 3, which is started at any timing, to receive all MMTP packets converted from the CMAF file group 100.

[0076] The present invention can also be applied to a multicast ABR system. Multicast ABR is a system that transmits ABR (adaptive bit rate) files such as HLS and MPEG-DASH by multicast, and its introduction is being considered in the CATV industry. When a multicast ABR system is based on A176 (DVB BlueBook A176, published in March 2020) established by DVB (Digital Video Broadcasting), an open standard for digital television broadcasting, the content distribution device (content hosting) defined in A176 can be replaced with the receiving device 3 in the embodiment. The content distribution device is a device that accumulates fragment files 110 and transmits them to a multicast server by unicast. By inputting a broadcast signal 200 from a transmission device 2 to a content distribution device, the present invention can be applied to a multicast ABR system implemented based on A176.

[0077] In the above embodiment, the broadcasting system 1 that transmits broadcast signals between the sending device 2 and the receiving device 3 via the broadcasting network 5 has been described as an example of a transmission system, but the present invention is not limited to this. The present invention can also be applied to a transmission system that transmits broadcast signals between the sending device 2 and the receiving device 3 via other transmission paths such as a communication network (IP network). [Explanation of symbols]

[0078] 1 Broadcasting System 2 Delivery device 3. Receiving device 21 Input section 22 Extraction part 23 Timed Data Generation Unit 24 Non-timed data generator 25 Control message generator 26 Multiplexer 27 Transmission Unit 31 Receiving unit 32 Packet Filter 33 Non-timed data conversion unit 34 Extraction part 35 Timed Data Converter 36 Distribution Server

Claims

1. A transmission device that converts a group of files holding streaming distribution data into broadcast signals and transmits the signals, the file group includes a plurality of fragment files each holding timed data divided from an asset and each having a file name including identification information of the timed data; a timed data generation unit that extracts the identification information from the file name of the fragment file and generates an MMTP packet including the timed data of the fragment file and the identification information; A transmission device characterized by comprising: a multiplexing unit that multiplexes the MMTP packets to generate the broadcast signal.

2. the group of files includes a manifest file that holds non-timed data including rules for naming the fragment files; an extracting unit that extracts the file name rule from the manifest file; 2. The transmission device according to claim 1, wherein the timed data generation unit extracts the identification information from the file names of the fragment files using the file name rules.

3. The transmission device according to claim 2, characterized in that the identification information includes an identifier of an asset to which the timed data held in the fragment file belongs and a sequence number indicating the order of the timed data in the asset.

4. a control message generating unit that generates a control message including at least a part of the identification information; 4. The transmission device according to claim 2, wherein the multiplexing unit further multiplexes the control messages to generate the broadcast signal.

5. a non-timed data generation unit that generates an MMTP packet including the non-timed data held in the manifest file; The transmission device according to claim 4, wherein the multiplexing unit further multiplexes the MMTP packets generated by the non-timed data generating unit to generate the broadcast signal.

6. A receiving device that receives a broadcast signal generated from a group of files holding streaming distribution data and converts the signal into the group of files, the file group includes a plurality of fragment files each holding timed data divided from an asset and each having a file name including identification information of the timed data; the broadcast signal includes an MMTP packet including the timed data extracted from the fragment file and the identification information extracted from the file name of the fragment file; A receiving device characterized by comprising a timed data conversion unit that extracts the timed data and the identification information from the MMTP packet, and converts the timed data into the fragment file by assigning a file name including the identification information to the timed data.

7. the group of files includes a manifest file that holds non-timed data including rules for naming the fragment files; the broadcast signal is generated by multiplexing an MMTP packet including the non-timed data in addition to an MMTP packet including the timed data, a non-timed data conversion unit that converts an MMTP packet including the non-timed data into the manifest file; a filename rule extraction unit that extracts the filename rule from the manifest file, The receiving device according to claim 6, wherein the timed data conversion unit extracts the identification information from an MMTP packet including the timed data using the file name rule.

8. Computer, A program for causing the receiving device according to claim 6 or 7 to function.

9. A transmission system comprising: a sending device that converts a group of files holding streaming distribution data into a broadcast signal and sends it; and a receiving device that receives the broadcast signal and converts it into the group of files, the file group includes a plurality of fragment files each holding timed data divided from an asset and each having a file name including identification information of the timed data; The delivery device includes: a timed data generation unit that extracts the identification information from the file name of the fragment file and generates an MMTP packet including the timed data of the fragment file and the identification information; a multiplexing unit that multiplexes the MMTP packets to generate the broadcast signal, The receiving device A transmission system characterized by comprising a timed data conversion unit that extracts the timed data and the identification information from the MMTP packet, and converts the timed data into the fragment file by assigning a file name including the identification information to the timed data.

Citation Information

Patent Citations

  • IEC23000-19

  • Method and apparatus for streaming media content to a client device

    JP2016502804A

  • Reproduction method, content transmission method, reproduction device, and content transmission device

    JP2019134489A

  • Content generation device, reception device, and program

    JP2020129734A

  • Broadcast signal transmission / reception device

    JP2021044822A