Information processing device, information processing method, and program

Abstract

To be capable of preferably performing a series of media access controls on a reception side.SOLUTION: A container of a predetermined format including a media stream is transmitted. A predetermined number of sets of media access information associated with a series of media access controls are successively inserted in a layer of the media stream or a layer of the container. For example, the media access information includes identification information for making a distinction between other media access information, and identification information for making an association with the other media access information.SELECTED DRAWING: Figure 16

Description

[Technical Field]

[0001] This technology is 、 Information Processing Method and programs Regarding. [Background technology]

[0002] For example, Patent Document 1 proposes that predetermined information is inserted into an audio compressed data stream from a broadcasting station, distribution server, etc. and transmitted, and that the set-top box on the receiving side transmits this audio compressed data stream directly to a television receiver via an HDMI digital interface, and that the television receiver performs information processing using the predetermined information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-010311 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present technology is to enable a series of media access controls to be performed well on the receiving side. [Means for solving the problem]

[0005] The concept of this technology is: a stream sending unit that sends a container in a predetermined format including a media stream; an information insertion unit for sequentially inserting a predetermined number of pieces of media access information related to a series of media access controls into a layer of the media stream or a layer of the container; Located in the transmitting device.

[0006] In this technology, a transmitting unit transmits a container in a predetermined format containing a media stream, and an information inserting unit sequentially inserts a predetermined number of related media access information for a series of media access controls into a layer of the media stream or a layer of the container.

[0007] For example, the media access information may include identification information for distinguishing it from other media access information, which makes it easy for the receiving side to distinguish between the media access information.

[0008] Furthermore, for example, the media access information may include identification information for associating it with other media access information, which makes it easier for the receiving side to check the associated media access information.

[0009] Furthermore, for example, the media access information may include duration information indicating a corresponding scene in the media stream, which makes it easier for a receiving side to obtain media data related to the corresponding scene in the media stream.

[0010] Furthermore, for example, user interface information for allowing the user to select playback media may be included, which allows the receiving side to allow the user to select desired playback media.

[0011] Furthermore, for example, the media access information may include time information for managing the activation of action commands. This time information allows flexible management of the activation timing of action commands.

[0012] Furthermore, for example, the media access information may include absolute time information indicating a time limit for media playback. This absolute time information makes it possible to set a time limit for media playback on the receiving side.

[0013] Furthermore, for example, the media access information may include notification information for informing the user of the status. This notification information allows the receiving side to appropriately inform the user of the status.

[0014] Furthermore, for example, the information insertion unit may be configured to insert each piece of segment information obtained by dividing the media access portion into a predetermined number of unit portions of the media stream. In this case, for example, the media stream may be an audio compressed data stream, and the information insertion unit may insert the segment information into a user data area of ​​an audio frame as a unit portion. By enabling segment insertion in this way, the size of information inserted into each media frame can be reduced even if the overall size of the media access information is large, and it is possible to transmit the media access information satisfactorily without affecting the transmission of the media data.

[0015] In this way, in the present technology, a predetermined number of pieces of media access information related to a series of media access controls are sequentially inserted into a media stream layer or a container layer and transmitted, thereby enabling the receiving side to perform a series of media access controls well.

[0016] Another concept of the present technology is a first acquisition unit that acquires first media data and sequentially acquires a predetermined number of pieces of media access information for a series of media access controls; a second acquisition unit that acquires second media data related to the first media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Located in the media processing device.

[0017] In the present technology, the first acquisition unit acquires first media data and sequentially acquires a predetermined number of pieces of media access information for a series of media access controls.

[0018] For example, the first acquisition unit may have a receiving unit that receives a container in a predetermined format that includes a media stream, and media access information is inserted in a layer of the media stream or a layer of the container, and the first acquisition unit may further have a decoding processing unit that performs a decoding process on the media stream to obtain first media data, and an information extraction unit that extracts the media access information from the layer of the media stream or the layer of the container.

[0019] Furthermore, for example, the first acquisition unit may include a receiving unit that receives video data as the first media data and an audio compressed data stream into which media access information has been inserted from an external device via a digital interface, a decoding processing unit that performs a decoding process on the audio compressed data stream to obtain audio data as the first media data, and an information extraction unit that extracts the media access information from the audio compressed data stream.

[0020] The second acquisition unit acquires second media data related to the first media data based on the media access information, and the presentation processing unit performs media presentation processing using the first media data and the second media data.

[0021] In this way, in the present technology, a predetermined number of pieces of media access information for a series of media access control are sequentially acquired together with the first media data, and the second media data is acquired based on the media access information, so that the second media data can be presented in correspondence with the presentation of the media by the first media data.

[0022] Another concept of the present technology is a receiving unit for receiving a container in a predetermined format including a media stream; a predetermined number of pieces of media access information related to a series of media access controls are sequentially inserted into a layer of the media stream or a layer of the container; The apparatus includes a control unit that controls a decoding process for decoding the media stream to obtain first media data, a media data acquisition process for acquiring second media data based on the media access information, and a media presentation process for presenting media using the first media data and the second media data. It is in the receiving device.

[0023] In this technology, A receiving unit receives a container in a predetermined format containing a media stream. A predetermined number of related media access information for a series of media access controls are sequentially inserted into a layer of the media stream or a layer of the container. A control unit controls a decoding process, a media data acquisition process, and a media presentation process.

[0024] In the decoding process, the media stream is decoded to obtain first media data, in the media data acquisition process, second media data is acquired based on the media access information, and in the media presentation process, media presentation is performed using the first media data and the second media data.

[0025] In this way, in the present technology, a predetermined number of pieces of media access information for a series of media access control are sequentially acquired together with the first media data, and the second media data is acquired based on the media access information, so that the second media data can be presented in correspondence with the presentation of the media by the first media data.

[0026] Another concept of the present technology is a receiving unit that receives, via a digital interface from an external device, a compressed audio data stream into which video data as first media data and a predetermined number of pieces of media access information for a series of media access controls are sequentially inserted; The audio data processing unit includes a control unit that controls a decoding process for decoding the audio compressed data stream to obtain audio data as the first media data, a media data acquisition process for acquiring second media data based on the media access information, and a media presentation process for presenting media using the first media data and the second media data. It is in the receiving device.

[0027] In this technology, a receiving unit receives, from an external device via a digital interface, a compressed audio data stream into which video data as first media data and a predetermined number of pieces of media access information for a series of media access control are sequentially inserted. A control unit controls a decoding process, a media data acquisition process, and a media presentation process.

[0028] In the decoding process, the audio compressed data stream is decoded to obtain audio data as first media data, in the media data acquisition process, second media data is acquired based on the media access information, and in the media presentation process, media presentation is performed using the first media data and the second media data.

[0029] In this way, in the present technology, a predetermined number of pieces of media access information for a series of media access control are sequentially acquired together with the first media data, and the second media data is acquired based on the media access information, so that the second media data can be presented in correspondence with the presentation of the media by the first media data.

[0030] Another concept of the present technology is a transmitting unit that transmits a container in a predetermined format including an encoded audio stream into which predetermined information has been inserted; An information inserting unit that inserts information indicating that the format of the encoded stream is to be given priority as the transmission format of the audio data into the layer of the container. Located in the transmitting device.

[0031] In this technology, a transmitting unit transmits a container of a predetermined format including an audio encoded stream into which predetermined information has been inserted. For example, the predetermined information may be a predetermined number of pieces of media access information associated with a series of media access controls. The information inserting unit inserts, into a layer of the container, information indicating that the format of the encoded stream is to be prioritized as a transmission format for audio data.

[0032] In this way, in this technology, information indicating that the encoded stream is to be prioritized as the transmission format of audio data is inserted into the container layer, which makes it possible for the receiving device to prioritize the format of the encoded stream as the transmission format of audio data, and enables the receiving device to reliably supply the predetermined information inserted into the encoded stream to an external device (destination device).

[0033] Another concept of the present technology is a transmitter for transmitting a container in a predetermined format including a media stream; an information insertion unit that inserts media access information into the layer of the media stream or the layer of the container, together with check information for checking the provider of the media data acquired using the media access information; Located in the transmitting device.

[0034] In this technology, a transmitting unit transmits a container in a predetermined format including a media stream. An information inserting unit inserts media access information into a layer of the media stream or a layer of the container. Check information for checking the source of media data obtained using the media access information is added to the media access information. For example, the check information may be an identification value uniquely assigned to an individual service provided by the media access information, or to a provider or standards organization of the service.

[0035] In this way, in the present technology, check information for checking the provider of media data obtained using the media access information is added to the media access information inserted into the media stream layer or the container layer, thereby enabling the receiving side to simply and easily check the provider of the media data obtained using the media access information.

[0036] Another concept of the present technology is a media access information acquisition unit for acquiring media access information, check information for checking a provider of the media data acquired using the media access information is added to the media access information; a media data acquisition unit that acquires media data based on the media access information; The information processing device further includes a provider check unit that checks the provider of the acquired media data based on the check information. Located in the media processing device.

[0037] In the present technology, a media access information acquisition unit acquires media access information. This media access information is added with check information for checking the provider of media data acquired using this media access information. A media data acquisition unit acquires media data based on the media access information. Then, a provider check unit checks the provider of the acquired media data based on the check information.

[0038] In this way, in the present technology, the provider of the media data acquired using the media access information is checked based on the check information added to the media access information, which makes it possible to simply and easily check the provider of the media data acquired using the media access information. [Effects of the Invention]

[0039] According to the present technology, a series of media access controls can be performed effectively on the receiving side. Note that the effects described in this specification are merely examples and are not intended to be limiting, and additional effects may also be provided. [Brief explanation of the drawings]

[0040] [Figure 1] 1 is a block diagram showing an example of the configuration of a transmission / reception system according to an embodiment; [Figure 2] FIG. 10 is a diagram for explaining the effect of dividing and transmitting media access information. [Figure 3] 10 is a block diagram showing an example of the configuration of a stream generation unit included in the broadcast transmission device. FIG. [Figure 4] FIG. 1 is a diagram illustrating an example of the structure of an audio frame in transmission data of MPEG-H 3D Audio. [Figure 5] FIG. 10 is a diagram showing the correspondence between extension element types and their values. [Figure 6]FIG. 10 is a diagram showing an example of the structure of a universal metadata frame that includes universal metadata as an extension element. [Figure 7] FIG. 13 is a diagram (1 / 3) showing an example of the configuration of access information data having media access information. [Figure 8] FIG. 2 is a diagram (2 / 3) showing an example of the configuration of access information data having media access information. [Figure 9] FIG. 3 is a diagram (3 / 3) showing an example of the configuration of access information data having media access information. [Figure 10] This figure (1 / 2) shows the contents of the main information in the universal metadata frame and access information data. [Figure 11] This is a diagram (2 / 2) showing the contents of the main information in the universal metadata frame and access information data. [Figure 12] FIG. 10 is a diagram showing an example of the structure of an audio streaming descriptor and the contents of the main information in the example structure. [Figure 13] FIG. 10 is a diagram illustrating an example in which container target data is transmitted in multiple universal metadata frames. [Figure 14] FIG. 10 is a diagram showing an example in which container target data is transmitted in one universal metadata frame. [Figure 15] FIG. 10 is a diagram illustrating an example in which multiple container target data are transmitted in multiple universal metadata frames. [Figure 16] FIG. 10 is a diagram showing an example of the structure of a transport stream TS when media access information (container target data) is inserted into an audio stream and transmitted. [Figure 17] FIG. 1 is a block diagram illustrating an example of the configuration of a set-top box. [Figure 18] FIG. 1 is a block diagram showing a configuration example of an audio amplifier. [Figure 19]FIG. 1 is a block diagram showing an example of the configuration of a television receiver. [Figure 20] FIG. 2 is a block diagram showing an example of the configuration of an HDMI transmitting unit and an HDMI receiving unit. [Figure 21] FIG. 10 is a diagram showing various transmission data sections when image data is transmitted over a TMDS channel. [Figure 22] FIG. 1 illustrates an example of media access control. [Figure 23] FIG. 10 is a diagram showing an example of information included in each piece of media access information. [Figure 24] FIG. 10 is a diagram showing another example of information included in each piece of media access information. [Figure 25] FIG. 1 illustrates an example of media access control. [Figure 26] FIG. 10 is a diagram showing an example of information included in each piece of media access information. [Figure 27] FIG. 10 is a diagram illustrating an example of checking the provider of media data acquired using media access information. [Figure 28] FIG. 10 is a block diagram showing another example configuration of the stream generating unit included in the broadcast transmission device. [Figure 29] FIG. 10 is a diagram illustrating an example of the structure of an application descriptor. [Figure 30] FIG. 10 is a diagram showing an example of the structure of a transport stream TS when media access information (container target data) is inserted into a container and sent. [Figure 31] FIG. 10 is a block diagram showing another example of the configuration of the set-top box. [Figure 32] FIG. 10 is a diagram illustrating an example of the structure of an MMT stream when media access information (container target data) is inserted into an audio stream and sent. [Figure 33] FIG. 10 is a diagram illustrating an example of the structure of an MMT stream when media access information (container target data) is inserted into a container and sent. [Figure 34] FIG. 1 is a diagram showing the structure of the AC4 Simple Transport layer. [Figure 35] FIG. 10 is a diagram showing a schematic configuration of a TOC (ac4_toc()) and a substream (ac4_substream_data()). [Figure 36] FIG. 10 is a diagram showing an example of a universal data structure. [Figure 37] This is a diagram showing the contents of the main information in an example of a universal data structure. [Figure 38] FIG. 10 is a diagram illustrating an example of the structure of an AC4 data container descriptor. [Figure 39] This figure shows the contents of the main information in an example structure of an AC4 data container descriptor. [Figure 40] FIG. 10 is a diagram illustrating an example of the structure of an MPEG-2 TS transport stream when the audio compression format is AC4. [Figure 41] FIG. 10 is a diagram illustrating an example of the structure of an MMT transport stream when the audio compression format is AC4. [Figure 42] FIG. 10 is a diagram showing an example of the structure of an MP4 stream (file) including audio track data when the audio compression format is AC4. [Figure 43] FIG. 10 is a diagram illustrating an example of an MPD file description. [Figure 44] FIG. 10 is a diagram showing the contents of main information in an example of an MPD file description. [Figure 45] FIG. 10 is a block diagram showing another example configuration of the transmission and reception system. [Figure 46] FIG. 10 is a block diagram showing yet another example configuration of the transmission and reception system. DETAILED DESCRIPTION OF THE INVENTION

[0041] Hereinafter, modes for carrying out the invention (hereinafter referred to as "embodiments") will be described. The description will be made in the following order. 1. Embodiment 2. Variations

[0042] <1. Embodiment> [Example of transmission and reception system configuration] 1 shows an example of the configuration of a transmission / reception system 10 according to an embodiment. The transmission / reception system 10 includes a broadcast transmission device 100, a set-top box (STB) 200, an audio amplifier (AMP) 300, and a television receiver (TV) 500. A multi-channel speaker system 400 is connected to the audio amplifier 300.

[0043] The set-top box 200 and the audio amplifier 300 are connected via an HDMI cable 610. In this case, the set-top box 200 is the source and the audio amplifier 300 is the destination. Furthermore, the audio amplifier 300 and the television receiver 500 are connected via an HDMI cable 620. In this case, the audio amplifier 300 is the source and the television receiver 500 is the destination. Note that "HDMI" is a registered trademark.

[0044] The broadcast transmission device 100 transmits a transport stream TS via broadcast waves. This transport stream TS includes a video stream and an audio stream (a compressed audio data stream and an encoded audio stream). The broadcast transmission device 100 sequentially inserts a predetermined number of related media access information for a series of media access controls into the audio stream as container target data.

[0045] Each piece of media access information includes identification information "data_id" for distinguishing it from other pieces of media access information, and identification information "information_id" for associating it with other pieces of media access information.

[0046] In addition, each piece of media access information selectively includes information such as ID tables (ID_tables), access information, action commands, notifications, periods, reference time processes, offset times, universal time codes (UTC), and UI selection codes.

[0047] The ID table (ID_tables) includes an application ID (application_id), a network ID (network_id), a transport ID (transport_id), a service ID (service_id), etc. The application ID indicates, for example, a hybrid service. The network ID is the original network ID. The transport ID is the transport ID of the object to be associated. The service ID is the service information ID to be associated. Each ID in this ID table and the organization ID (organization_id) indicating ATSC, DVB, etc. constitute identification information for the service supplied by broadcast wave.

[0048] The access information indicates the URL to access. The action command is a command for starting an action such as autostart or manual_start. The notification indicates notification information (message) for notifying the user of the status. The period is period information that indicates the corresponding scene in the audio stream.

[0049] The reference time code and offset time are time information used to manage the initiation of action commands. The universal time code (UTC) is absolute time information that indicates the deadline for media playback. The UI selection code is user interface information that allows the user to select the media to be played.

[0050] The broadcast transmission device 100 divides each of a predetermined number of pieces of media access information into a predetermined number of audio frames of the audio stream and inserts them into the audio frames. By dividing the information into pieces in this manner, even if the total size of the media access information is large, the size of the information inserted into each audio frame can be reduced, and the predetermined information can be transmitted without affecting the transmission of the compressed audio data.

[0051] At this time, the broadcast transmission device 100 adds information indicating the overall size of the predetermined information to the first division information, and adds information indicating whether it is the first division information or not and information indicating the division position to each division information. Note that the predetermined number includes 1. When the predetermined number is 1, the media access information is not actually divided, and the entire information is inserted into one audio frame.

[0052] The solid line a in Figure 2 shows a rough outline of the change in bit rate when a large amount of predetermined information is transmitted in one audio frame. However, the bit rate increases sharply in the audio frame where the media access information is inserted. In this case, for example, if the bit rate of the audio compressed data is 192 kbps and the predetermined information is 40 bytes, the bit rate increases by 15 kbps to 207 kbps. Such a sudden spike-like increase in bit rate affects the transmission of the audio compressed data.

[0053] On the other hand, the dashed line b in Figure 2 shows the change in bit rate when large media access information is divided into multiple audio frames and transmitted. In this case, the bit rate does not increase suddenly. Therefore, large media access information can be transmitted satisfactorily without affecting the transmission of compressed audio data.

[0054] The broadcast transmission device 100 also inserts information (transmission format priority information) indicating that the format of the encoded stream is to be prioritized as the transmission format of audio data into the layer of the transport stream TS serving as a container. The broadcast transmission device 100 inserts this information, for example, as a descriptor into an audio elementary stream loop existing under a program map table (PMT).

[0055] The set-top box 200 receives a transport stream TS transmitted via broadcast waves from the broadcast transmission device 100. As described above, this transport stream TS includes a video stream and an audio stream, and a predetermined number of related media access information for a series of media access controls are inserted sequentially into the audio stream.

[0056] The set-top box 200 transmits the received audio stream itself to the audio amplifier 300 via the HDMI cable 610, together with uncompressed video data obtained by decoding the video stream. In this case, the set-top box 200 transmits the audio stream itself to the audio amplifier 300 without decoding it, based on the above-mentioned transmission format priority information inserted in the layer of the transport stream TS. As a result, the media access information inserted in the audio stream is also sent to the audio amplifier 300 as is.

[0057] The audio amplifier 300 receives an audio stream containing media access information inserted together with uncompressed video data from the set-top box 200 via the HDMI cable 610. The audio amplifier 300 decodes the audio stream to obtain multi-channel audio data and supplies this audio data to the speaker system 400.

[0058] The audio amplifier 300 also transmits the received uncompressed video data and audio stream to the television receiver 500 via the HDMI cable 620. As a result, the media access information inserted in the audio stream is also sent directly to the television receiver 500. In this case, the audio amplifier 300 is instructed by the set-top box 200, for example, via communication using the CEC line, to prioritize the format of the encoded stream as the transmission format of the audio data.

[0059] The television receiver 500 receives an audio stream, into which a predetermined number of pieces of media access information related to a series of media access controls are sequentially inserted, along with uncompressed video data, from the audio amplifier 300 via the HDMI cable 620. The television receiver 500 displays an image based on the uncompressed video data. The television receiver 500 also decodes the audio stream to obtain the media access information.

[0060] The media access information is divided into a predetermined number of audio frames of the audio stream and inserted. Information indicating the overall size of the media access information is added to the first division information, and information indicating whether it is the first division information or not and information indicating the division position is added to each division information. Based on this information, the television receiver 500 acquires each division information constituting the media access information from the predetermined number of audio frames.

[0061] In this case, the television receiver 500 recognizes the information indicating the overall size of the media access information when the first piece of division information is acquired, and the television receiver 500 can then secure space in the storage medium for storing predetermined information, making it possible to easily and appropriately perform the process of acquiring the media access information.

[0062] The television receiver 500 acquires media data based on a predetermined number of pieces of media access information related to a series of media access controls, and then displays images and outputs audio based on the media data acquired based on the media access information in response to image display, audio output, etc. based on the video and audio data sent from the set-top box 200.

[0063] [Stream generation unit of broadcast transmission device] 3 shows an example of the configuration of the stream generation unit 110 provided in the broadcast transmission device 100. This stream generation unit 110 has a control unit 111, a video encoder 112, an audio encoder 113, and a multiplexer 114.

[0064] The control unit 111 includes a CPU 111a and controls each unit of the stream generation unit 110. The video encoder 112 encodes video data (image data) SV using MPEG2, H.264 / AVC, H.265 / HEVC, or the like to generate a video stream (video elementary stream). The video data SV is, for example, video data played back from a recording medium such as an HDD (hard disk drive), or live video data captured by a video camera.

[0065] The audio encoder 113 encodes the audio data (sound data) SA in the MPEG-H 3D Audio compression format to generate an audio stream (audio elementary stream). The audio data SA corresponds to the above-mentioned video data SV, and may be audio data played back from a recording medium such as a HDD, or live audio data obtained by a microphone.

[0066] The audio encoder 113 has an audio encoding block unit 113a and an audio framing unit 113b. The audio encoding block unit 113a generates an encoded block, and the audio framing unit 113b performs framing.

[0067] Under the control of the control unit 111, the audio encoder 113 sequentially inserts a predetermined number of pieces of media access information related to a series of media access control into the audio stream as container target data. The audio encoder 113 divides each of the predetermined number of pieces of media access information into a predetermined number (including 1) of audio frames of the audio stream and inserts them. At this time, the audio encoder 113 adds information indicating the overall size of the predetermined information to the first piece of division information. The audio encoder 113 also adds, to each piece of division information, information indicating whether it is the first piece of division information or not, and a count number in descending order as information indicating the division position.

[0068] Figure 4 shows an example of the structure of an audio frame in MPEG-H 3D Audio transmission data. This audio frame consists of multiple MPEG Audio Stream Packets. Each MPEG Audio Stream Packet consists of a header and a payload.

[0069] The header contains information such as packet type, packet label, and packet length. The payload contains information defined by the packet type in the header. This payload information contains "SYNC," which is the synchronization start code, "Frame," which is the actual data for 3D audio transmission, and "Config," which indicates the configuration of this "Frame."

[0070] A "Frame" contains channel-encoded data and object-encoded data that make up the 3D audio transmission data. Here, the channel-encoded data consists of encoded sample data such as SCE (Single Channel Element), CPE (Channel Pair Element), and LFE (Low Frequency Element). Also, the object-encoded data consists of encoded sample data of SCE (Single Channel Element) and metadata for mapping and rendering it to speakers located at any position. This metadata is included as an extension element (Ext_element).

[0071] In this embodiment, an element (Ext_universal_metadata) that has media access information as universal metadata (universal_metadata) is newly defined as an extension element (Ext_element). Accordingly, configuration information for that element (universal_metadataConfig) is newly defined in "Config."

[0072] Figure 5 shows the correspondence between the type (ExElementType) of an extension element (Ext_element) and its value (Value). Currently, 0 to 7 are defined. Values ​​128 and above can be extended to standards other than MPEG, so for example, 128 is defined as a new type value for "ID_EXT_ELE_universal_metadata." Note that for standards such as MPEG, it is also possible to define values ​​from 8 to 127.

[0073] Figure 6 shows an example of the structure (syntax) of a universal metadata frame (universal_metadata_frame()) that includes universal metadata as an extension element. Figures 7, 8, and 9 show example structures (syntax) of access information data (Access_information_data()) inserted into the "bytes_to_carry_access_information_data" field of a specified number (including 1) of universal metadata frames. Figures 10 and 11 show the semantics of the main information in each structure example.

[0074] In the universal metadata frame (universal_metadata_frame()), the 32-bit field "organization_id" indicates an identification value uniquely assigned to each individual service transmitted in the user data area, or to the provider or standards organization of this service (e.g., "ATSC", "DVB", etc.). The 8-bit field "metadata_type" indicates the type of container target data. For example, "0x10" indicates MPEG-H universal metadata, and "0x02" indicates ATSC application metadata. The 8-bit field "data_id" indicates the ID of the container target data (media access information). The same ID is assigned to each piece of partition information obtained by dividing the same container target data.

[0075] The 1-bit field of "start_flag" indicates whether it is the start of the container target data. "1" indicates the start, and "0" indicates that it is not the start. The 7-bit field of "fcounter" indicates the division position of the divided container target data in descending order as a count number. "0" indicates the last divided part. If "start_flag" is "1" and "fcounter" is "0", it indicates that it is not divided.

[0076] When "start_flag" is "1", the 16-bit field "total_data_size" exists. This field indicates the size of the data to be contained in the container. The entire access information data (Access_information_data()) or a part of it (division information) is inserted into the "bytes_to_carry_access_information_data" field.

[0077] In the access information data (Access_information_data()), the 8-bit field "num_of_access_information; N" indicates the number of pieces of information N in the media access information. The 8-bit field "information_id" indicates the ID of the media access information. The same ID is assigned to a certain number of related media access information. In other words, applications can use this "information_id" to associate each piece of media access information. The 8-bit field "segment_id" indicates the ID of each segmented media access information that shares the same "information_id."

[0078] The access information data (Access_information_data()) contains information of the number N indicated by "num_of_access_information; N". The 8-bit field "information_type" indicates the type of information. "0x00" indicates ID tables (ID_tables). When the type of information is ID tables, there are 16-bit fields indicating the application ID (applicatio_id), network ID (network_id), transport ID (transport_id), and service ID (service_id).

[0079] "0x01" indicates access information. When the type of information is access information, the code for each character of the URL is placed in the "bytes" field. The 8-bit field "url_length" indicates the number of characters in the URL.

[0080] "0x02" indicates an action command. When the information type is an action command, an 8-bit field "command_type" exists. For example, "1" indicates autostart, "2" indicates manual start, "3" indicates resume, "4" indicates pause, "5" indicates stop, "6" indicates user selected, and "7" indicates discard download data.

[0081] "0x03" indicates notification. When the type of information is notification, an 8-bit field "message_type" exists. For example, "1" indicates preparing, "2" indicates access ready, "3" indicates expired, and "4" indicates selection.

[0082] "0x04" indicates a period. When the type of information is a period, an 8-bit field "period_id" exists. "0x05" indicates a reference time code. When the type of information is a reference time code, a 64-bit field "time_code1" exists.

[0083] "0x06" indicates the offset time (offset_time). When the type of information is offset time, there is a 64-bit field for "time_code2" and an 8-bit field for "target_segment_id". This field indicates the "segment_id" of the media access information to which the offset time is specified. Note that when specifying its own offset time, this "target_segment_id" may not exist.

[0084] "0x07" indicates UTC (universal time code). When the type of information is UTC, a 64-bit field of "UTC" exists.

[0085] "0x08" indicates a UI selection process (UI selection code). When the information type is a UI selection process, user interface information for allowing the user to select playback media is placed in the "data" field. This user interface information is, for example, HTML data describing the information necessary to start a browser. This description includes thumbnail information for the user to select, an ID "select_ID" that indicates the selection result, and so on. The 8-bit field of "html_length" is information for realizing the browser function, and indicates the number of bytes of related HTML data.

[0086] Returning to Figure 3, the multiplexer 114 PES packets the video stream output from the video encoder 112 and the audio stream output from the audio encoder 113, and then transport packets and multiplexes them to obtain a transport stream TS as a multiplexed stream.

[0087] The multiplexer 114 also inserts information (transmission format priority information) indicating that the format of the encoded stream (audio compressed data stream) is to be prioritized as the transmission format of audio data into the program map table (PMT). Specifically, the multiplexer 114 inserts an audio streaming descriptor (Audio_streaming_descriptor()) into the audio elementary stream loop.

[0088] Figure 12(a) shows an example of the structure (Syntax) of an audio streaming descriptor, and Figure 12(b) shows the main information content (Semantics) of the example structure.

[0089] The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an audio streaming descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0090] The 1-bit field "audio_streaming_flag" indicates that the format of the coded stream is to be given priority as the transmission format of audio data. "1" indicates that the format of the coded stream is to be given priority, and "0" indicates that the format of the coded stream does not have to be given priority. In this embodiment, "audio_streaming_flag" is set to "1".

[0091] A brief description will be given of the operation of the stream generation unit 110 shown in Fig. 3. Video data SV is supplied to a video encoder 112. In this video encoder 112, the video data SV is subjected to encoding using H.264 / AVC, H.265 / HEVC, or the like, and a video stream including the encoded video data is generated.

[0092] The audio data SA is also supplied to an audio encoder 113. In this audio encoder 113, the audio data SA is encoded in the MPEG-H 3D Audio compression format, and an audio stream (audio compressed data stream) is generated.

[0093] At this time, media access information to be inserted into the audio stream is supplied as container target data from the control unit 111 to the audio encoder 113. The audio encoder 113 divides the container target data (media access information) into a predetermined number (including 1) of audio frames of the audio stream and inserts the divided data into the audio frames.

[0094] At this time, the audio encoder 113 adds information indicating the total size of the container target data (media access information) to the first division information. Also, the audio encoder 113 adds, to each division information, information indicating whether it is the first division information or not and a count number in descending order as information indicating the division position.

[0095] The video stream generated by the video encoder 112 is supplied to a multiplexer 114. Also, the audio stream generated by the audio encoder 113 is supplied to the multiplexer 114. Then, in this multiplexer 114, the streams supplied from the respective encoders are packetized and multiplexed, and a transport stream TS is obtained as transmission data.

[0096] Additionally, the multiplexer 114 inserts an audio streaming descriptor (see FIG. 12(a)) into the audio elementary stream loop under the program map table (PMT). This descriptor contains information (transmission format priority information) indicating that the format of the encoded stream (audio compressed data stream) is to be given priority as the transmission format for audio data.

[0097] [Insert container target data (prescribed information)] The insertion of container object data into an audio stream will be further explained below. Figure 13 shows an example in which container object data (media access information) is transmitted in multiple universal metadata frames.

[0098] In this case, the container target data is divided into multiple pieces, and each of the multiple pieces of division information is distributed across multiple universal metadata frames and inserted into the "bytes_to_carry_access_information_data" field (see Figure 6). Here, the "start_flag" corresponding to the first piece of division information is set to "1", indicating that it is the first piece of division information. The "fcounter" corresponding to the first piece of division information is set to "n-1", and adding 1 to this value indicates the number of divisions, "n". Also, corresponding to this first piece of division information, there is a "total_data_size" field, which indicates the total size of the container target data (media access information).

[0099] The "start_flag" corresponding to the second and subsequent division information is set to "0", indicating that it is not the first division information. The "fcounter" corresponding to the second and subsequent division information is set to a count number decremented sequentially from "n-1", indicating the division position and the number of remaining division information. The "fcounter" corresponding to the last division information is set to "0", indicating that it is the last division information.

[0100] It is also possible to set the "fcounter" corresponding to the first division information to "n", the "fcounter" corresponding to the second and subsequent division information to count numbers decremented from "n", and the "fcounter" corresponding to the last division information to "1". The "n" in the "fcounter" corresponding to the first division information indicates the number of divisions, and an "fcounter" of "1" indicates that it is the last division information.

[0101] Figure 14 shows an example where container target data (media access information) is transmitted in one universal metadata frame. In this case, the container target data is not divided but inserted into the "bytes_to_carry_access_information_data" field of one universal metadata frame (see Figure 6). Here, "start_flag" is set to "1", indicating that this is the first division information. Also, "fcounter" is set to "0", indicating that this is the last division information. Therefore, these pieces of information indicate that the data has not been divided. Also, corresponding to this first division information, there is a "total_data_size" field, which indicates the total size of the container target data (media access information).

[0102] Figure 15 shows an example in which multiple container target data (media access information) are transmitted in multiple universal metadata frames. The example shown in the figure is an example in which two container target data are transmitted: container target data A, whose "data_id" is "0", and container target data B, whose "data_id" is "1".

[0103] In this case, container target data A is divided into three pieces of division information, and each of the three pieces of division information is allocated to three universal metadata frames and inserted into the "bytes_to_carry_access_information_data" field (see Figure 6). Here, the "start_flag" corresponding to the first division information is set to "1", indicating that this is the first division information. Also, the "fcounter" corresponding to the first division information is set to "2", and adding 1 to this value indicates the number of divisions, "3". Also, corresponding to this first division information, there is a "total_data_size" field, which indicates the total size of the container target data (media access information).

[0104] The "start_flag" corresponding to the second division information is set to "0", indicating that it is not the first division information. The "fcounter" corresponding to the second division information is set to "1", indicating the division position and that the number of remaining division information is "1". The "start_flag" corresponding to the last division information is set to "0", indicating that it is not the last division information. The "fcounter" corresponding to the last division information is set to "0", indicating that it is the last division information.

[0105] Furthermore, container target data B is inserted into the "bytes_to_carry_access_information_data" field of one universal metadata frame without being divided (see Figure 6). Here, "start_flag" is set to "1", indicating that this is the first division information. Also, "fcounter" is set to "0", indicating that this is the last division information. Therefore, these pieces of information indicate that it has not been divided. Also, corresponding to this first division information, there is a "total_data_size" field, which indicates the total size of the container target data (media access information).

[0106] [Example of transport stream TS structure] Fig. 16 shows an example structure of a transport stream TS. In this example structure, there is a PES packet "video PES" for a video stream identified by PID1, and there is also a PES packet "audio PES" for an audio stream identified by PID2. A PES packet consists of a PES header (PES_header) and a PES payload (PES_payload). DTS and PTS timestamps are inserted in the PES header.

[0107] An audio stream (Audio coded stream) is inserted into the PES payload of the PES packet of the audio stream. Access information data (Access_information_data()) (see Figures 7 to 9) containing media access information (container target data) is inserted into the universal metadata frame (universal_metadata_frame()) in a predetermined number of audio frames (including 1) of this audio stream.

[0108] The transport stream TS also contains a PMT (Program Map Table) as PSI (Program Specific Information). The PSI is information that describes which program each elementary stream in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program.

[0109] The PMT also contains elementary stream loops that contain information related to each elementary stream. In this configuration example, there is a video elementary stream loop (video ES loop) corresponding to the video stream, and an audio elementary stream loop (audio ES loop) corresponding to the audio stream.

[0110] The video elementary stream loop (video ES loop) contains information such as the stream type and PID (packet identifier) ​​for each video stream, as well as descriptors describing information related to the video stream. The "Stream_type" value for this video stream is set to "0x24," and the PID information indicates PID1, which is assigned to the PES packet "video PES" of the video stream, as described above. One of the descriptors included is the HEVC descriptor.

[0111] Additionally, the audio elementary stream loop (audio ES loop) contains information such as the stream type and PID (packet identifier) ​​for each audio stream, as well as a descriptor describing information related to that audio stream. The "Stream_type" value for this audio stream is set to "0x2C," and the PID information indicates PID2, which is assigned to the audio stream's PES packet, "audio PES," as described above. One of the descriptors contained therein is the audio streaming descriptor described above.

[0112] [Set-top box configuration example] 17 shows an example of the configuration of a set-top box 200. This set-top box 200 has a CPU 201, a flash ROM 202, a DRAM 203, an internal bus 204, a remote control receiver 205, and a remote control transmitter 206. The set-top box 200 also has an antenna terminal 211, a digital tuner 212, a demultiplexer 213, a video decoder 214, an audio framing unit 215, an HDMI transmitter 216, and an HDMI terminal 217.

[0113] The CPU 201 controls the operation of each unit of the set-top box 200. The flash ROM 202 stores control software and data. The DRAM 203 constitutes the work area of ​​the CPU 201. The CPU 201 loads software and data read from the flash ROM 202 onto the DRAM 203, starts up the software, and controls each unit of the set-top box 200.

[0114] The remote control receiving unit 205 receives a remote control signal (remote control code) transmitted from the remote control transmitter 206 and supplies it to the CPU 201. The CPU 201 controls each unit of the set-top box 200 based on the remote control code. The CPU 201, flash ROM 202, and DRAM 203 are connected to an internal bus 204.

[0115] The antenna terminal 211 is a terminal for inputting a television broadcast signal received by a receiving antenna (not shown). The digital tuner 212 processes the television broadcast signal input to the antenna terminal 211 and outputs a transport stream TS corresponding to a channel selected by the user.

[0116] The demultiplexer 213 extracts video stream packets from the transport stream TS and sends them to the video decoder 214. The video decoder 214 reconstructs the video stream from the video packets extracted by the demultiplexer 213 and performs a decoding process to obtain uncompressed video data (image data).

[0117] The demultiplexer 213 also extracts audio stream packets from the transport stream TS and reconstructs the audio stream. The audio framing unit 215 performs framing on the reconstructed audio stream. As explained above with reference to the stream generation unit 110 (see FIG. 3), media access information (container target data) has been inserted into this audio stream.

[0118] The demultiplexer 213 also extracts various types of information, such as descriptor information, from the transport stream TS and sends it to the CPU 201. This information also includes the above-mentioned audio streaming descriptor (Audio_streaming_descriptor()) information (see FIG. 12(a)).

[0119] Based on the information in the "audio_streaming_flag" field inserted in this descriptor, i.e., the transmission format priority information, the CPU 201 recognizes that the format of the encoded stream (audio compressed data stream) is to be prioritized as the transmission format for audio data. As a result, the CPU 201 controls each unit of the set-top box 200 so that the audio stream is transmitted to the audio amplifier 300 without being decoded. Although not shown, the set-top box 200 may also include, for example, an audio decoder, which can decode the audio stream to obtain audio data.

[0120] Furthermore, the CPU 201 communicates with the audio amplifier 300 using, for example, a CEC line, and instructs the audio amplifier 300 to prioritize the format of the encoded stream as the transmission format of the audio data. As a result, the audio amplifier 300 operates to transmit the audio stream as is to the television receiver 500, as will be described later.

[0121] 33, the audio amplifier 300 may or may not decode the audio stream. In either case, the audio stream is prioritized based on the priority information, allowing the audio encoded stream to reach the final destination receiving device.

[0122] The HDMI transmission unit 216 transmits the uncompressed video data obtained by the video decoder 214 and the audio stream that has been framed by the audio framing unit 215 from the HDMI terminal 217 using HDMI-compliant communication. The HDMI transmission unit 216 packs the video data and audio stream for transmission on the TMDS channel of HDMI and outputs them to the HDMI terminal 217. Details of this HDMI transmission unit 216 will be described later.

[0123] A brief description will be given of the operation of the set-top box 200. A television broadcast signal input to an antenna terminal 211 is supplied to a digital tuner 212. This digital tuner 212 processes the television broadcast signal and outputs a transport stream TS corresponding to the channel selected by the user.

[0124] The transport stream TS output from the digital tuner 212 is supplied to a demultiplexer 213. In this demultiplexer 213, packets of the video elementary stream are extracted from the transport stream TS and sent to a video decoder 214.

[0125] The video decoder 214 reconstructs a video stream from the video packets extracted by the demultiplexer 213, and then decodes the video stream to obtain uncompressed video data. This uncompressed video data is supplied to the HDMI transmission unit 216.

[0126] Furthermore, the demultiplexer 213 extracts audio stream packets from the transport stream TS and reconstructs an audio stream into which media access information (container target data) has been inserted. This audio stream is framed by an audio framing unit 215 and then supplied to an HDMI transmission unit 216. The HDMI transmission unit 216 then packs the uncompressed video data and audio stream and transmits them from an HDMI terminal 217 to the audio amplifier 300 via an HDMI cable 610.

[0127] [Audio amplifier configuration example] 18 shows an example configuration of an audio amplifier 300. The audio amplifier 300 has a CPU 301, a flash ROM 302, a DRAM 303, an internal bus 304, a remote control receiver 305, and a remote control transmitter 306. The audio amplifier 300 also has an HDMI terminal 311, an HDMI receiver 312, an audio decoder 313, an audio processing circuit 314, an audio amplifier circuit 315, an audio output terminal 316, an HDMI transmitter 317, and an HDMI terminal 318.

[0128] The CPU 301 controls the operation of each unit of the audio amplifier 300. The flash ROM 302 stores control software and data. The DRAM 303 constitutes a work area for the CPU 301. The CPU 301 loads software and data read from the flash ROM 302 onto the DRAM 303, starts up the software, and controls each unit of the audio amplifier 300.

[0129] A remote control receiving unit 305 receives a remote control signal (remote control code) transmitted from a remote control transmitter 306 and supplies it to a CPU 301. The CPU 301 controls each unit of the audio amplifier 300 based on the remote control code. The CPU 301, flash ROM 302, and DRAM 303 are connected to an internal bus 304.

[0130] The HDMI receiving unit 312 receives uncompressed video data and an audio stream supplied to the HDMI terminal 311 via an HDMI cable 610 through HDMI-compliant communication. As described above with respect to the set-top box 200 (see FIG. 17), media access information (container target data) is inserted into the audio stream. Details of this HDMI receiving unit 312 will be described later.

[0131] The audio decoder 313 performs decoding processing on the audio stream received by the HDMI receiving unit 212 to obtain uncompressed audio data (sound data) for a predetermined number of channels. The sound processing circuit 314 performs up / downmix processing as required depending on the configuration of the speaker system 400 (see FIG. 1) on the uncompressed audio data for a predetermined number of channels to obtain audio data for a required number of channels, and also performs necessary processing such as D / A conversion.

[0132] The audio amplifier circuit 315 amplifies the audio signals of each channel obtained by the audio processing circuit 314 and outputs the amplified signals to an audio output terminal 316. The audio output terminal 316 is connected to a speaker system 400.

[0133] The HDMI transmission unit 317 transmits the uncompressed video data and audio stream received by the HDMI reception unit 212 through HDMI-compliant communication from an HDMI terminal 318. To transmit on the TMDS channel of HDMI, the HDMI transmission unit 317 packs the uncompressed video data and audio stream and outputs them to the HDMI terminal 318. Details of this HDMI transmission unit 317 will be described later.

[0134] A brief description will be given of the operation of the audio amplifier 300 shown in Fig. 18. The HDMI receiving unit 312 receives uncompressed video data and audio streams transmitted from the set-top box 200 to the HDMI terminal 311 via the HDMI cable 610.

[0135] The audio stream received by the HDMI receiving unit 312 is supplied to the audio decoder 313. The audio decoder 313 decodes the audio stream to obtain uncompressed audio data for a predetermined number of channels. This audio data is supplied to the audio processing circuit 314.

[0136] In the audio processing circuit 314, the uncompressed audio data for the predetermined number of channels is subjected to the necessary up / downmixing process in accordance with the configuration of the speaker system 400 (see FIG. 1) to obtain audio data for the required number of channels, and the audio data is subjected to the necessary processes such as D / A conversion. The audio data for each channel output from the audio processing circuit 314 is amplified by an audio amplifier circuit 315 and output to an audio output terminal 316. Therefore, audio output for the predetermined number of channels is obtained from the speaker system 400 connected to the audio output terminal 316.

[0137] The uncompressed video data and audio stream received by the HDMI receiving unit 312 are supplied to the HDMI transmitting unit 317. Note that instead of the uncompressed video data itself received by the HDMI receiving unit 312, video data that has been subjected to processing such as superimposition of graphics data on this uncompressed video data may be supplied to the HDMI transmitting unit 317. The HDMI transmitting unit 317 packs this uncompressed video data and audio stream and transmits them from the HDMI terminal 318 to the television receiver 500 via the HDMI cable 620.

[0138] [Example of a TV receiver configuration] 19 shows an example of the configuration of a television receiver 500. This television receiver 500 has a CPU 501, a flash ROM 502, a DRAM 503, an internal bus 504, a remote control receiver 505, a remote control transmitter 506, and a communication interface 507.

[0139] The television receiver 500 also has an antenna terminal 511, a digital tuner 512, a demultiplexer 513, a video decoder 514, an HDMI terminal 515, and an HDMI receiving unit 516. The television receiver 500 also has a video processing circuit 517, a panel driving circuit 518, a display panel 519, an audio decoder 520, an audio processing circuit 521, an audio amplifier circuit 522, and a speaker 523.

[0140] The CPU 501 controls the operation of each unit of the television receiver 500. The flash ROM 502 stores control software and data. The DRAM 503 constitutes the work area of ​​the CPU 501. The CPU 501 loads software and data read from the flash ROM 502 onto the DRAM 503, starts up the software, and controls each unit of the television receiver 500.

[0141] The remote control receiving unit 505 receives a remote control signal (remote control code) transmitted from the remote control transmitter 506 and supplies it to the CPU 501. The CPU 501 controls each unit of the television receiver 500 based on the remote control code. The CPU 501, the flash ROM 502, and the DRAM 503 are connected to an internal bus 504.

[0142] The communication interface 507 communicates with a server on a network such as the Internet under the control of the CPU 501. The communication interface 507 is connected to the internal bus 504.

[0143] The antenna terminal 511 is a terminal for inputting a television broadcast signal received by a receiving antenna (not shown). The digital tuner 512 processes the television broadcast signal input to the antenna terminal 511 and outputs a transport stream TS corresponding to the channel selected by the user.

[0144] The demultiplexer 513 extracts video stream packets from the transport stream TS and sends them to the video decoder 514. The video decoder 514 reconstructs the video stream from the video packets extracted by the demultiplexer 513 and performs a decoding process to obtain uncompressed video data (image data).

[0145] The demultiplexer 513 also extracts audio stream packets from the transport stream TS and reconstructs the audio stream, into which media access information (container target data) has been inserted, as described above in connection with the stream generation unit 110 (see FIG. 3).

[0146] The HDMI receiving unit 516 receives uncompressed video data and an audio stream supplied to the HDMI terminal 515 via an HDMI cable 620 through HDMI-compliant communication. As described above with respect to the audio amplifier 300 (see FIG. 18), media access information (container target data) is inserted into the audio stream. Details of this HDMI receiving unit 516 will be described later.

[0147] The video processing circuit 517 performs scaling and compositing processes on the video data obtained by the video decoder 514 or the HDMI receiving unit 516, as well as video data received from a server on the Internet via the communication interface 507, to obtain video data for display.

[0148] The panel drive circuit 518 drives the display panel 519 based on the display image data obtained by the video processing circuit 517. The display panel 519 is configured, for example, with an LCD (Liquid Crystal Display), an organic EL display (organic electroluminescence display), or the like.

[0149] The audio decoder 520 decodes the audio stream obtained by the demultiplexer 513 or the HDMI receiving unit 516 to obtain uncompressed audio data (sound data). The audio decoder 520 also extracts a predetermined number of pieces of media access information (container target data) related to a series of media access controls that are sequentially inserted into the audio stream, and sends them to the CPU 501. The CPU 501 appropriately causes each unit of the television receiver 500 to perform processing using this media access information.

[0150] Here, the media access information is divided into a predetermined number (including 1) of audio frames of the audio stream and inserted, and information indicating the total size of the media access information (container target data) is added to the first division information, and information indicating whether it is the first division information or not and a descending count number as information indicating the division position are added to each division information.The audio decoder 520 obtains the media access information from the predetermined number of audio frames based on this information.

[0151] In this case, the audio decoder 520 can recognize the first segment information from the information indicating whether it is the first segment information, recognize the number of segments from the count number in descending order corresponding to the first segment information, and recognize the number of remaining segment information from the count number in descending order. Therefore, the audio decoder 520 can easily and appropriately obtain each segment information constituting the media access information from a predetermined number of audio frames.

[0152] In addition, the descending count number (1) allows the receiving side to detect if an error occurs in a transmission packet along the way, and (2) also allows the receiving side to know in advance the approximate time when the final divided packet will arrive.

[0153] Furthermore, since information indicating the total size of the media access information is added to the first division information, at the time the first division information is acquired, sufficient space can be secured in the memory (storage medium) to store the specified information based on the information indicating the total size of the media access information, making it possible to easily and appropriately perform the process of acquiring the media access information.

[0154] The audio processing circuit 521 performs necessary processing such as D / A conversion on the audio data obtained by the audio decoder 520. The audio amplification circuit 522 amplifies the audio signal output from the audio processing circuit 521 and supplies the amplified signal to a speaker 523.

[0155] The CPU 501 controls, for example, the communication interface 507 based on a predetermined number of pieces of media access information related to a series of media access controls acquired by the audio decoder 520. In this case, media data is acquired from a server on a network such as the Internet, and images are displayed and audio is output based on this media data. Specific examples of media access control will be described later.

[0156] The operation of the television receiver 500 shown in Fig. 19 will be briefly described. A television broadcast signal input to an antenna terminal 511 is supplied to a digital tuner 512. This digital tuner 512 processes the television broadcast signal to obtain a transport stream TS corresponding to the channel selected by the user.

[0157] The transport stream TS obtained by the digital tuner 512 is supplied to a demultiplexer 513. The demultiplexer 513 extracts video stream packets from the transport stream TS and supplies them to a video decoder 514. The video decoder 514 reconstructs a video stream from the video packets extracted by the demultiplexer 513 and performs a decoding process to obtain uncompressed video data. This uncompressed video data is supplied to a video processing circuit 517.

[0158] The demultiplexer 513 also extracts audio stream packets from the transport stream TS and reconstructs the audio stream. This audio stream is supplied to the audio decoder 520.

[0159] The HDMI receiving unit 516 receives uncompressed video data and an audio stream supplied to the HDMI terminal 515 via an HDMI cable 620 through HDMI-compliant communication. The uncompressed video data is supplied to a video processing circuit 517. The audio stream is supplied to an audio decoder 520.

[0160] The video processing circuit 517 performs scaling and compositing processes on the video data obtained by the video decoder 514 or the HDMI receiving unit 516, as well as video data received from a server on the Internet via the communication interface 507, to obtain video data for display.

[0161] The display video data obtained by the video processing circuit 517 is supplied to a panel driving circuit 518. The panel driving circuit 518 drives a display panel 519 based on the display video data, causing the display panel 519 to display an image corresponding to the display video data.

[0162] The audio decoder 520 decodes the audio stream obtained by the demultiplexer 513 or the HDMI receiving unit 516 to obtain uncompressed audio data. The audio data obtained by the audio decoder 520 is supplied to an audio processing circuit 521. The audio processing circuit 521 performs necessary processing such as D / A conversion on the audio data. This audio data is amplified by an audio amplifier circuit 522 and then supplied to a speaker 523. Therefore, audio corresponding to the image displayed on the display panel 519 is output from the speaker 523.

[0163] The audio decoder 520 also extracts a predetermined number of pieces of media access information (container target data) related to a series of media access controls, which are sequentially inserted into the audio stream. The media access information extracted by the audio decoder 520 is sent to the CPU 501. The CPU 501 controls, for example, the communication interface 507 based on this media access information. This allows media data to be acquired from a server on a network such as the Internet, and images and audio are displayed based on this media data.

[0164] [Example of HDMI transmitter and receiver configuration] Fig. 20 shows an example configuration of the HDMI transmitting unit 216 (see Fig. 17) of the set-top box 200 and the HDMI receiving unit 312 (see Fig. 18) of the audio amplifier 300 in the transmission / reception system 10 of Fig. 1. Note that the example configurations of the HDMI transmitting unit 317 (see Fig. 18) of the audio amplifier 300 and the HDMI receiving unit 516 (see Fig. 19) of the television receiver 500 are similar, and therefore description thereof will be omitted.

[0165] During an active image interval 21 (hereinafter also referred to as an "active video interval" as appropriate) (see FIG. 21 ), which is the interval from one vertical synchronization signal to the next, excluding horizontal blanking interval 22 and vertical blanking interval 23, the HDMI transmission unit 216 unidirectionally transmits differential signals corresponding to pixel data of one uncompressed screenful of image over multiple channels to the HDMI reception unit 312. Furthermore, during the horizontal blanking interval 22 or vertical blanking interval 23, the HDMI transmission unit 216 unidirectionally transmits differential signals corresponding to at least audio data, control data, other auxiliary data, etc. accompanying the image over multiple channels to the HDMI reception unit 312.

[0166] That is, the HDMI sending unit 216 has an HDMI transmitter 31. The transmitter 31 converts, for example, pixel data of an uncompressed image into a corresponding differential signal, and transmits the signal serially in one direction to the HDMI receiving unit 312 over three TMDS (Transition Minimized Differential Signaling) channels #0, #1, and #2, which are multiple channels.

[0167] In addition, the transmitter 31 converts audio data accompanying the uncompressed images, as well as necessary control data and other auxiliary data, into corresponding differential signals and transmits them serially in one direction to the HDMI receiving unit 312 via three TMDS channels #0, #1, and #2.

[0168] The HDMI receiving unit 312 receives differential signals corresponding to pixel data transmitted unidirectionally over multiple channels from the HDMI transmitting unit 216 during the active video interval 21 (see FIG. 21). The HDMI receiving unit 312 also receives differential signals corresponding to audio data or control data transmitted unidirectionally over multiple channels from the HDMI transmitting unit 216 during the horizontal blanking interval 22 (see FIG. 21) or the vertical blanking interval 23 (see FIG. 21).

[0169] The transmission channels of the HDMI system consisting of the HDMI transmitter 216 and the HDMI receiver 312 include three TMDS channels #0 to #2 as transmission channels for transmitting pixel data and audio data, a TMDS clock channel as a transmission channel for transmitting a pixel clock, as well as transmission channels called a DDC (Display Data Channel) 33 and a CEC (Consumer Electronics Control) line 34.

[0170] The DDC 33 is made up of two signal lines included in the HDMI cable 610, and is used by the HDMI transmitter 216 to read EDID (Extended Display Identification Data) from the HDMI receiver 312 connected via the HDMI cable 610. That is, the HDMI receiver 312 has, in addition to the HDMI receiver 32, an EDID ROM (Read Only Memory) that stores EDID, which is performance information related to its own performance (configuration and capability). When the HDMI transmitter 216 reads the EDID, decoding capability information on the receiving side is sent to the transmitting side.

[0171] The HDMI transmitter 216 reads the EDID from the HDMI receiver 312 connected via the HDMI cable 610 via the DDC 33. Then, the CPU 201 of the set-top box 200 recognizes the performance of the audio amplifier 300 having the HDMI receiver 312 based on the EDID.

[0172] The CEC line 34 is made up of one signal line included in the HDMI cable 610, and is used for bidirectional communication of control data between the HDMI transmitter 216 and the HDMI receiver 312. The HDMI cable 610 also includes an HPD (Hot Plug Detect) line 35 that is connected to a pin called HPD.

[0173] The source device can detect the connection of the sink device (destination device) using this HPD line 35 based on the DC bias potential. In this case, from the source device's perspective, the HPD line 35 has the function of receiving notification of the connection status from the sink device based on the DC bias potential. On the other hand, from the sink device's perspective, the HPD line has the function of notifying the source device of the connection status based on the DC bias potential. The HDMI cable 610 also includes a power line 36 used to supply power from the source device to the sink device.

[0174] Furthermore, the HDMI cable 610 includes a reserved line 37. There is an HDMI Ethernet Channel (HEC) that transmits Ethernet signals using the HPD line 35 and the reserved line 37. There is also an Audio Return Channel (ARC) that transmits audio data from a destination device (sink device) to a source device using both the HPD line 35 and the reserved line 37 or only the HPD line 35. Note that "Ethernet" is a registered trademark.

[0175] 21 shows various transmission data periods when image data of 1920 pixels wide x 1080 lines high is transmitted in a TMDS channel. The video field in which data is transmitted in the three TMDS channels of HDMI has three types of periods depending on the type of transmission data: a video data period 24, a data island period 25, and a control period 26.

[0176] Here, the video field interval is the interval from the rising edge of one vertical synchronization signal (active edge) to the rising edge of the next vertical synchronization signal, and is divided into a horizontal blanking interval 22, a vertical blanking interval 23, and an active pixel interval 21 (active video), which is the interval from the video field interval excluding the horizontal blanking interval and vertical blanking interval.

[0177] The video data section 24 is allocated to the active pixel section 21. In this video data section 24, data of 1920 pixels (picture elements) x 1080 lines of active pixels (active pixels) constituting one screen's worth of uncompressed image data is transmitted. The data island section 25 and control section 26 are allocated to the horizontal blanking interval 22 and vertical blanking interval 23. In this data island section 25 and control section 26, auxiliary data is transmitted.

[0178] That is, the data island section 25 is allocated to a part of the horizontal blanking interval 22 and the vertical blanking interval 23. In this data island section 25, data not related to control among the auxiliary data, such as audio data packets, is transmitted. The control section 26 is allocated to another part of the horizontal blanking interval 22 and the vertical blanking interval 23. In this control section 26, data related to control among the auxiliary data, such as vertical and horizontal synchronization signals, control packets, etc., is transmitted.

[0179] [Media access control example] 22 shows an example of media access control. Media access information "data1" is divided and inserted into three audio frames of the audio stream and transmitted. Upon receiving these three audio frames, the entire media access information "data1" is stored in a buffer within the audio decoder 520 and then transmitted to the CPU 501.

[0180] This media access information "data1" includes "ID tables", "URL", "period1", "notification 'preparing'", "information_id1", "reference TC = TC1", and "UTC1", as shown in Figure 23(a).

[0181] When this media access information "data1" is received, as shown in Figure 22(a), a rectangular message field 701 is provided on the screen of display panel 519, and for example, "preparing" is displayed, notifying the user that media access is being prepared.

[0182] After that, the media access information "data2" is sent as divided and inserted into three audio frames of the audio stream. Upon receiving these three audio frames, the entire media access information "data2" is stored in a buffer within the audio decoder 520 and then sent to the CPU 501.

[0183] As shown in FIG. 23(b), this media access information "data2" includes "URL", "period2", "notification'preparing'", "information_id2", "reference TC = TC2", and "UTC1". The identification information "information_id" in this media access information "data2" is "information_id2", which is different from the "information_id1" in the media access information "data1". This enables CPU 501 to determine that media access information "data2" is not related to media access information "data1".

[0184] When this media access information "data2" is received, as shown in Figure 22(b), a rectangular message field 702 is further provided on the screen of display panel 519, and for example, "preparing" is displayed, notifying the user that media access is being prepared.

[0185] After that, media access information "data3" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data3" is captured in a buffer within audio decoder 520 and then sent to CPU 501.

[0186] As shown in FIG. 23(c), this media access information "data3" includes "action command 'autostart'", "notification 'access ready'", "information_id1", and "offset time = oft1". The identification information "information_id" in this media access information "data3" is "information_id1", which is the same as "information_id1" in media access information "data1". This enables CPU 501 to determine that media access information "data3" is associated with media access information "data1".

[0187] The action command "autostart" indicated by "action command 'autostart'" is activated when the offset time indicated by "offset time = oft1" in the media access information "data3" has elapsed from the reference time indicated by the reference time code "reference TC = TC1" in the media access information "data1".

[0188] At this time, the "URL" of the media access information "data1" is used to access a server on the Internet. At this time, the "ID tables" and "period1" information of the media access information "data1" are also sent to the server. Note that these "ID tables" include the application ID (applicatio_id), network ID (network_id), transport ID (transport_id), service ID (service_id), and also the organization ID (organization_id) (see Figure 6).

[0189] By sending the "ID tables" information in this way, the server is informed that the access is authorized. Also, by sending the "period1" information, the server plays back the media data portion of the audio stream corresponding to the scene indicated by "period1" and sends it to the television receiver 500.

[0190] When the action command "autostart" for media access information "data3" is activated in this way, as shown in Fig. 22(c), a message such as "access ready" is displayed in rectangular message field 701 on the screen of display panel 519, informing the user that media access is in progress. In addition, a new rectangular display field 703 is provided on the screen of display panel 519, and media data sent from the server, in this case an image of video data, is displayed in this display field 703. Rectangular message field 702 is then erased at a predetermined timing.

[0191] In addition, if the current time (UTC) corresponding to the point in time when the offset time has elapsed from the reference time is later than the time indicated by "UTC1" in the media access information "data1", the time limit is considered to have expired and the action command "autostart" is not activated.

[0192] After that, media access information "data4" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data4" is captured in a buffer within audio decoder 520 and then sent to CPU 501.

[0193] As shown in FIG. 23(d), this media access information "data4" includes "action command 'autostart'", "notification 'access ready'", "information_id2", and "offset time = oft2". The identification information "information_id" in this media access information "data4" is "information_id2", which is the same as "information_id2" in media access information "data2". This enables CPU 501 to determine that media access information "data4" is associated with media access information "data2".

[0194] The action command "autostart" indicated by "action command 'autostart'" is activated when the offset time indicated by "offset time = oft2" in the media access information "data4" has elapsed from the reference time indicated by the reference time code "reference TC = TC2" in the media access information "data2".

[0195] At this time, the "URL" of the media access information "data2" is used to access a server on the Internet. At this time, the "period2" information of the media access information "data2" is also sent to the server. By sending the "period2" information in this way, the server plays back the media data portion of the audio stream corresponding to the scene indicated by "period2", and sends it to the television receiver 500.

[0196] When the action command "autostart" for media access information "data4" is activated in this way, as shown in Fig. 22(d), a message such as "access ready" is displayed in rectangular message field 702 on the screen of display panel 519, informing the user that media access is in progress. Also, a new rectangular display field 704 is provided on the screen of display panel 519, and images of media data sent from the server, in this case video data, are displayed in this display field 704. Rectangular message field 702 is then erased.

[0197] Here, if the current time (UTC) corresponding to the point in time when the offset time has elapsed from the reference time is later than the time indicated by "UTC1" in the media access information "data2", the time limit is considered to have expired and the action command "autostart" is not activated.

[0198] 22 and 23, the media access information "data3" and "data4" containing action commands contain offset time information "offset time = oft1" and "offset time = oft2". However, by using the "target_segment_id" information indicating the "segment_id" of the media access information that specifies the offset time, it is also possible to include the offset time information "offset time = oft1" and "offset time = oft2" in the media access information "data1" and "data2".

[0199] 24(a), (b), (c), and (d) show the information contained in the media access information "data1," "data2," "data3," and "data4" in this case. That is, as shown in FIG. 24(a), the media access information "data1" contains "ID tables," "URL," "period1," "notification'preparing'," "information_id1," "segment#1," "reference TC = TC1," "offsettime = oft1," "target_segment_id = segment#3," and "UTC1."

[0200] In addition, the media access information "data2" includes "URL", "period2", "notification'preparing'", "information_id2", "segment#2", "reference TC = TC2", "offsettime = oft2", "target_segment_id = segment#4", and "UTC1", as shown in Figure 24(b).

[0201] Furthermore, the media access information "data3" includes "action command 'autostart'", "notification 'access ready'", "information_id1", and "segment #3", as shown in Figure 24(c). Furthermore, the media access information "data4" includes "action command 'autostart'", "notification 'access ready'", "information_id2", and "segment #4", as shown in Figure 24(d).

[0202] 25 shows another example of media access control. Media access information "data1" is divided and inserted into three audio frames of the audio stream and transmitted. Upon receiving these three audio frames, the entire media access information "data1" is stored in a buffer within the audio decoder 520 and then transmitted to the CPU 501.

[0203] This media access information "data1" includes "ID tables", "UI selection process", "notification 'preparing'", "information_id1", "reference TC = TC1", and "UTC1", as shown in Figure 26(a).

[0204] 25(a), when this media access information "data1" is received, a rectangular message field 801 is provided on the screen of display panel 519, and for example, "preparing" is displayed, notifying the user that preparation for user selection is in progress. Also, this screen displays multiple thumbnail images 802 to allow the user to select playback media based on the information in the "UI selection process."

[0205] After that, the media access information "data2" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data2" is captured in a buffer within the audio decoder 520 and then sent to the CPU 501.

[0206] As shown in FIG. 26(b), this media access information "data2" includes "action command 'user selected'", "notification 'user selected'", "information_id1", and "offset time = oft1". The identification information "information_id" in this media access information "data2" is "information_id1", which is the same as "information_id1" in the media access information "data1". This enables CPU 501 to determine that media access information "data2" is related to media access information "data1".

[0207] When the offset time indicated by "offset time = oft1" in the media access information "data2" has elapsed from the reference time indicated by the reference time code "reference TC = TC1" in the media access information "data1," the action command "user selected" indicated by "action command 'user selected'" is activated, and playback media can be selected by selecting a specified thumbnail.

[0208] At this time, as shown in Fig. 25(b), for example, 'user selected' is displayed in rectangular message field 801 on the screen of display panel 519, informing the user that playback media can now be selected. Note that Fig. 25(b) shows that thumbnail 802a has been selected by the user and its display state has changed. After the user has finished selecting playback media in this way, rectangular message field 801 and the thumbnail display are erased at a predetermined timing.

[0209] Note that if the current time (UTC) corresponding to the offset time from the reference time is later than the time indicated by "UTC1" in the media access information "data1", the time has expired and the action command "user selected" is not activated.

[0210] After that, the media access information "data3" is sent as divided and inserted into three audio frames of the audio stream. Upon receiving these three audio frames, the entire media access information "data3" is stored in a buffer within the audio decoder 520 and then sent to the CPU 501.

[0211] As shown in FIG. 26(c), this media access information "data3" includes "URL", "notification'preparing'", "information_id1", "reference TC = TC2", and "UTC1". The identification information "information_id" in this media access information "data3" is "information_id1", which is the same as the "information_id1" in the media access information "data1" and "data2". This enables CPU 501 to determine that media access information "data3" is related to media access information "data1" and "data2".

[0212] When this media access information "data3" is received, as shown in Figure 25(c), a rectangular message field 803 is further provided on the screen of display panel 519, and for example, "preparing" is displayed, notifying the user that media access is being prepared.

[0213] After that, media access information "data4" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data4" is captured in a buffer within audio decoder 520 and then sent to CPU 501.

[0214] As shown in FIG. 26(d), this media access information "data4" includes "action command 'autostart'", "notification 'access ready'", "information_id1", and "offset time = oft2". The identification information "information_id" in this media access information "data4" is "information_id1", which is the same as the "information_id1" in the media access information "data1", "data2", and "data3". This enables CPU 501 to determine that media access information "data4" is associated with media access information "data1", "data2", and "data3".

[0215] The action command "autostart" indicated by "action command 'autostart'" is activated when the offset time indicated by "offset time = oft2" in the media access information "data4" has elapsed from the reference time indicated by the reference time code "reference TC = TC2" in the media access information "data3".

[0216] At this time, the "URL" of the media access information "data3" is used to access a server on the Internet. At this time, the "ID tables" and "period1" information of the media access information "data1" are also sent to the server, along with the ID "select_ID" representing the user selection result related to the media access information "data2."

[0217] In this way, by sending the information of "ID tables," the server is informed that the access is authorized. In addition, by sending the information of "select_ID" and "period1," the server plays back the media data portion of the playback media selected by the user that corresponds to the scene indicated by "period1" of the audio stream, and sends the media data to the television receiver 500.

[0218] When the action command "autostart" for media access information "data4" is activated in this way, as shown in Fig. 25(d), a message such as "access ready" is displayed in rectangular message field 803 on the screen of display panel 519, informing the user that media access is in progress. In addition, a new rectangular display field 804 is provided on the screen of display panel 519, and media data sent from the server, in this case an image of video data, is displayed in display field 804. Rectangular message field 803 is then erased at a predetermined timing.

[0219] Note that if the current time (UTC) corresponding to the offset time from the reference time is later than the time indicated by "UTC1" in the media access information "data3", the time has expired and the action command "autostart" is not activated.

[0220] 25 and 26, the media access information "data2" and "data4" containing action commands contain offset time information "offset time = oft1" and "offset time = oft2". However, by using the "target_segment_id" information indicating the "segment_id" of the media access information that specifies the offset time, it is also possible to include the offset time information "offset time = oft1" and "offset time = oft2" in the media access information "data1" and "data3".

[0221] "Example of checking the source of media data" As mentioned above, the universal metadata frame (see Figure 6) contains a 32-bit field called "organization_id." This field indicates an identification value that is uniquely assigned to each service transmitted in the user data area, or to the provider or standard organization of this service (e.g., "ATSC," "DVB," etc.). This "organization_id" can be used as check information to check the provider of media data obtained using media access information.

[0222] An example of checking the provider of media data using "organization_id" will be described using the service system of Fig. 27. In Fig. 27, a television receiver 500 is connected to the Internet. Also connected to the Internet are a server A and a server B. In this example, the television receiver 500 accesses server A using URL 1 supplied by a broadcast service from broadcast wave A directly or via set-top box 200, and receives an application (media data) linked to broadcast A via the Internet.

[0223] URL1 is supplied to the television receiver 500 via broadcast wave A. An "organization_id" is added to this URL1. The television receiver 500 accesses server A using URL1. Server A performs authentication processing for the access from the television receiver 500 and returns an Ack response to the television receiver 500, and also notifies server B of URL2 of the IP address of the television receiver 500 via inter-server access to cooperate, and transfers the access from the television receiver 500 to server B.

[0224] Server B transmits media playback related information to the television receiver 500. This media playback related information is, for example, image information of a plurality of thumbnails that allows the user to select playback media. The television receiver 500 checks the provider of the media playback related information to see if it is from the same service organization as the "organization_id" received from broadcast wave A, and then sends a media playback command to server B.

[0225] The television receiver 500 performs this provider check, for example, as follows. That is, the television receiver 500 recognizes from a table or the like the characters associated with the identification value indicated by the "organization_id" received from the A broadcast wave, in this case "ATSC_ch5_net_sports." Note that the characters "ATSC_ch5_net_sports" may be associated with URL1 received from the A broadcast wave together with the "organization_id."

[0226] The television receiver 500 checks the provider by checking whether the media playback related information sent from server B to the television receiver 500 contains the words "ATSC_ch5_net_sports" or whether the information obtained by accessing a URL (e.g., http: / / service.organization.information) included in the media playback related information contains the words "ATSC_ch5_net_sports."

[0227] After checking the provider to confirm that the provider is valid, the television receiver 500 sends a media playback command to server B as described above. Server B plays the media in accordance with the media playback command and transmits media playback data (media data) to the television receiver 500. The television receiver 500 performs output based on the media playback data, such as image display and audio output.

[0228] In the above example, "organization_id" is used as check information to check the provider of media data acquired using media access information. However, the check information is not limited to "organization_id", and other check information may be added to the media access information and used to check the provider.

[0229] As described above, in the transmission / reception system 10 shown in Fig. 1, the broadcast transmission device 100 sequentially inserts a predetermined number of related media access information for a series of media access controls into an audio stream (audio compressed data stream) and transmits the audio stream. This allows the receiving side to perform a series of media access controls successfully.

[0230] 1, the broadcast transmission device 100 is capable of dividing and inserting media access information into a predetermined number of audio frames of an audio stream (audio compression data stream). Therefore, even if the total size of the media access information is large, the size of the information inserted into each audio frame can be reduced, and the predetermined information can be transmitted satisfactorily without affecting the transmission of the audio compression data.

[0231] 1, the television receiver 500 acquires a predetermined number of pieces of media access information for media access control that are sequentially inserted into the audio stream along with the video data and audio data as the first media data, and acquires the second media data based on this media access information. This allows the second media data to be presented satisfactorily in correspondence with the presentation of the first media data.

[0232] 1, the broadcast transmission device 100 inserts information indicating that the encoded stream is to be given priority as the transmission format of audio data into the layer of the transport stream serving as a container. This enables the set-top box 200 and the audio amplifier 300 to give priority to the format of the encoded stream as the transmission format of audio data. This allows the media access information inserted in the audio stream to be reliably supplied to the television receiver 500.

[0233] 1, the broadcast transmission device 100 adds check information (such as "organization_id") to the media access information inserted into the audio stream (audio compressed data stream) or the transport stream as a container, for checking the provider of the media data obtained using this media access information. Therefore, on the receiving side, the provider of the media data obtained using the media access information can be simply and easily checked based on this check information.

[0234] <2. Modifications> In the above-described embodiment, the broadcast transmission device 100 sequentially inserts a predetermined number of pieces of media access information related to a series of media access controls into an audio stream (audio compressed data stream) and transmits the inserted information. However, it is also conceivable that the broadcast transmission device 100 sequentially inserts a predetermined number of pieces of media access information into other media streams such as a video stream and transmits the inserted information. It is also conceivable that the broadcast transmission device 100 sequentially inserts a predetermined number of pieces of media access information into layers of a transport stream TS as a container and transmits the inserted information.

[0235] In this case, Figure 28 shows an example of the configuration of the stream generation unit 110A provided in the broadcast transmission device 100. In Figure 27, parts corresponding to those in Figure 3 are given the same reference numerals, and detailed explanations thereof will be omitted where appropriate. This stream generation unit 110A has a control unit 111, a video encoder 112, an audio encoder 113A, and a multiplexer 114A.

[0236] The audio encoder 113A encodes the audio data SA in the MPEG-H 3D Audio compression format to generate an audio stream (audio compressed data stream). Unlike the audio encoder 113 in the stream generation unit 110 in Fig. 3, this audio encoder 113A does not insert media access information into the audio stream.

[0237] The video stream generated by the video encoder 112 is supplied to a multiplexer 114A. Also, the audio stream generated by the audio encoder 113A is supplied to the multiplexer 114A. Then, in this multiplexer 114A, the streams supplied from the respective encoders are packetized and multiplexed, and a transport stream TS is obtained as transmission data.

[0238] At this time, in the multiplexer 114A, a predetermined number of pieces of media access information related to a series of media access controls are sequentially inserted as container target data into the layer of the transport stream TS serving as a container under the control of the control unit 111. For example, in the multiplexer 114A, a newly defined application descriptor (Application_descriptor) having media access information is inserted under an application information table (AIT).

[0239] Figure 29 shows an example of the structure (Syntax) of an application descriptor. The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an application descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0240] The 8-bit field "data_id" indicates the ID of the media access information. It is the same information as the "data_id" field in the universal metadata frame (see Figure 6) described above. Following the "data_id" field is the Access Information Data (Access_information_data()) field (see Figures 7-9) which contains the media access information.

[0241] Figure 30 shows an example of the structure of a transport stream TS when an application descriptor (Application_descriptor) is inserted under the AIT. In this example, an audio stream (Audio coded stream) is inserted into the PES payload of the PES packet of the audio stream. However, access information data (Access_information_data()) containing media access information (container target data) is not inserted into this audio stream.

[0242] In addition to the PMT (Program Map Table), the transport stream TS also contains an AIT (Application Information Table), which contains an application identifier (Application_id) and an application descriptor (see Figure 29).

[0243] Figure 31 shows an example configuration of a set-top box 200A in which media access information is inserted into, for example, a layer of a transport stream TS serving as a container and transmitted, as described above. In Figure 31, parts corresponding to those in Figure 17 are given the same reference numerals, and detailed descriptions thereof will be omitted where appropriate. The set-top box 200A includes a CPU 201, a flash ROM 202, a DRAM 203, an internal bus 204, a remote control receiver 205, and a remote control transmitter 206. The set-top box 200A also includes an antenna terminal 211, a digital tuner 212, a demultiplexer 213A, a video decoder 214, a data inserter 218, an audio framing unit 215, an HDMI transmitter 216, and an HDMI terminal 217.

[0244] The demultiplexer 213 extracts audio stream packets from the transport stream TS and reconstructs the audio stream (audio compressed data stream). The demultiplexer 213A also extracts various descriptors from the transport stream TS and sends them to the CPU 201. These descriptors include an application descriptor (see FIG. 29) that has media access information.

[0245] The audio stream extracted by the demultiplexer 213A is supplied to the data insertion unit 218. Predetermined information is supplied to this data insertion unit 218 from the CPU 201. Under the control of the CPU 201, the data insertion unit 218 inserts media access information into the audio stream.

[0246] In this case, similar to the audio encoder 113 of the stream generating unit 110 in Fig. 3, the media access information is divided and inserted into a predetermined number (including 1) of audio frames of the audio stream (see Figs. 13-15). At this time, information indicating the total size of the media access information is added to the first division information. In addition, information indicating whether it is the first division information or not and a count number in descending order as information indicating the division position are added to each division information.

[0247] In this case, the number of divisions is determined so that the bit rate of the audio stream into which the media access information has been inserted falls within the transmission bandwidth capacity range of HDMI. As a result, depending on the overall size of the media access information, the entire media access information may be inserted into one audio frame without being divided.

[0248] The audio stream into which the media access information from the data inserting unit 218 has been inserted is framed by the audio framing unit 215 and then supplied to the HDMI transmitting unit 216. The set-top box 200A shown in Fig. 31 is otherwise configured in the same manner as the set-top box 200 shown in Fig. 17.

[0249] In addition, when the media access information is transmitted, for example, inserted into the layer of a transport stream TS as a container, as described above, in the television receiver 500 shown in Figure 19, the demultiplexer 513 extracts the application descriptor (see Figure 29) containing the media access information, making it possible to use the media access information.

[0250] Furthermore, in the above-described embodiment, the set-top box 200 is configured to receive a video stream and an audio stream from a broadcast signal sent from the broadcast transmission device 100. However, the set-top box 200 may also be configured to receive a video stream and an audio stream from a distribution server (streaming server) via a network.

[0251] In the above-described embodiment, an example was shown in which the container was a transport stream (MPEG-2 TS). However, the present technology can be similarly applied to systems that deliver data in containers of MP4 or other formats. For example, this includes an MPEG-DASH-based stream delivery system or a transmission / reception system that handles an MMT (MPEG Media Transport) structured transmission stream.

[0252] 32 shows an example of the structure of an MMT stream when media access information (container target data) is inserted into an audio stream and sent. The MMT stream contains MMT packets for each asset, such as video and audio. In this example structure, an MMT packet for an audio asset identified by ID2 exists along with an MMT packet for a video asset identified by ID1.

[0253] Access information data (Access_information_data()) containing media access information is inserted into the universal metadata frame (universal_metadata_frame()) in a predetermined number (including 1) of audio frames of an audio asset (audio stream).

[0254] Additionally, MMT streams contain message packets such as PA (Packet Access) message packets. PA message packets contain tables such as the MMT Packet Table. MP tables contain information for each asset. In this case, audio asset information also includes an audio streaming descriptor (see Figure 12(a)).

[0255] Figure 33 shows an example structure of an MMT stream when media access information (container target data) is inserted into a container and sent. The MMT stream contains MMT packets for each asset, such as video and audio. In this example structure, an MMT packet for an audio asset identified by ID2 exists along with an MMT packet for a video asset identified by ID1. In this example structure, unlike the example structure of Figure 31, media access information is not included in the audio asset (audio stream).

[0256] Additionally, MMT streams contain message packets such as PA (Packet Access) message packets. PA message packets contain the MMT Packet Table (MPT: MMT Package Table), among other things. The MPT contains information for each asset. PA message packets also contain an Application Information Table (AIT). An application descriptor (Application_descriptor) containing access information data (Access_information_data()) is inserted under this AIT.

[0257] Although the above-described embodiment has been described by way of example in which the audio compression format is MPEG-H 3D Audio, the present technology can also be applied to other audio compression formats such as AAC, AC3, and AC4.

[0258] Figure 34(a) shows the structure of the AC4 Simple Transport layer. There are a sync word field, a frame length field, a "RawAc4Frame" field as an encoded data field, and a CRC field. As shown in Figure 34(b), the "RawAc4Frame" field starts with a TOC (Table Of Contents) field, followed by a predetermined number of substream fields.

[0259] As shown in Figure 35(b), the substream (ac4_substream_data()) contains a metadata area (metadata), which contains the "umd_payloads_substream()" field. Universal data (universal_data()) is placed in the "umd_payload_byte" field within this "umd_payloads_substream()" field.

[0260] Figure 36 shows an example of the universal data structure (syntax), and Figure 37 shows the main information content (semantics) in that structure example. The 1-bit field of "start_flag" indicates whether or not this is the start of the container target data. "1" indicates that it starts from this packet, and "0" indicates that this packet is not the start. The 7-bit field of "fcounter" indicates the division position of the divided container target data in descending order as a count number. "0" indicates the last divided part. If "start_flag" is "1" and "fcounter" is "0", it indicates that it is not divided.

[0261] When "start_flag" is "1", there is a 32-bit field for "organization_id" and a 16-bit field for "target_data_size". The "organization_id" field indicates an identification value uniquely assigned to each service transmitted in the user data area, or to the provider or standards organization of this service (e.g., "ATSC", "DVB", etc.). The "target_data_size" field indicates the data size of the container target data before division in bytes. The whole or part of the access information data (Access_information_data()) (see Figure 7) is inserted into the "data_payload_byte" field.

[0262] Also, if the audio compression format is AC4, an AC4 data container descriptor (AC4_datacontainer_desucriptor) is inserted into the container layer.

[0263] Figure 38 shows an example of the structure (syntax) of an AC4 data container descriptor, and Figure 39 shows the main information content (semantics) of that structure example. The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an application descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0264] The 1-bit field "umd_payload_embedded" indicates whether a UMD payload has been inserted. "1" indicates that a UMD payload has been inserted, and "0" indicates that a UMD payload has not been inserted. When "umd_payload_embedded" is "1", the 5-bit field "umd_payload_id" and the 11-bit field "audio_stream_rate" exist.

[0265] The "umd_payload_id" field indicates the identification value of the UMD payload. A specific value is defined as this identification value. For example, "7" indicates a universal data container format. The "audio_stream_rate" field indicates the delivery bit rate of the audio stream.

[0266] Figure 40 shows an example structure of an MPEG-2 TS transport stream when the audio compression format is AC4. In this example structure, the portion related to the video stream is omitted. In this example structure, there is a PES packet "audio PES" for the audio stream identified by PID2. The PES packet consists of a PES header (PES_header) and a PES payload (PES_payload). DTS and PTS timestamps are inserted in the PES header.

[0267] An audio stream (Audio coded stream) is inserted into the PES payload of the PES packet of the audio stream. Access information data (Access_information_data()) (see Figures 7 to 9) containing media access information (container target data) is inserted into the universal metadata (universal_metadata()) in a predetermined number of substreams (including 1) of this audio stream.

[0268] Additionally, an MPEG-2 TS transport stream contains a PMT (Program Map Table) as PSI (Program Specific Information). The PSI is information that describes which program each elementary stream in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program.

[0269] The PMT also contains an elementary stream loop that contains information related to each elementary stream. In this configuration example, there is an audio elementary stream loop (audio ES loop) that corresponds to the audio stream.

[0270] This audio elementary stream loop contains information such as the stream type and PID (packet identifier) ​​for each audio stream, as well as a descriptor describing information related to the audio stream. The value of the stream type "Stream_type" is set to "0x2C", and the PID information indicates PID1, which is assigned to the PES packet "audio PES" of the audio stream, as described above. One of the descriptors contained therein is the AC4 data container descriptor (see Figure 38).

[0271] Additionally, an MPEG-2 TS transport stream contains an Event Information Table (EIT). A component descriptor is placed under this EIT. This component descriptor describes that the service contains meta-information for network connection.

[0272] Figure 41 shows an example of the structure of an MMT transport stream when the audio compression format is AC4. In this example structure, the part related to the video asset (video stream) is omitted. In this example structure, there is an MMT packet for the audio asset (audio stream) identified by ID2.

[0273] Access information data (Access_information_data()) (see Figures 7-9) containing media access information (container target data) is inserted into universal metadata (universal_metadata()) in a predetermined number (including 1) of substreams of an audio asset (audio stream).

[0274] Additionally, MMT transport streams contain message packets such as PA (Packet Access) message packets. PA message packets contain tables such as the MP table (MPT: MMT Package Table). The MPT contains information such as asset type (Asset_type) and packet ID (Packet_id) corresponding to each audio asset, as well as a descriptor describing information related to that audio asset. One of these descriptors is the AC4 data container descriptor (see Figure 38) described above.

[0275] Additionally, an MMT transport stream contains an Event Information Table (EIT). A component descriptor is placed under this EIT. This component descriptor describes that the service contains meta-information for network connection.

[0276] Figure 42 shows an example of the structure of an MP4 stream (file) containing data of an audio track (track A) when the audio compression format is AC4. The example shown is for a fragmented MP4. A predetermined number of movie fragments are placed in the MP4 stream, each of which consists of a "moof" box containing control information and an "mdat" box containing the media data itself. The "mdat" box contains fragments obtained by fragmenting the track data, so the control information placed in the "moof" box is control information related to that fragment.

[0277] In the "audio bitstream" MP4 stream corresponding to the audio track, a certain number of AC4 frames are placed in the "mdat" box of each movie fragment. Also, in this "audio bitstream" MP4 stream, a "traf" box exists within the "moof" box of each movie fragment, and within that box exists a "tfdt" box. This "tfdt" box contains the "baseMediaDecodeTime" decode time of the first access unit after the "moof" box.

[0278] Furthermore, the "moof" box contains a "tfdt" box, which contains an "sgpd" box, which in turn contains a "tscl" box. This "tscl" box contains the parameters "Audiostreamtype" and "Attribute". "Audiostreamtype = AC4" indicates that the audio compression format is AC4. "Attribute = soundumd" indicates that metadata (such as media access information) has been inserted into the AC4 track. Specifically, the contents of the AC4 Data Container Descriptor shown in Figure 38 above are described as "soundumd".

[0279] Fig. 43 shows an example of an MPD file description. Fig. 44 shows the contents of the main information in the description example. As is well known in the art, in an MPEG-DASH-based stream distribution system, a media stream (MP4 stream) and an MPD file as a metafile are transmitted to a receiving side via a communication network transmission path.

[0280] " <adaptationset mimetype=""audio / mp4”" group=""1”">" indicates that an adaptation set (AdaptationSet) exists for the audio stream, that the audio stream is provided in an MP4 file structure, and that group 1 is assigned to it. <supplementarydescriptor schemeiduri=""urn:brdcst:codecType”" value=""AC4” / ">" indicates that the codec of the audio stream is AC4. "schemeIdUri="urn:brdcst:codecType" indicates the type of codec. For example, "value" can be "mpegh", "AAC", "AC3", or "AC4".

[0281] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:coordinatedControl”" value=""false” / ">" indicates that the net connection information is supplied only by the stream of this adaptation set. "schemeIdUri="urn:brdcst:coordinatedControl" indicates whether the information required for net connection is supplied in a coordinated manner across multiple media streams. For example, when "value" is "true", it indicates that the net connection information is supplied in coordination with the streams of other adaptation sets. When "value" is "false", it indicates that the net connection information is supplied only by the stream of this adaptation set.

[0282] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:UMDContained”" value=""true” / ">" indicates that the audio stream contains metadata. "schemeIdUri="urn:brdcst:UMDContained" indicates whether the audio stream contains metadata. For example, when "value" is "true", it indicates that audio meta information is included. When "value" is "false", it indicates that audio meta information is not included.

[0283] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:metaInsertionFrequency”" value=""1” / ">" indicates that meta information is provided on an access unit basis. "schemeIdUri="urn:brdcst:metaInsertionFrequency" indicates how often meta information is provided on an access unit basis. For example, "1" indicates that one user data entry occurs in one access unit. "2" indicates that multiple user data entries occur in one access unit. "3" indicates that one or more user data entries occur during a period separated by a random access point.

[0284] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:type”value="netlink” / ">" indicates that the meta-service type is a net connection. "schemeIdUri="urn:brdcst:type" indicates the meta-service type. For example, when "value" is "netlink", it indicates that the meta-service type is a net connection.

[0285] In the above-described embodiment, an example has been shown in which the audio amplifier 300 is interposed between the set-top box 200 and the television receiver 500. However, a transmission / reception system 10A as shown in Fig. 45 may also be considered in which the set-top box 200 is directly connected to the television receiver 500.

[0286] In this transmission / reception system 10A, the set-top box 200 and the television receiver 500 are connected via an HDMI cable 610. In this case, the set-top box 200 is the source and the television receiver 500 is the destination. The audio amplifier 300 and the television receiver 500 are connected via an HDMI cable 620. In this case, the audio amplifier 300 is the source and the television receiver 500 is the destination.

[0287] In this case, uncompressed video data and an audio stream into which media access information (container target data) is inserted are transmitted via the HDMI digital interface from the set-top box 200 to the television receiver 500. The television receiver 500 also transmits the audio stream itself or decoded audio data to the audio amplifier 300 using the HDMI audio return channel.

[0288] In the above-described embodiment, the transmitting / receiving system 10 has the set-top box 200 and the television receiver 500. However, a configuration in which a monitor device, a projector, or the like is provided instead of the television receiver 500 is also conceivable. Also, a configuration in which a recorder with a receiving function, a personal computer, or the like is provided instead of the set-top box 200 is also conceivable.

[0289] In the above-described embodiment, the receiving devices are connected by wire using an HDMI digital interface. However, the present invention can of course be applied to cases where the devices are connected by wire using a digital interface similar to HDMI, or even when they are connected wirelessly.

[0290] In the above-described embodiment, the transmission / reception system 10 is shown in which the set-top box 200 receives the transport stream TS transmitted from the broadcast transmission device 100 via broadcast waves. However, as shown in Fig. 46, a transmission / reception system 10B is also possible in which the television receiver 500 directly receives the transport stream TS transmitted from the broadcast transmission device 100 via broadcast waves.

[0291] The present technology can also be configured as follows. (1) a transmitter for transmitting a container in a predetermined format including a media stream; an information insertion unit for sequentially inserting a predetermined number of pieces of media access information related to a series of media access controls into a layer of the media stream or a layer of the container; Transmitting device. (2) The above media access information includes identification information to distinguish it from other media access information. The transmitting device according to (1) above. (3) The above media access information includes identification information for associating it with other media access information. The transmitting device according to (1) or (2). (4) The media access information includes period information indicating a corresponding scene in the media stream. The transmitting device according to any one of (1) to (3). (5) The media access information includes user interface information for allowing the user to select playback media. The transmitting device according to any one of (1) to (3). (6) The above media access information includes time information for managing the activation of action commands. The transmitting device according to any one of (1) to (3). (7) The media access information includes absolute time information indicating the media playback deadline. The transmitting device according to any one of (1) to (3). (8) The above media access information includes notification information for informing the user of the status. The transmitting device according to any one of (1) to (3). (9) The information insertion unit is Each piece of division information obtained by dividing the media access portion can be inserted into a predetermined number of unit portions of the media stream. The transmitting device according to any one of (1) to (8). (10) the media stream is an audio compressed data stream; The information inserting unit inserts the division information into a user data area of ​​the audio frame as the unit part. The transmitting device according to (9) above. (11) a transmitting step of transmitting a container in a predetermined format including a media stream by a transmitting unit; an information insertion step of sequentially inserting a predetermined number of pieces of media access information related to a series of media access controls into a layer of the media stream or a layer of the container; Sending method. (12) a first acquisition unit that acquires first media data and sequentially acquires a predetermined number of pieces of media access information for a series of media access controls; a second acquisition unit that acquires second media data related to the first media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Media processing device. (13) The first acquisition unit a receiving unit for receiving a container in a predetermined format including a media stream; the media access information is inserted into a layer of the media stream or a layer of the container; The first acquisition unit a decoding processing unit that decodes the media stream to obtain the first media data; The media access information may be extracted from a layer of the media stream or a layer of the container. The media processing device according to (12) above. (14) The first acquisition unit a receiving unit that receives the video data as the first media data and the audio compressed data stream into which the media access information is inserted from an external device via a digital interface; a decoding processing unit that decodes the audio compressed data stream to obtain audio data as the first media data; an information extractor for extracting the media access information from the audio compressed data stream; The media processing device according to (12) above. (15) a first acquisition step of acquiring first media data by a first acquisition unit and sequentially acquiring a predetermined number of pieces of media access information related to the first media data for a series of media access controls; a second acquisition step of acquiring, by a second acquisition unit, second media data related to the first media data based on the media access information; a presentation processing step of performing a media presentation process using the first media data and the second media data; Media processing methods. (16) A receiving unit for receiving a container in a predetermined format including a media stream, a predetermined number of pieces of media access information related to a series of media access controls are sequentially inserted into a layer of the media stream or a layer of the container; a decoding processing unit that decodes the media stream to obtain first media data; an information extraction unit for extracting the media access information from a layer of the media stream or a layer of the container; a media data acquisition unit that acquires second media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Receiving device. (17) a receiving unit that receives, via a digital interface from an external device, a compressed audio data stream into which video data as first media data and a predetermined number of pieces of media access information for a series of media access controls are sequentially inserted; a decoding processing unit that decodes the audio compressed data stream to obtain audio data as the first media data; an information extractor for extracting the media access information from the audio compressed data stream; a media data acquisition unit that acquires second media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Receiving device. (18) a transmitting unit that transmits a container in a predetermined format including an audio encoded stream into which predetermined information is inserted; An information inserting unit that inserts information indicating that the coded stream is to be given priority as a transmission format for audio data into the layer of the container. Transmitting device. (19) The predetermined information is a predetermined number of related media access information for a series of media access controls. The transmitting device according to (18) above. (20) a transmitting step of transmitting, by a transmitting unit, a container in a predetermined format including an encoded audio stream in which predetermined information is inserted in a user data area; An information inserting step of inserting information indicating that the coded stream is to be given priority as a transmission format for audio data into the layer of the container. Sending method. (20) a transmitting unit that transmits a container in a predetermined format including a media stream; an information insertion unit that inserts media access information into the layer of the media stream or the layer of the container, together with check information for checking the provider of the media data acquired using the media access information; Transmitting device. (21) The above check information is An identification value uniquely assigned to an individual service according to the media access information, or to the provider or standard organization of the service. The transmitting device according to (21) above. (23) a transmitting step of transmitting a container in a predetermined format including a media stream by a transmitting unit; an information inserting step of inserting media access information into a layer of the media stream or a layer of the container together with check information for checking the provider of the media data acquired using the media access information; Sending method. (24) A media access information acquisition unit for acquiring media access information, check information for checking a provider of the media data acquired using the media access information is added to the media access information; a media data acquisition unit that acquires media data based on the media access information; The information processing device further includes a provider check unit that checks the provider of the acquired media data based on the check information. Media processing device. (25) A media access information acquisition step of acquiring media access information by a media access information acquisition unit, check information for checking a provider of the media data acquired using the media access information is added to the media access information; a media data acquisition step of acquiring media data based on the media access information; The method further includes a provider check step of checking the provider of the acquired media data based on the check information. Media processing methods.

[0292] The main feature of this technology is that it enables the receiving side to perform a series of media access controls well by sequentially inserting a predetermined number of related media access information for a series of media access controls into the media stream layer or the container layer and transmitting them (see Figures 6-11 and 16). [Explanation of symbols]

[0293] 10, 10A, 10B... Transmitting and receiving system 21. Effective pixel section 22 Horizontal blanking period 23 Vertical blanking period 24 Video data section 25 Data Island Section 26. Control Section 31···HDMI Transmitter 32···HDMI Receiver 33···DDC 34 CEC Line 35 HPD line 36 Power line 37 Reserve Line 100 Broadcast transmission device 110, 110A...Stream generation unit 111 Control unit 111a···CPU 112...Video Encoder 113,113A···Audio Encoder 113a Audio coding block 113b Audio Framing Section 114,114A···Multiplexer 200,200A···Set-top box (STB) 201 CPU 202 Flash ROM 203 DRAM 204 Internal Bus 205 Remote control receiver 206···Remote control transmitter 211 Antenna terminal 212···Digital Tuner 213, 213A Demultiplexer 214...Video decoder 215 Audio Framing Section 216···HDMI transmitter 217···HDMI terminal 218 Data insertion section 300···Audio amplifier (AMP) 301 CPU 302···Flash ROM 303 DRAM 304 Internal Bus 305 Remote control receiver 306···Remote control transmitter 311···HDMI terminal 312···HDMI receiver 313 Audio Decoder 314 Audio processing circuit 315 Audio amplifier circuit 316 Audio output terminal 317···HDMI transmitter 318···HDMI terminal 400···Speaker System (SP) 500···Television receiver (TV) 501 CPU 502 Flash ROM 503 DRAM 504 Internal Bus 505 Remote control receiver 506···Remote control transmitter 507···Communication Interface 511 Antenna terminal 512···Digital Tuner 513 Demultiplexer 514...Video Decoder 515···HDMI terminal 516···HDMI receiver 517···Video processing circuit 518 Panel drive circuit 519···Display panel 520 audio decoder 521 Audio processing circuit 522 Audio amplifier circuit 523···Speaker 610,620···HDMI cable< / supplementarydescriptor> < / supplementarydescriptor> < / supplementarydescriptor> < / supplementarydescriptor> < / supplementarydescriptor> < / adaptationset>

Claims

1. an acquisition unit for acquiring an audio stream; a decoding unit that performs a decoding process on the acquired audio stream to obtain uncompressed audio data; a processing unit that performs an upmixing process or a downmixing process on the audio data supplied from the decoding unit, The audio stream is composed of MPEG Audio Stream Packets, The MPEG audio stream packet is composed of a header and a payload. The payload includes "SYNC" corresponding to a synchronization start code, "Frame" which is the actual data of the 3D audio transmission data, and "Config" which indicates the configuration of the "Frame", The "Frame" includes channel-encoded data or object-encoded data that constitutes 3D audio transmission data, the object coded data is composed of coded sample data of SCE (Single Channel Element) and metadata for mapping the coded sample data to speakers located at arbitrary positions for rendering, The metadata is included as an extension element (Ext_element), A predetermined value (Value) is defined as the type (ExElementType) of the extension element (Ext_element), If the value is 0, the type of the extension element is "ID_EXT_ELE_FILL"; Information processing device.

2. the audio stream is included in a transport stream; The transport stream includes a descriptor that describes information related to the audio stream. The information processing device according to claim 1 .

3. The descriptor has an 8-bit field "descriptor_tag" which is information indicating the descriptor type of the descriptor. The information processing device according to claim 2 .

4. The descriptor has an 8-bit field "descriptor_length" which is information indicating the length or size of the descriptor. The information processing device according to claim 2 .

5. If the value is 1, the type of the extension element is "ID_EXT_ELE_MPEGS". The information processing device according to claim 1 .

6. If the value is 2, the type of the extension element is "ID_EXT_ELE_SAOC"; The information processing device according to claim 1 .

7. If the value is 3, the type of the extension element is "ID_EXT_ELE_AUDIOPREROLL". The information processing device according to claim 1 .

8. If the value is 4, the type of the extension element is "ID_EXT_ELE_UNI_DRC". The information processing device according to claim 1 .

9. If the value is 5, the type of the extension element is "ID_EXT_ELE_OBJ_METADATA". The information processing device according to claim 1 .

10. If the value is 6, the type of the extension element is "ID_EXT_ELE_SAOC_3D". The information processing device according to claim 1 .

11. If the value is 7, the type of the extension element is "ID_EXT_ELE_HOA"; The information processing device according to claim 1 .

12. Steps to get the audio stream, decoding the audio stream to obtain uncompressed audio data; performing an upmixing process or a downmixing process on the audio data, The audio stream is composed of MPEG Audio Stream Packets, The MPEG audio stream packet is composed of a header and a payload. The payload includes "SYNC" corresponding to a synchronization start code, "Frame" which is the actual data of the 3D audio transmission data, and "Config" which indicates the configuration of the "Frame", The "Frame" includes channel-encoded data or object-encoded data that constitutes 3D audio transmission data, the object coded data is composed of coded sample data of SCE (Single Channel Element) and metadata for mapping the coded sample data to speakers located at arbitrary positions for rendering, The metadata is included as an extension element (Ext_element), A predetermined value (Value) is defined as the type (ExElementType) of the extension element (Ext_element), If the value is 0, the type of the extension element is "ID_EXT_ELE_FILL"; Information processing methods.

13. Computer, an acquisition means for acquiring an audio stream; a decoding means for decoding the acquired audio stream to obtain uncompressed audio data; causing the audio signal processing unit to function as a processing unit that performs an upmixing process or a downmixing process on the audio data supplied from the decoding unit; The audio stream is composed of MPEG Audio Stream Packets, The MPEG audio stream packet is composed of a header and a payload. The payload includes "SYNC" corresponding to a synchronization start code, "Frame" which is the actual data of the 3D audio transmission data, and "Config" which indicates the configuration of the "Frame", The "Frame" includes channel-encoded data or object-encoded data that constitutes 3D audio transmission data, the object coded data is composed of coded sample data of SCE (Single Channel Element) and metadata for mapping the coded sample data to speakers located at arbitrary positions for rendering, The metadata is included as an extension element (Ext_element), A predetermined value (Value) is defined as the type (ExElementType) of the extension element (Ext_element), If the value is 0, the type of the extension element is "ID_EXT_ELE_FILL"; program.

Images