Information Processing Apparatus and Information Processing Method

Abstract

To be capable of preferably performing a series of media access controls on a reception side.SOLUTION: A container of a predetermined format including a media stream is transmitted. A predetermined number of sets of media access information associated with a series of media access controls are successively inserted in a layer of the media stream or a layer of the container. For example, the media access information includes identification information for making a distinction between other media access information, and identification information for making an association with the other media access information.SELECTED DRAWING: Figure 16

Description

[Technical field]

[0001] The present technology relates to a transmitting device, a transmitting method, a media processing device, a media processing method, and a receiving device, and in particular to a transmitting device that transmits media access information together with a media stream such as video or audio. [Background technology]

[0002] For example, Patent Document 1 proposes that predetermined information is inserted into an audio compressed data stream from a broadcasting station, distribution server, etc. and transmitted, and that a set-top box on the receiving side transmits this audio compressed data stream directly to a television receiver via an HDMI digital interface, and that the television receiver performs information processing using the predetermined information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-010311 A Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present technology is to enable a series of media access controls to be performed effectively on the receiving side. [Means for solving the problem]

[0005] The concept of this technology is as follows: a stream sending unit that sends a container in a predetermined format including a media stream; An information insertion unit for sequentially inserting a predetermined number of pieces of media access information related to a series of media access controls into a layer of the media stream or a layer of the container. Located in the transmitting device.

[0006] In this technology, a transmitting unit transmits a container in a predetermined format including a media stream, and an information inserting unit sequentially inserts a predetermined number of related media access information for a series of media access controls into a layer of the media stream or a layer of the container.

[0007] For example, the media access information may include identification information for distinguishing the media access information from other media access information. This identification information makes it easy for the receiving side to distinguish between the media access information.

[0008] Also, for example, the media access information may include identification information for associating the media access information with other media access information, which makes it easy for the receiving side to check the associated media access information.

[0009] Also, for example, the media access information may include duration information indicating a corresponding scene in the media stream, which makes it easy for a receiving side to obtain media data related to the corresponding scene in the media stream.

[0010] Also, for example, user interface information for allowing a user to select a playback medium may be included. This user interface information enables the receiving side to allow the user to select a desired playback medium.

[0011] Also, for example, the media access information may include time information for managing the activation of an action command. This time information enables flexible management of the activation timing of an action command.

[0012] Furthermore, for example, the media access information may include absolute time information indicating a time limit for media playback. This absolute time information makes it possible to set a time limit for media playback on the receiving side.

[0013] Also, for example, the media access information may include notification information for notifying the user of the status. This notification information enables the receiving side to properly notify the user of the status.

[0014] Also, for example, the information inserting unit may be configured to insert each piece of division information obtained by dividing the media access portion into a predetermined number of unit portions of the media stream. In this case, for example, the media stream may be an audio compression data stream, and the information inserting unit may insert the division information into a user data area of ​​an audio frame as a unit portion. By enabling division and insertion in this way, even if the total size of the media access information is large, the size of information inserted into each media frame can be suppressed, and the media access information can be transmitted satisfactorily without affecting the transmission of the media data.

[0015] In this manner, in the present technology, a predetermined number of pieces of related media access information for a series of media access controls are sequentially inserted into a media stream layer or a container layer and transmitted, thereby enabling a series of media access controls to be performed satisfactorily on the receiving side.

[0016] Another concept of the present technology is a first acquisition unit that acquires first media data and sequentially acquires a predetermined number of pieces of media access information for a series of media access controls; a second acquisition unit that acquires second media data related to the first media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Located in the media processing device.

[0017] In the present technology, the first acquisition unit acquires first media data and sequentially acquires a predetermined number of pieces of media access information for a series of media access controls.

[0018] For example, the first acquisition unit may have a receiving unit that receives a container in a predetermined format including a media stream, and media access information is inserted in a layer of the media stream or a layer of the container, and the first acquisition unit may further have a decoding processing unit that performs a decoding process on the media stream to obtain first media data, and an information extraction unit that extracts the media access information from the layer of the media stream or the layer of the container.

[0019] Also, for example, the first acquisition unit may have a receiving unit that receives video data as the first media data and an audio compressed data stream into which media access information is inserted from an external device via a digital interface, a decoding processing unit that performs a decoding process on the audio compressed data stream to obtain audio data as the first media data, and an information extraction unit that extracts the media access information from the audio compressed data stream.

[0020] The second acquisition unit acquires second media data related to the first media data based on the media access information, and the presentation processing unit performs media presentation processing using the first media data and the second media data.

[0021] In this manner, in the present technology, a predetermined number of pieces of media access information for a series of media access control are sequentially acquired together with the first media data, and the second media data is acquired based on the media access information, so that the second media data can be presented in correspondence with the presentation of media by the first media data.

[0022] Another concept of the present technology is A receiving unit receives a container in a predetermined format including a media stream, a predetermined number of related media access information for a series of media access controls are sequentially inserted into a layer of the media stream or a layer of the container; The apparatus includes a control unit that controls a decoding process for decoding the media stream to obtain first media data, a media data acquisition process for acquiring second media data based on the media access information, and a media presentation process for presenting media using the first media data and the second media data. in the receiving device.

[0023] In this technology, The receiving unit receives a container in a predetermined format including a media stream. A predetermined number of related media access information for a series of media access controls are sequentially inserted into a layer of the media stream or a layer of the container. The control unit controls a decoding process, a media data acquisition process, and a media presentation process.

[0024] In the decoding process, the media stream is decoded to obtain first media data, in the media data acquisition process, second media data is acquired based on the media access information, and in the media presentation process, media presentation is performed using the first media data and the second media data.

[0025] In this manner, in the present technology, a predetermined number of pieces of media access information for a series of media access control are sequentially acquired together with the first media data, and the second media data is acquired based on the media access information, so that the second media data can be presented in correspondence with the presentation of media by the first media data.

[0026] Another concept of the present technology is a receiving unit that receives, from an external device via a digital interface, a compressed audio data stream into which video data as first media data and a predetermined number of pieces of media access information for a series of media access controls are sequentially inserted; a control unit that controls a decoding process for decoding the audio compressed data stream to obtain audio data as the first media data, a media data acquisition process for acquiring second media data based on the media access information, and a media presentation process for presenting media using the first media data and the second media data. in the receiving device.

[0027] In the present technology, a receiving unit receives, from an external device via a digital interface, a compressed audio data stream into which video data as first media data and a predetermined number of pieces of media access information for a series of media access controls are sequentially inserted. A control unit controls a decoding process, a media data acquisition process, and a media presentation process.

[0028] In the decoding process, the audio compression data stream is decoded to obtain audio data as first media data. In the media data acquisition process, second media data is acquired based on the media access information. Then, in the media presentation process, media presentation is performed using the first media data and the second media data.

[0029] In this manner, in the present technology, a predetermined number of pieces of media access information for a series of media access control are sequentially acquired together with the first media data, and the second media data is acquired based on the media access information, so that the second media data can be presented in correspondence with the presentation of media by the first media data.

[0030] Another concept of the present technology is a transmitting unit that transmits a container in a predetermined format including an encoded audio stream into which predetermined information is inserted; An information inserting unit that inserts information indicating that the format of the encoded stream is to be prioritized as the transmission format of the audio data into the layer of the container. Located in the transmitting device.

[0031] In the present technology, a container of a predetermined format including an audio encoded stream into which predetermined information has been inserted is transmitted by a transmitting unit. For example, the predetermined information may be a predetermined number of pieces of media access information related to a series of media access controls. The information inserting unit inserts information indicating that the format of the encoded stream is to be prioritized as a transmission format for audio data into a layer of the container.

[0032] In this way, in the present technology, information indicating that the encoded stream is to be prioritized as the transmission format of audio data is inserted into the container layer, which makes it possible for the receiving side to prioritize the format of the encoded stream as the transmission format of audio data, and enables the receiving device to reliably supply the predetermined information inserted into the encoded stream to an external device (destination device).

[0033] Another concept of the present technology is a transmitter for transmitting a container in a predetermined format including a media stream; An information insertion unit that inserts media access information into the layer of the media stream or the layer of the container by adding check information for checking a source of the media data obtained using the media access information. Located in the transmitting device.

[0034] In this technology, a transmitting unit transmits a container in a predetermined format including a media stream. An information inserting unit inserts media access information into a layer of the media stream or a layer of the container. Check information for checking a source of media data acquired using the media access information is added to the media access information. For example, the check information may be an identification value uniquely assigned to an individual service by the media access information, or a provider or a standards organization of the service.

[0035] In this manner, in the present technology, check information for checking the source of media data obtained using the media access information is added to the media access information inserted into the media stream layer or the container layer, so that the receiving side can simply and easily check the source of media data obtained using the media access information.

[0036] Another concept of the present technology is a media access information acquisition unit for acquiring media access information, The media access information includes check information for checking a source of the media data obtained using the media access information. a media data acquisition unit that acquires media data based on the media access information; The information processing device further includes a provider check unit that checks a provider of the acquired media data based on the check information. Located in the media processing device.

[0037] In the present technology, a media access information acquisition unit acquires media access information. Check information for checking a provider of media data acquired using the media access information is added to the media access information. The media data acquisition unit acquires media data based on the media access information. Then, a provider check unit checks a provider of the acquired media data based on the check information.

[0038] In this manner, in the present technology, the source of the media data acquired using the media access information is checked based on the check information added to the media access information, which makes it possible to simply and easily check the source of the media data acquired using the media access information. Effect of the Invention

[0039] According to the present technology, a series of media access controls can be performed well on the receiving side. Note that the effects described in this specification are merely examples and are not limiting, and additional effects may also be provided. [Brief description of the drawings]

[0040] [Figure 1] 1 is a block diagram showing an example of the configuration of a transmission / reception system according to an embodiment; [Diagram 2] FIG. 11 is a diagram for explaining the effect of dividing and transmitting media access information. [Diagram 3] 2 is a block diagram showing an example of the configuration of a stream generating unit included in the broadcast transmitting device. FIG. [Figure 4] 1 is a diagram showing an example of the structure of an audio frame in transmission data of MPEG-H 3D Audio. FIG. [Diagram 5] FIG. 13 is a diagram showing the correspondence between extension element types and their values. [Figure 6]FIG. 13 is a diagram showing an example of the configuration of a universal metadata frame including universal metadata as an extension element. [Figure 7] FIG. 1 / 3 shows an example of the configuration of access information data having media access information. [Figure 8] FIG. 2 is a diagram (2 / 3) showing an example of the configuration of access information data having media access information. [Figure 9] FIG. 3 is a diagram (3 / 3) showing an example of the configuration of access information data having media access information. [Figure 10] This figure (1 / 2) shows the contents of the main information in the universal metadata frame and access information data. [Figure 11] This is a diagram (2 / 2) showing the main information contents in the universal metadata frame and access information data. [Figure 12] FIG. 13 is a diagram showing an example of the structure of an audio streaming descriptor and the contents of main information in the example structure. [Figure 13] A figure showing an example where container target data is transmitted in multiple universal metadata frames. [Figure 14] A diagram showing an example where container target data is transmitted in one universal metadata frame. [Figure 15] A figure showing an example where multiple container target data are transmitted in multiple universal metadata frames. [Figure 16] 1 is a diagram showing an example of the structure of a transport stream TS when media access information (container target data) is inserted into an audio stream and transmitted. FIG. [Figure 17] FIG. 2 is a block diagram showing an example of the configuration of a set-top box. [Figure 18] 1 is a block diagram showing a configuration example of an audio amplifier; [Figure 19]FIG. 1 is a block diagram showing an example of the configuration of a television receiver. [Figure 20] 2 is a block diagram showing an example of the configuration of an HDMI transmitting unit and an HDMI receiving unit. FIG. [Figure 21] A diagram showing various transmission data sections when image data is transmitted on a TMDS channel. [Figure 22] FIG. 1 illustrates an example of media access control. [Figure 23] FIG. 11 is a diagram showing an example of information included in each piece of media access information. [Figure 24] FIG. 11 is a diagram showing another example of information included in each piece of media access information. [Diagram 25] FIG. 1 illustrates an example of media access control. [Figure 26] FIG. 11 is a diagram showing an example of information included in each piece of media access information. [Figure 27] FIG. 11 is a diagram for explaining an example of checking the provider of media data acquired using media access information. [Figure 28] 13 is a block diagram showing another example configuration of the stream generating unit included in the broadcast transmitting device. FIG. [Figure 29] FIG. 13 is a diagram illustrating an example of the structure of an application descriptor. [Diagram 30] 1 is a diagram showing an example of the structure of a transport stream TS when media access information (container target data) is inserted into a container and transmitted. FIG. [Diagram 31] FIG. 13 is a block diagram showing another example of the configuration of the set-top box. [Diagram 32] 13 is a diagram showing an example of the structure of an MMT stream when media access information (container target data) is inserted into an audio stream and sent. FIG. [Diagram 33] 13 is a diagram showing an example of the structure of an MMT stream when media access information (container target data) is inserted into a container and sent. [Diagram 34] FIG. 1 is a diagram showing the structure of the AC4 Simple Transport layer. [Diagram 35] FIG. 2 is a diagram showing a schematic configuration of a TOC (ac4_toc()) and a substream (ac4_substream_data()). [Diagram 36] FIG. 13 is a diagram showing an example of a universal data structure. [Figure 37] This is a diagram showing the contents of main information in an example of a universal data structure. [Figure 38] FIG. 13 is a diagram showing an example of the structure of an AC4 data container descriptor. [Figure 39] This is a diagram showing the contents of main information in an example of the AC4 data container descriptor structure. [Diagram 40] FIG. 2 is a diagram showing an example of the structure of an MPEG-2 TS transport stream when the audio compression format is AC4. [Diagram 41] FIG. 11 is a diagram showing an example of the structure of an MMT transport stream when the audio compression format is AC4. [Diagram 42] FIG. 2 is a diagram showing an example of the structure of an MP4 stream (file) including audio track data when the audio compression format is AC4. [Diagram 43] FIG. 13 is a diagram showing an example of an MPD file description. [Diagram 44] FIG. 1 is a diagram showing the contents of main information in an example of an MPD file description. [Diagram 45] FIG. 13 is a block diagram showing another example of the configuration of the transmission / reception system. [Diagram 46] FIG. 13 is a block diagram showing yet another example configuration of the transmission / reception system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0041] Hereinafter, modes for carrying out the invention (hereinafter, referred to as "embodiments") will be described. The description will be made in the following order. 1. Embodiment 2. Variations

[0042] <1. Preferred embodiment> [Example of transmission and reception system configuration] 1 shows an example of the configuration of a transmission / reception system 10 according to an embodiment. The transmission / reception system 10 includes a broadcast transmission device 100, a set-top box (STB) 200, an audio amplifier (AMP) 300, and a television receiver (TV) 500. A multi-channel speaker system 400 is connected to the audio amplifier 300.

[0043] The set-top box 200 and the audio amplifier 300 are connected via an HDMI cable 610. In this case, the set-top box 200 is the source, and the audio amplifier 300 is the destination. In addition, the audio amplifier 300 and the television receiver 500 are connected via an HDMI cable 620. In this case, the audio amplifier 300 is the source, and the television receiver 500 is the destination. Note that "HDMI" is a registered trademark.

[0044] The broadcast transmission device 100 transmits a transport stream TS via broadcast waves. This transport stream TS includes a video stream and an audio stream (compressed audio data stream, encoded audio stream). The broadcast transmission device 100 sequentially inserts a predetermined number of related media access information for a series of media access controls into the audio stream as container target data.

[0045] Each piece of media access information includes identification information "data_id" for distinguishing it from other media access information, and identification information "information_id" for associating it with other media access information.

[0046] In addition, each media access information selectively includes information such as ID tables (ID_tables), access information, action command, notification, period, reference time code, offset time (offset_time), universal time code (UTC), and UI selection code.

[0047] The ID table (ID_tables) includes an application ID (application_id), a network ID (network_id), a transport ID (transport_id), a service ID (service_id), and the like. The application ID indicates, for example, a hybrid service. The network ID is the original network ID. The transport ID is the transport ID to be associated. The service ID is the service information ID to be associated. Each ID in this ID table and an organization ID (organization_id) indicating ATSC, DVB, etc. constitute identification information of the service supplied by broadcast wave.

[0048] "Access information" indicates the URL to access. "Action command" is a command for starting an action such as "autostart" or "manual_start". "Notification" indicates notification information (message) for notifying the user of a status. "Period" is period information that indicates the corresponding scene in the audio stream.

[0049] The reference time code and offset time are time information for managing the initiation of action commands. The universal time process (UTC) is absolute time information that indicates the deadline for media playback. The UI selection code is user interface information that allows the user to select the media to be played.

[0050] The broadcast transmission device 100 divides each of a predetermined number of pieces of media access information into a predetermined number of audio frames of the audio stream and inserts the divided pieces. By dividing the pieces in this manner, the size of the information inserted into each audio frame can be suppressed even if the total size of the media access information is large, and the predetermined information can be transmitted without affecting the transmission of compressed audio data.

[0051] At this time, the broadcast transmitting device 100 adds information indicating the overall size of the predetermined information to the first division information, and adds information indicating whether it is the first division information or not and information indicating the division position to each division information. Note that the predetermined number includes 1. When the predetermined number is 1, the media access information is not actually divided, and the entire information is inserted into one audio frame.

[0052] The solid line a in Fig. 2 shows a schematic diagram of the change in bit rate when a large amount of predetermined information is transmitted in one audio frame, and the bit rate increases suddenly in the audio frame in which the media access information is inserted. In this case, for example, when the bit rate of the audio compressed data is 192 kbps and the predetermined information is 40 bytes, the bit rate increases by 15 kbps to 207 kbps. Such a sudden spike-like increase in the bit rate affects the transmission of the audio compressed data.

[0053] On the other hand, the dashed line b in Fig. 2 shows a schematic diagram of the change in the bit rate when large-sized media access information is divided into multiple audio frames and transmitted. In this case, the bit rate does not increase suddenly. Therefore, large-sized media access information can be transmitted satisfactorily without affecting the transmission of compressed audio data.

[0054] The broadcast transmitting device 100 also inserts information (transmission format priority information) indicating that the format of the encoded stream is to be prioritized as the transmission format of audio data into the layer of the transport stream TS as a container. The broadcast transmitting device 100 inserts this information, for example, as a descriptor into an audio elementary stream loop existing under a program map table (PMT).

[0055] The set-top box 200 receives the transport stream TS transmitted on the broadcast waves from the broadcast transmitting device 100. As described above, this transport stream TS includes a video stream and an audio stream, and a predetermined number of related media access information for a series of media access controls are sequentially inserted into the audio stream.

[0056] The set-top box 200 transmits the received audio stream itself to the audio amplifier 300 via the HDMI cable 610 together with uncompressed video data obtained by decoding the video stream. In this case, the set-top box 200 transmits the audio stream itself to the audio amplifier 300 without decoding it based on the above-mentioned transmission format priority information inserted in the layer of the transport stream TS. As a result, the media access information inserted in the audio stream is also sent to the audio amplifier 300 as is.

[0057] The audio amplifier 300 receives an audio stream into which media access information is inserted together with uncompressed video data from the set-top box 200 via the HDMI cable 610. The audio amplifier 300 decodes the audio stream to obtain multi-channel audio data, and supplies the audio data to the speaker system 400.

[0058] Furthermore, the audio amplifier 300 transmits the received uncompressed video data and audio stream to the television receiver 500 via the HDMI cable 620. As a result, the media access information inserted in the audio stream is also sent directly to the television receiver 500. In this case, the audio amplifier 300 is instructed by the set-top box 200, for example, through communication using the CEC line, to prioritize the format of the encoded stream as the transmission format of the audio data.

[0059] The television receiver 500 receives an audio stream in which a predetermined number of pieces of related media access information for a series of media access controls are sequentially inserted together with uncompressed video data from the audio amplifier 300 via the HDMI cable 620. The television receiver 500 displays an image based on the uncompressed video data. The television receiver 500 also performs a decoding process on the audio stream to obtain the media access information.

[0060] The media access information is divided into a predetermined number of audio frames of the audio stream and inserted. Information indicating the total size of the media access information is added to the first division information, and information indicating whether it is the first division information or not and information indicating the division position are added to each division information. Based on this information, the television receiver 500 obtains each division information constituting the media access information from the predetermined number of audio frames.

[0061] In this case, the television receiver 500 recognizes the information indicating the total size of the media access information when the first division information is acquired. Then, the television receiver 500 can secure space for storing predetermined information in the storage medium, and can easily and appropriately perform the process of acquiring the media access information.

[0062] The television receiver 500 acquires media data based on a predetermined number of pieces of media access information related to a series of media access controls. Then, the television receiver 500 displays images and outputs audio based on the media data acquired based on the media access information in correspondence with image display, audio output, etc. based on the video and audio data sent from the set-top box 200.

[0063] [Stream generation section of broadcast transmission device] 3 shows an example of the configuration of the stream generating unit 110 included in the broadcast transmitting device 100. This stream generating unit 110 has a control unit 111, a video encoder 112, an audio encoder 113, and a multiplexer 114.

[0064] The control unit 111 includes a CPU 111a and controls each unit of the stream generating unit 110. The video encoder 112 performs encoding such as MPEG2, H.264 / AVC, and H.265 / HEVC on the video data (image data) SV to generate a video stream (video elementary stream). The video data SV is, for example, video data played back from a recording medium such as a hard disk drive (HDD), or live video data obtained by a video camera.

[0065] The audio encoder 113 encodes the audio data (voice data) SA in the MPEG-H 3D Audio compression format to generate an audio stream (audio elementary stream). The audio data SA corresponds to the above-mentioned video data SV, and may be audio data reproduced from a recording medium such as a HDD, or live audio data obtained by a microphone.

[0066] The audio encoder 113 has an audio encoding block unit 113a and an audio framing unit 113b. The audio encoding block unit 113a generates an encoded block, and the audio framing unit 113b performs framing.

[0067] Under the control of the control unit 111, the audio encoder 113 sequentially inserts a predetermined number of pieces of media access information related to a series of media access controls as container target data into the audio stream. The audio encoder 113 divides each of the predetermined number of pieces of media access information into a predetermined number (including 1) of audio frames of the audio stream and inserts them. At this time, the audio encoder 113 adds information indicating the overall size of the predetermined information to the first piece of division information. In addition, the audio encoder 113 adds, to each piece of division information, information indicating whether it is the first piece of division information or not and a count number in descending order as information indicating the division position.

[0068] Figure 4 shows an example of the structure of an audio frame in MPEG-H 3D Audio transmission data. This audio frame is made up of multiple MPEG Audio Stream Packets. Each MPEG Audio Stream Packet is made up of a header and a payload.

[0069] The header has information such as packet type, packet label, and packet length. The payload contains information defined by the packet type in the header. This payload information contains "SYNC", which is the synchronization start code, "Frame", which is the actual data for the 3D audio transmission, and "Config", which indicates the configuration of this "Frame".

[0070] A "Frame" includes channel-encoded data and object-encoded data that constitute the transmission data of 3D audio. Here, the channel-encoded data is composed of encoded sample data such as SCE (Single Channel Element), CPE (Channel Pair Element), and LFE (Low Frequency Element). The object-encoded data is composed of encoded sample data of SCE (Single Channel Element) and metadata for mapping it to a speaker located at an arbitrary position and rendering it. This metadata is included as an extension element (Ext_element).

[0071] In this embodiment, an element (Ext_universal_metadata) that has media access information as universal metadata (universal_metadata) is newly defined as an extension element (Ext_element). Accordingly, configuration information (universal_metadataConfig) for that element is newly defined in "Config".

[0072] Fig. 5 shows the correspondence between the type (ExElementType) of the extension element (Ext_element) and its value (Value). Currently, 0 to 7 are defined. Since values ​​from 128 onwards can be extended beyond MPEG, for example, 128 is newly defined as the type value of "ID_EXT_ELE_universal_metadata". Note that in the case of standards such as MPEG, it is also possible to define it as 8 to 127.

[0073] Figure 6 shows an example of the structure (syntax) of a universal metadata frame (universal_metadata_frame()) that includes universal metadata as an extension element. Figures 7, 8, and 9 show examples of the structure (syntax) of access information data (Access_information_data()) inserted in "bytes_to_carry_access_information_data" of a certain number of universal metadata frames (including 1). Figures 10 and 11 show the main information contents (semantics) in each structure example.

[0074] In the universal metadata frame (universal_metadata_frame()), the 32-bit field "organization_id" indicates an identification value uniquely assigned to each service transmitted in the user data area, or to the provider or standard organization of this service (e.g., "ATSC", "DVB", etc.). The 8-bit field "metadata_type" indicates the type of container target data. For example, "0x10" indicates universal metadata for the MPEG-H format, and "0x02" indicates application metadata for ATSC. The 8-bit field "data_id" indicates the ID of the container target data (media access information). The same ID is assigned to each piece of partition information obtained by partitioning the same container target data.

[0075] The 1-bit field "start_flag" indicates whether it is the start of the container target data. "1" indicates the start, and "0" indicates that it is not the start. The 7-bit field "fcounter" indicates the division position of the divided container target data in descending order as a count number. "0" indicates the last division. If "start_flag" is "1" and "fcounter" is "0", it indicates that it is not divided.

[0076] When "start_flag" is "1", the 16-bit field "total_data_size" exists. This field indicates the size of the data to be contained in the container. The whole or part of the access information data (Access_information_data()) is inserted into the "bytes_to_carry_access_information_data" field.

[0077] In the access information data (Access_information_data()), the 8-bit field "num_of_access_information; N" indicates the number of pieces of information N in the media access information. The 8-bit field "information_id" indicates the ID of the media access information. The same ID is assigned to a certain number of related media access information. In other words, an application can use this "information_id" to associate each piece of media access information. The 8-bit field "segment_id" indicates the ID of each segmented media access information that shares the "information_id".

[0078] The access information data (Access_information_data()) contains information of the number N indicated by "num_of_access_information; N". The 8-bit field "information_type" indicates the type of information. "0x00" indicates ID tables (ID_tables). When the type of information is ID tables, there are 16-bit fields indicating the application ID (applicatio_id), network ID (network_id), transport ID (transport_id), and service ID (service_id).

[0079] "0x01" indicates access information. When the type of information is access information, the code of each character of the URL is placed in the "bytes" field. The 8-bit field of "url_length" indicates the number of characters of the URL.

[0080] "0x02" indicates an action command. When the type of information is an action command, there is an 8-bit field of "command_type". For example, "1" indicates autostart, "2" indicates manual start, "3" indicates resume, "4" indicates pause, "5" indicates stop, "6" indicates user selected, and "7" indicates discard download_data.

[0081] "0x03" indicates notification. When the type of information is notification, there is an 8-bit field of "message_type". For example, "1" indicates preparing, "2" indicates access ready, "3" indicates expired, and "4" indicates selection.

[0082] "0x04" indicates a period. When the type of information is a period, an 8-bit field of "period_id" exists. "0x05" indicates a reference time code. When the type of information is a reference time code, a 64-bit field of "time_code1" exists.

[0083] "0x06" indicates the offset time (offset_time). When the type of information is offset time, there is a 64-bit field for "time_code2" and an 8-bit field for "target_segment_id". This field indicates the "segment_id" of the media access information for which the offset time is specified. Note that when specifying its own offset time, this "target_segment_id" may not exist.

[0084] "0x07" indicates UTC (universal time code). When the type of information is UTC, a 64-bit field of "UTC" exists.

[0085] "0x08" indicates a UI selection process (UI selection code). When the type of information is a UI selection process, user interface information for allowing the user to select playback media is placed in the "data" field. This user interface information is, for example, HTML data in which information required to start a browser is described. This description includes thumbnail information for the user to select, and an ID "select_ID" that indicates the selection result. The 8-bit "html_length" field is information for implementing the browser function, and indicates the number of bytes of related HTML data.

[0086] Returning to FIG. 3, the multiplexer 114 PES packets the video stream output from the video encoder 112 and the audio stream output from the audio encoder 113, and further transport packets them and multiplexes them to obtain a transport stream TS as a multiplexed stream.

[0087] The multiplexer 114 also inserts information (transmission format priority information) indicating that the format of the encoded stream (audio compressed data stream) is to be prioritized as the transmission format of audio data under the program map table (PMT). Specifically, the multiplexer 114 inserts an audio streaming descriptor (Audio_streaming_descriptor()) into the audio elementary stream loop.

[0088] Figure 12(a) shows an example of the structure (Syntax) of an audio streaming descriptor, and Figure 12(b) shows the main information content (Semantics) of the example structure.

[0089] The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an audio streaming descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0090] The 1-bit field of "audio_streaming_flag" indicates that the format of the encoded stream is to be prioritized as the transmission format of audio data. "1" indicates that the format of the encoded stream is to be prioritized, and "0" indicates that the format of the encoded stream does not have to be prioritized. In this embodiment, "audio_streaming_flag" is set to "1".

[0091] A brief description will be given of the operation of the stream generation unit 110 shown in Fig. 3. Video data SV is supplied to a video encoder 112. In this video encoder 112, the video data SV is subjected to encoding using H.264 / AVC, H.265 / HEVC, or the like, and a video stream including encoded video data is generated.

[0092] The audio data SA is also supplied to an audio encoder 113. In this audio encoder 113, the audio data SA is encoded in the MPEG-H 3D Audio compression format to generate an audio stream (audio compressed data stream).

[0093] At this time, media access information to be inserted into the audio stream is supplied as container target data from the control unit 111 to the audio encoder 113. In the audio encoder 113, the container target data (media access information) is divided and inserted into a predetermined number (including 1) of audio frames of the audio stream.

[0094] At this time, the audio encoder 113 adds information indicating the total size of the container target data (media access information) to the first division information. Also, the audio encoder 113 adds information indicating whether it is the first division information or not and a count number in descending order as information indicating the division position to each division information.

[0095] The video stream generated by the video encoder 112 is supplied to a multiplexer 114. Also, the audio stream generated by the audio encoder 113 is supplied to the multiplexer 114. Then, in this multiplexer 114, the streams supplied from the respective encoders are packetized and multiplexed, and a transport stream TS is obtained as transmission data.

[0096] In addition, the multiplexer 114 inserts an audio streaming descriptor (see FIG. 12(a)) into the audio elementary stream loop under the program map table (PMT). This descriptor contains information (transmission format priority information) indicating that the format of the encoded stream (audio compressed data stream) is to be prioritized as the transmission format of audio data.

[0097] [Insert container target data (prescribed information)] Further explanation of the insertion of container object data into an audio stream is given in Fig. 13. Fig. 13 shows an example in which container object data (media access information) is transmitted in multiple universal metadata frames.

[0098] In this case, the container target data is divided into multiple pieces, and each of the multiple pieces of division information is distributed to multiple universal metadata frames and inserted into the "bytes_to_carry_access_information_data" field (see Figure 6). Here, the "start_flag" corresponding to the first division information is set to "1", indicating that it is the first division information. The "fcounter" corresponding to the first division information is set to "n-1", and the number of divisions "n" is indicated by adding 1 to this value. The "total_data_size" field also exists corresponding to this first division information, and indicates the total size of the container target data (media access information).

[0099] The "start_flag" corresponding to the second or subsequent split information is set to "0", indicating that it is not the first split information. Additionally, the "fcounter" corresponding to the second or subsequent split information is set to a count number decremented sequentially from "n-1", indicating the split position and the number of remaining split information. Additionally, the "fcounter" corresponding to the last split information is set to "0", indicating that it is the last split information.

[0100] It is also possible to set the "fcounter" corresponding to the first division information to "n", the "fcounter" corresponding to the second and subsequent division information to count numbers decremented from "n", and the "fcounter" corresponding to the last division information to "1". "n" in the "fcounter" corresponding to the first division information indicates the number of divisions, and "fcounter" being "1" indicates that it is the last division information.

[0101] Figure 14 shows an example of the case where container target data (media access information) is transmitted in one universal metadata frame. In this case, the container target data is not divided, but is inserted into the "bytes_to_carry_access_information_data" field of one universal metadata frame (see Figure 6). Here, "start_flag" is set to "1", indicating that this is the first division information. Also, "fcounter" is set to "0", indicating that this is the last division information. Therefore, these pieces of information indicate that the data is not divided. Also, corresponding to this first division information, there is a "total_data_size" field, which indicates the total size of the container target data (media access information).

[0102] Figure 15 shows an example of a case where multiple container object data (media access information) are transmitted in multiple universal metadata frames. The illustrated example shows a case where two container object data are transmitted: container object data A whose "data_id" is "0" and container object data B whose "data_id" is "1".

[0103] In this case, container target data A is divided into three, and each of the three pieces of division information is allocated to three universal metadata frames and inserted into the "bytes_to_carry_access_information_data" field (see Figure 6). Here, the "start_flag" corresponding to the first division information is set to "1", indicating that this is the first division information. The "fcounter" corresponding to the first division information is set to "2", and adding 1 to this value indicates the number of divisions "3". Also, corresponding to this first division information, there is a "total_data_size" field, which indicates the total size of the container target data (media access information).

[0104] The "start_flag" corresponding to the second split information is set to "0", indicating that it is not the first split information. Furthermore, the "fcounter" corresponding to the second split information is set to "1", indicating the split position and that the number of remaining split information is "1". Furthermore, the "start_flag" corresponding to the last split information is set to "0", indicating that it is not the last split information. Furthermore, the "fcounter" corresponding to the last split information is set to "0", indicating that it is the last split information.

[0105] Additionally, container target data B is inserted into the "bytes_to_carry_access_information_data" field of one universal metadata frame without being divided (see Figure 6). Here, "start_flag" is set to "1", indicating that this is the first division information. Additionally, "fcounter" is set to "0", indicating that this is the last division information. Therefore, these pieces of information indicate that it has not been divided. Additionally, corresponding to this first division information, there is a "total_data_size" field, which indicates the total size of the container target data (media access information).

[0106] [Example of transport stream TS structure] Fig. 16 shows an example of the structure of a transport stream TS. In this example structure, there is a PES packet "video PES" of a video stream identified by PID1, and there is also a PES packet "audio PES" of an audio stream identified by PID2. A PES packet consists of a PES header (PES_header) and a PES payload (PES_payload). DTS and PTS timestamps are inserted in the PES header.

[0107] An audio stream (Audio coded stream) is inserted into the PES payload of the PES packet of the audio stream. Access information data (Access_information_data()) (see Figures 7 to 9) including media access information (container target data) is inserted into the universal metadata frame (universal_metadata_frame()) in a predetermined number (including 1) of audio frames of this audio stream.

[0108] The transport stream TS also contains a PMT (Program Map Table) as PSI (Program Specific Information). The PSI is information that describes which program each elementary stream in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program.

[0109] The PMT also contains elementary stream loops that contain information related to each elementary stream. In this configuration example, there is a video elementary stream loop (video ES loop) that corresponds to the video stream, and an audio elementary stream loop (audio ES loop) that corresponds to the audio stream.

[0110] In the video elementary stream loop (video ES loop), information such as stream type and PID (packet identifier) ​​corresponding to the video stream is placed, and a descriptor describing information related to the video stream is also placed. The value of "Stream_type" for this video stream is set to "0x24", and the PID information indicates PID1 that is assigned to the PES packet "video PES" of the video stream as described above. One of the descriptors placed is the HEVC descriptor.

[0111] Additionally, in the audio elementary stream loop (audio ES loop), information such as stream type and PID (packet identifier) ​​is placed for each audio stream, as well as a descriptor describing information related to that audio stream. The value of "Stream_type" for this audio stream is set to "0x2C", and the PID information indicates PID2, which is added to the PES packet "audio PES" of the audio stream, as described above. The audio streaming descriptor described above is placed as one of the descriptors.

[0112] [Set-top box configuration example] 17 shows an example of the configuration of a set-top box 200. The set-top box 200 has a CPU 201, a flash ROM 202, a DRAM 203, an internal bus 204, a remote control receiver 205, and a remote control transmitter 206. The set-top box 200 also has an antenna terminal 211, a digital tuner 212, a demultiplexer 213, a video decoder 214, an audio framing unit 215, an HDMI transmitter 216, and an HDMI terminal 217.

[0113] The CPU 201 controls the operation of each part of the set-top box 200. The flash ROM 202 stores control software and data. The DRAM 203 constitutes a work area for the CPU 201. The CPU 201 loads software and data read from the flash ROM 202 onto the DRAM 203, starts up the software, and controls each part of the set-top box 200.

[0114] The remote control receiving unit 205 receives a remote control signal (remote control code) transmitted from the remote control transmitter 206, and supplies it to the CPU 201. The CPU 201 controls each unit of the set-top box 200 based on the remote control code. The CPU 201, the flash ROM 202, and the DRAM 203 are connected to an internal bus 204.

[0115] The antenna terminal 211 is a terminal for inputting a television broadcast signal received by a receiving antenna (not shown). The digital tuner 212 processes the television broadcast signal input to the antenna terminal 211 and outputs a transport stream TS corresponding to a channel selected by the user.

[0116] The demultiplexer 213 extracts video stream packets from the transport stream TS and sends them to the video decoder 214. The video decoder 214 reconstructs the video stream from the video packets extracted by the demultiplexer 213, and performs a decoding process to obtain uncompressed video data (image data).

[0117] Moreover, the demultiplexer 213 extracts packets of the audio stream from the transport stream TS and reconstructs the audio stream. The audio framing unit 215 performs framing on the audio stream thus reconstructed. As described above with respect to the stream generating unit 110 (see FIG. 3), media access information (container target data) is inserted into this audio stream.

[0118] In addition, the demultiplexer 213 extracts various information such as descriptor information from the transport stream TS, and sends it to the CPU 201. This various information also includes the above-mentioned audio streaming descriptor (Audio_streaming_descriptor()) information (see FIG. 12(a)).

[0119] Based on the information in the "audio_streaming_flag" field inserted in this descriptor, i.e., the transmission format priority information, the CPU 201 recognizes that the format of the encoded stream (audio compressed data stream) is to be prioritized as the transmission format of the audio data. As a result, the CPU 201 controls each unit of the set-top box 200 so as to transmit the audio stream itself to the audio amplifier 300 without performing a decoding process on the audio stream. Although not shown, the set-top box 200 may include, for example, an audio decoder, and may perform a decoding process on the audio stream to obtain audio data.

[0120] Furthermore, the CPU 201 communicates with the audio amplifier 300 using, for example, a CEC line, and instructs the audio amplifier 300 to prioritize the format of the encoded stream as the transmission format of the audio data. As a result, the audio amplifier 300 operates to transmit the audio stream as is to the television receiver 500, as will be described later.

[0121] In the case of a transmission / reception system 10A having the configuration shown in Fig. 33 described later, the audio amplifier 300 may or may not decode the audio stream. In either case, the encoded stream is prioritized based on the priority information, so that the encoded audio stream can reach the final destination receiving device.

[0122] The HDMI transmission unit 216 transmits the uncompressed video data obtained by the video decoder 214 and the audio stream that has been framed by the audio framing unit 215 from the HDMI terminal 217 through communication compliant with HDMI. To transmit on the TMDS channel of HDMI, the HDMI transmission unit 216 packs the video data and audio stream and outputs them to the HDMI terminal 217. Details of this HDMI transmission unit 216 will be described later.

[0123] A brief description will now be given of the operation of the set-top box 200. A television broadcast signal input to an antenna terminal 211 is supplied to a digital tuner 212. This digital tuner 212 processes the television broadcast signal and outputs a transport stream TS corresponding to a channel selected by the user.

[0124] The transport stream TS output from the digital tuner 212 is supplied to a demultiplexer 213. In the demultiplexer 213, packets of the video elementary stream are extracted from the transport stream TS and sent to a video decoder 214.

[0125] In the video decoder 214, a video stream is reconstructed from the video packets extracted by the demultiplexer 213, and then the video stream is decoded to obtain uncompressed video data. This uncompressed video data is supplied to an HDMI transmission unit 216.

[0126] Furthermore, the demultiplexer 213 extracts packets of the audio stream from the transport stream TS, and reconstructs the audio stream into which the media access information (container target data) is inserted. This audio stream is framed by an audio framing unit 215, and then supplied to an HDMI transmission unit 216. Then, the HDMI transmission unit 216 packs the uncompressed video data and audio stream, and transmits them from the HDMI terminal 217 to the audio amplifier 300 via the HDMI cable 610.

[0127] [Example of audio amplifier configuration] 18 shows an example of the configuration of an audio amplifier 300. The audio amplifier 300 has a CPU 301, a flash ROM 302, a DRAM 303, an internal bus 304, a remote control receiver 305, and a remote control transmitter 306. The audio amplifier 300 also has an HDMI terminal 311, an HDMI receiver 312, an audio decoder 313, an audio processing circuit 314, an audio amplifier circuit 315, an audio output terminal 316, an HDMI transmitter 317, and an HDMI terminal 318.

[0128] The CPU 301 controls the operation of each unit of the audio amplifier 300. The flash ROM 302 stores control software and data. The DRAM 303 constitutes a work area for the CPU 301. The CPU 301 loads software and data read from the flash ROM 302 onto the DRAM 303, starts up the software, and controls each unit of the audio amplifier 300.

[0129] A remote control receiving unit 305 receives a remote control signal (remote control code) transmitted from a remote control transmitter 306, and supplies the signal to the CPU 301. The CPU 301 controls each unit of the audio amplifier 300 based on the remote control code. The CPU 301, the flash ROM 302, and the DRAM 303 are connected to an internal bus 304.

[0130] The HDMI receiving unit 312 receives uncompressed video data and an audio stream supplied to the HDMI terminal 311 via an HDMI cable 610 by HDMI-compliant communication. As described above with respect to the set-top box 200 (see FIG. 17), media access information (container target data) is inserted in the audio stream. The HDMI receiving unit 312 will be described in detail later.

[0131] The audio decoder 313 performs a decoding process on the audio stream received by the HDMI receiving unit 212 to obtain uncompressed audio data (audio data) for a predetermined number of channels. The audio processing circuit 314 performs a necessary up / downmix process on the uncompressed audio data for a predetermined number of channels in accordance with the configuration of the speaker system 400 (see FIG. 1) to obtain audio data for a necessary number of channels, and also performs necessary processes such as D / A conversion.

[0132] The audio amplifier circuit 315 amplifies the audio signals of each channel obtained by the audio processing circuit 314, and outputs the amplified audio signals to an audio output terminal 316. Note that the audio output terminal 316 is connected to a speaker system 400.

[0133] The HDMI transmission unit 317 transmits the uncompressed video data and audio stream received by the HDMI reception unit 212 through HDMI-compliant communication from an HDMI terminal 318. To transmit on the TMDS channel of HDMI, the HDMI transmission unit 317 packs the uncompressed video data and audio stream and outputs them to the HDMI terminal 318. Details of this HDMI transmission unit 317 will be described later.

[0134] A brief description will be given of the operation of the audio amplifier 300 shown in Fig. 18. The HDMI receiving unit 312 receives uncompressed video data and an audio stream transmitted from the set-top box 200 to the HDMI terminal 311 via the HDMI cable 610.

[0135] The audio stream received by the HDMI receiving unit 312 is supplied to an audio decoder 313. The audio decoder 313 performs a decoding process on the audio stream to obtain uncompressed audio data for a predetermined number of channels. This audio data is supplied to an audio processing circuit 314.

[0136] In the audio processing circuit 314, the uncompressed audio data of the predetermined number of channels is subjected to necessary up / downmix processing according to the configuration of the speaker system 400 (see FIG. 1) to obtain audio data of the necessary number of channels, and is subjected to necessary processing such as D / A conversion. The audio data of each channel output from the audio processing circuit 314 is amplified by the audio amplifier circuit 315 and output to the audio output terminal 316. Therefore, audio output of the predetermined number of channels is obtained from the speaker system 400 connected to the audio output terminal 316.

[0137] Furthermore, the uncompressed video data and audio stream received by the HDMI receiving unit 312 are supplied to the HDMI transmitting unit 317. Note that instead of the uncompressed video data itself received by the HDMI receiving unit 312, video data that has been subjected to processing such as superimposition of graphics data on this uncompressed video data may be supplied to the HDMI transmitting unit 317. In the HDMI transmitting unit 317, this uncompressed video data and audio stream are packed and transmitted from the HDMI terminal 318 to the television receiver 500 via the HDMI cable 620.

[0138] [Example of a TV receiver configuration] 19 shows an example of the configuration of a television receiver 500. The television receiver 500 has a CPU 501, a flash ROM 502, a DRAM 503, an internal bus 504, a remote control receiver 505, a remote control transmitter 506, and a communication interface 507.

[0139] The television receiver 500 also has an antenna terminal 511, a digital tuner 512, a demultiplexer 513, a video decoder 514, an HDMI terminal 515, and an HDMI receiving unit 516. The television receiver 500 also has a video processing circuit 517, a panel driving circuit 518, a display panel 519, an audio decoder 520, an audio processing circuit 521, an audio amplifier circuit 522, and a speaker 523.

[0140] The CPU 501 controls the operation of each part of the television receiver 500. The flash ROM 502 stores control software and data. The DRAM 503 constitutes a work area for the CPU 501. The CPU 501 loads software and data read from the flash ROM 502 onto the DRAM 503, starts up the software, and controls each part of the television receiver 500.

[0141] A remote control receiving unit 505 receives a remote control signal (remote control code) transmitted from a remote control transmitter 506, and supplies the signal to the CPU 501. The CPU 501 controls each unit of the television receiver 500 based on the remote control code. The CPU 501, the flash ROM 502, and the DRAM 503 are connected to an internal bus 504.

[0142] The communication interface 507 communicates with a server on a network such as the Internet under the control of the CPU 501. The communication interface 507 is connected to the internal bus 504.

[0143] The antenna terminal 511 is a terminal for inputting a television broadcast signal received by a receiving antenna (not shown). The digital tuner 512 processes the television broadcast signal input to the antenna terminal 511 and outputs a transport stream TS corresponding to a channel selected by the user.

[0144] The demultiplexer 513 extracts video stream packets from the transport stream TS and sends them to the video decoder 514. The video decoder 514 reconstructs the video stream from the video packets extracted by the demultiplexer 513, and performs a decoding process to obtain uncompressed video data (image data).

[0145] The demultiplexer 513 also extracts packets of the audio stream from the transport stream TS and reconstructs the audio stream, into which media access information (container target data) has been inserted, as described above in relation to the stream generating unit 110 (see FIG. 3).

[0146] The HDMI receiving unit 516 receives uncompressed video data and an audio stream supplied to the HDMI terminal 515 via an HDMI cable 620 by HDMI-compliant communication. As described above with respect to the audio amplifier 300 (see FIG. 18), media access information (container target data) is inserted in the audio stream. The HDMI receiving unit 516 will be described in detail later.

[0147] The video processing circuit 517 performs scaling, compositing, and other processing on the video data obtained by the video decoder 514 or the HDMI receiving unit 516, as well as video data received from a server on the Internet via the communications interface 507, to obtain video data for display.

[0148] The panel drive circuit 518 drives the display panel 519 based on the image data for display obtained by the video processing circuit 517. The display panel 519 is composed of, for example, an LCD (Liquid Crystal Display), an organic EL display (organic electroluminescence display), or the like.

[0149] The audio decoder 520 performs a decoding process on the audio stream obtained by the demultiplexer 513 or the HDMI receiving unit 516 to obtain uncompressed audio data (sound data). The audio decoder 520 also extracts a predetermined number of pieces of media access information (container target data) related to a series of media access controls that are sequentially inserted into the audio stream, and sends the pieces to the CPU 501. The CPU 501 appropriately causes each unit of the television receiver 500 to perform processing using the media access information.

[0150] Here, the media access information is divided into a predetermined number (including 1) of audio frames of the audio stream and inserted, and information indicating the total size of the media access information (container target data) is added to the first division information, and information indicating whether it is the first division information or not and a descending count number as information indicating the division position are added to each division information. The audio decoder 520 obtains the media access information from the predetermined number of audio frames based on this information.

[0151] In this case, the audio decoder 520 can recognize the first division information from the information indicating whether it is the first division information, recognize the number of divisions from the count number in descending order corresponding to the first division information, and recognize the number of remaining division information from the count number in descending order. Therefore, the audio decoder 520 can easily and appropriately obtain each division information constituting the media access information from a predetermined number of audio frames.

[0152] In addition, the descending count number (1) makes it possible for the receiving side to detect if there is an error in the transmission packet along the way, and (2) enables the receiving side to know in advance the approximate time when the final divided packet will arrive.

[0153] Furthermore, since information indicating the total size of the media access information is added to the initial division information, at the time the initial division information is acquired, sufficient space can be secured in the memory (storage medium) to store the specified information based on the information indicating the total size of the media access information, making it possible to easily and appropriately perform the process of acquiring the media access information.

[0154] The audio processing circuit 521 performs necessary processing such as D / A conversion on the audio data obtained by the audio decoder 520. The audio amplifier circuit 522 amplifies the audio signal output from the audio processing circuit 521 and supplies the amplified signal to a speaker 523.

[0155] The CPU 501 controls, for example, the communication interface 507, etc., based on a predetermined number of pieces of related media access information for a series of media access controls acquired by the audio decoder 520. In this case, media data is acquired from a server on a network such as the Internet, and images are displayed and audio is output based on this media data. A specific example of media access control will be described later.

[0156] A brief description will now be given of the operation of the television receiver 500 shown in Fig. 19. A television broadcast signal input to an antenna terminal 511 is supplied to a digital tuner 512. In this digital tuner 512, the television broadcast signal is processed to obtain a transport stream TS corresponding to a channel selected by the user.

[0157] The transport stream TS obtained by the digital tuner 512 is supplied to a demultiplexer 513. The demultiplexer 513 extracts video stream packets from the transport stream TS and supplies them to a video decoder 514. The video decoder 514 reconstructs a video stream from the video packets extracted by the demultiplexer 513, and decodes the video stream to obtain uncompressed video data. This uncompressed video data is supplied to a video processing circuit 517.

[0158] The demultiplexer 513 also extracts packets of the audio stream from the transport stream TS and reconstructs the audio stream. This audio stream is supplied to the audio decoder 520.

[0159] The HDMI receiving unit 516 receives uncompressed video data and an audio stream supplied to the HDMI terminal 515 via an HDMI cable 620 through HDMI-compliant communication. The uncompressed video data is supplied to a video processing circuit 517. The audio stream is supplied to an audio decoder 520.

[0160] In the video processing circuit 517, scaling and compositing processes are performed on the video data obtained by the video decoder 514 or the HDMI receiving unit 516, as well as on the video data received from a server on the Internet via the communication interface 507, to obtain video data for display.

[0161] The display video data obtained by the video processing circuit 517 is supplied to a panel driving circuit 518. The panel driving circuit 518 drives a display panel 519 based on the display video data. As a result, an image corresponding to the display video data is displayed on the display panel 519.

[0162] In the audio decoder 520, a decoding process is performed on the audio stream obtained in the demultiplexer 513 or the HDMI receiving unit 516, and uncompressed audio data is obtained. The audio data obtained in the audio decoder 520 is supplied to an audio processing circuit 521. In the audio processing circuit 521, necessary processes such as D / A conversion are performed on the audio data. This audio data is amplified in an audio amplifier circuit 522 and then supplied to a speaker 523. Therefore, sound corresponding to the display image on the display panel 519 is output from the speaker 523.

[0163] Furthermore, the audio decoder 520 extracts a predetermined number of pieces of media access information (container target data) related to a series of media access control, which are sequentially inserted into the audio stream. The media access information thus extracted by the audio decoder 520 is sent to the CPU 501. The CPU 501 controls, for example, the communication interface 507 based on this media access information. As a result, media data is acquired from a server on a network such as the Internet, and images are displayed and audio is output based on this media data.

[0164] [Example of HDMI transmitter and receiver configuration] Fig. 20 shows a configuration example of the HDMI transmitting unit 216 (see Fig. 17) of the set-top box 200 and the HDMI receiving unit 312 (see Fig. 18) of the audio amplifier 300 in the transmission / reception system 10 of Fig. 1. Note that configuration examples of the HDMI transmitting unit 317 (see Fig. 18) of the audio amplifier 300 and the HDMI receiving unit 516 (see Fig. 19) of the television receiver 500 have similar configurations, and therefore description thereof will be omitted.

[0165] The HDMI transmitter 216 unidirectionally transmits differential signals corresponding to pixel data of an uncompressed image for one screen over multiple channels to the HDMI receiver 312 in an effective image interval 21 (hereinafter also referred to as an "active video interval" as appropriate) (see FIG. 21), which is an interval from one vertical synchronizing signal to the next vertical synchronizing signal, excluding horizontal blanking interval 22 and vertical blanking interval 23. Furthermore, the HDMI transmitter 216 unidirectionally transmits differential signals corresponding to at least audio data, control data, other auxiliary data, etc. associated with the image over multiple channels to the HDMI receiver 312 in the horizontal blanking interval 22 or vertical blanking interval 23.

[0166] That is, the HDMI sending unit 216 has an HDMI transmitter 31. The transmitter 31 converts, for example, pixel data of an uncompressed image into a corresponding differential signal, and transmits the signal serially in one direction to the HDMI receiving unit 312 via three TMDS (Transition Minimized Differential Signaling) channels #0, #1, and #2, which are multiple channels.

[0167] In addition, the transmitter 31 converts audio data accompanying the uncompressed images, as well as necessary control data and other auxiliary data, into corresponding differential signals and transmits them serially in one direction to the HDMI receiving unit 312 over three TMDS channels #0, #1, and #2.

[0168] The HDMI receiving unit 312 receives differential signals corresponding to pixel data transmitted in one direction from the HDMI transmitting unit 216 over multiple channels during the active video interval 21 (see FIG. 21). The HDMI receiving unit 312 also receives differential signals corresponding to audio data or control data transmitted in one direction from the HDMI transmitting unit 216 over multiple channels during the horizontal blanking interval 22 (see FIG. 21) or the vertical blanking interval 23 (see FIG. 21).

[0169] The transmission channels of the HDMI system consisting of the HDMI transmitting unit 216 and the HDMI receiving unit 312 include three TMDS channels #0 to #2 as transmission channels for transmitting pixel data and audio data, a TMDS clock channel as a transmission channel for transmitting a pixel clock, as well as transmission channels called a DDC (Display Data Channel) 33 and a CEC (Consumer Electronics Control) line 34.

[0170] The DDC 33 is made up of two signal lines included in the HDMI cable 610, and is used by the HDMI transmission unit 216 to read EDID (Extended Display Identification Data) from the HDMI reception unit 312 connected via the HDMI cable 610. That is, the HDMI reception unit 312 has, in addition to the HDMI receiver 32, an EDID ROM (Read Only Memory) that stores EDID, which is performance information related to its own performance (configuration and capability). When the HDMI transmission unit 216 reads the EDID, decoding capability information of the receiving side is sent to the transmitting side.

[0171] The HDMI transmitting unit 216 reads the EDID from the HDMI receiving unit 312 connected via an HDMI cable 610 via the DDC 33. Then, the CPU 201 of the set-top box 200 recognizes the performance of the audio amplifier 300 having the HDMI receiving unit 312 based on the EDID.

[0172] The CEC line 34 is made up of one signal line included in the HDMI cable 610, and is used for bidirectional communication of control data between the HDMI transmitting unit 216 and the HDMI receiving unit 312. The HDMI cable 610 also includes an HPD line 35 that is connected to a pin called HPD (Hot Plug Detect).

[0173] The source device can detect the connection of the sink device (destination device) by using the HPD line 35 with a DC bias potential. In this case, when viewed from the source device side, the HPD line 35 has a function of receiving notification of the connection state from the sink device with a DC bias potential. On the other hand, when viewed from the sink device side, the HPD line has a function of notifying the source device of the connection state with a DC bias potential. The HDMI cable 610 also includes a power line 36 used to supply power from the source device to the sink device.

[0174] Furthermore, the HDMI cable 610 includes a reserved line 37. There is an HDMI Ethernet Channel (HEC) that transmits an Ethernet signal using the HPD line 35 and the reserved line 37. There is also an Audio Return Channel (ARC) that transmits audio data from a destination device (sink device) to a source device using both the HPD line 35 and the reserved line 37 or only the HPD line 35. Note that "Ethernet" is a registered trademark.

[0175] 21 shows various transmission data periods when image data of 1920 pixels horizontal x 1080 lines vertical is transmitted in a TMDS channel. In a video field in which data is transmitted in three TMDS channels of HDMI, there are three types of periods according to the type of transmission data: a video data period 24, a data island period 25, and a control period 26.

[0176] Here, the video field period is the period from the rising edge of one vertical synchronization signal (active edge) to the rising edge of the next vertical synchronization signal, and is divided into a horizontal blanking period 22 (horizontal blanking), a vertical blanking period 23 (vertical blanking), and an effective pixel period 21 (active video), which is the period excluding the horizontal blanking period and the vertical blanking period from the video field period.

[0177] The video data section 24 is allocated to the effective pixel section 21. In this video data section 24, data of effective pixels (active pixels) of 1920 pixels (picture elements) x 1080 lines constituting one screen's worth of uncompressed image data is transmitted. The data island section 25 and the control section 26 are allocated to the horizontal blanking interval 22 and the vertical blanking interval 23. In this data island section 25 and control section 26, auxiliary data is transmitted.

[0178] That is, the data island section 25 is allocated to a part of the horizontal blanking interval 22 and the vertical blanking interval 23. In this data island section 25, data not related to control among the auxiliary data, such as audio data packets, is transmitted. The control section 26 is allocated to the other part of the horizontal blanking interval 22 and the vertical blanking interval 23. In this control section 26, data related to control among the auxiliary data, such as vertical and horizontal synchronizing signals, control packets, etc., is transmitted.

[0179] [Media access control example] 22 shows an example of media access control. Media access information "data1" is divided and inserted into three audio frames of the audio stream and sent. When these three audio frames are received, the entire media access information "data1" is taken into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0180] This media access information "data1" includes "ID tables", "URL", "period1", "notification 'preparing'", "information_id1", "reference TC = TC1", and "UTC1", as shown in FIG. 23(a).

[0181] At the time when this media access information "data1" is received, as shown in FIG. 22(a), a rectangular message field 701 is provided on the screen of display panel 519, and for example, "preparing" is displayed, notifying the user that media access is being prepared.

[0182] After that, the media access information "data2" is sent by being divided and inserted into three audio frames of the audio stream. By receiving these three audio frames, the entire media access information "data2" is taken into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0183] As shown in FIG. 23(b), this media access information "data2" includes "URL", "period2", "notification'preparing'", "information_id2", "reference TC = TC2", and "UTC1". The identification information "information_id" in this media access information "data2" is "information_id2", which is different from "information_id1" in media access information "data1". This enables CPU 501 to determine that media access information "data2" is not related to media access information "data1".

[0184] At the time when this media access information "data2" is received, as shown in Figure 22(b), a rectangular message field 702 is further provided on the screen of display panel 519, and a message such as "preparing" is displayed, notifying the user that media access is being prepared.

[0185] After that, the media access information "data3" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data3" is loaded into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0186] As shown in FIG. 23(c), this media access information "data3" includes "action command 'autostart'", "notification 'access ready'", "information_id1", and "offset time = oft1". The identification information "information_id" in this media access information "data3" is "information_id1", which is the same as "information_id1" in media access information "data1". This enables CPU 501 to determine that media access information "data3" is associated with media access information "data1".

[0187] The action command "autostart" indicated by "action command 'autostart'" is activated when the offset time indicated by "offset time = oft1" in the media access information "data3" has elapsed from the reference time indicated by the reference time code in "reference TC = TC1" in the media access information "data1".

[0188] At this time, the "URL" of the media access information "data1" is used to access a server on the Internet. At this time, the "ID tables" and "period1" information of the media access information "data1" are also sent to the server. Note that these "ID tables" include the application ID (applicatio_id), network ID (network_id), transport ID (transport_id), service ID (service_id), and also the organization ID (organization_id) (see Figure 6).

[0189] In this way, by sending the information of "ID tables", the server is informed that the access is authorized. Also, by sending the information of "period1", the server plays back the media data portion of the audio stream corresponding to the scene indicated by "period1" and sends it to the television receiver 500.

[0190] When the action command "autostart" of the media access information "data3" is activated in this manner, as shown in Fig. 22(c), for example, 'access ready' is displayed in rectangular message field 701 on the screen of display panel 519, informing the user that media access is in progress. Also, a new rectangular display field 703 is provided on the screen of display panel 519, and images based on media data sent from the server, in this case video data, are displayed in this display field 703. Rectangular message field 702 is then erased at a predetermined timing.

[0191] In addition, if the current time (UTC) corresponding to the point in time when the offset time has elapsed from the reference time is later than the time indicated by "UTC1" in the media access information "data1", the time has expired and the action command "autostart" is not activated.

[0192] After that, the media access information "data4" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data4" is loaded into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0193] As shown in FIG. 23(d), this media access information "data4" includes "action command 'autostart'", "notification 'access ready'", "information_id2", and "offset time = oft2". The identification information "information_id" in this media access information "data4" is "information_id2", which is the same as "information_id2" in media access information "data2". This enables CPU 501 to determine that media access information "data4" is associated with media access information "data2".

[0194] The action command "autostart" indicated by "action command 'autostart'" is activated when the offset time indicated by "offset time = oft2" in the media access information "data4" has elapsed from the reference time indicated by the reference time code in "reference TC = TC2" in the media access information "data2".

[0195] At this time, the "URL" of the media access information "data2" is used to access a server on the Internet. At this time, the "period2" information of the media access information "data2" is also sent to the server. By sending the "period2" information in this manner, the server plays back the media data portion of the audio stream that corresponds to the scene indicated by "period2", and sends it to the television receiver 500.

[0196] When the action command "autostart" of the media access information "data4" is activated in this manner, as shown in Fig. 22(d), for example, 'access ready' is displayed in rectangular message field 702 on the screen of display panel 519, informing the user that media access is in progress. Also, a new rectangular display field 704 is provided on the screen of display panel 519, and images based on the media data sent from the server, in this case video data, are displayed in this display field 704. Rectangular message field 702 is then erased.

[0197] In addition, if the current time (UTC) corresponding to the point in time when the offset time has elapsed from the reference time is later than the time indicated by "UTC1" in the media access information "data2", the time has expired and the action command "autostart" is not activated.

[0198] 22 and 23, the media access information "data3" and "data4" including an action command includes offset time information "offset time = oft1" and "offset time = oft2". However, by using the "target_segment_id" information indicating the "segment_id" of the media access information that specifies the offset time, it is also possible to include the offset time information "offset time = oft1" and "offset time = oft2" in the media access information "data1" and "data2".

[0199] Figures 24(a), (b), (c), and (d) show the information included in the media access information "data1", "data2", "data3", and "data4" in this case. That is, as shown in Figure 24(a), the media access information "data1" includes "ID tables", "URL", "period1", "notification'preparing'", "information_id1", "segment#1", "reference TC = TC1", "offsettime = oft1", "target_segment_id = segment#3", and "UTC1".

[0200] In addition, the media access information "data2" includes "URL", "period2", "notification'preparing'", "information_id2", "segment#2", "reference TC = TC2", "offsettime = oft2", "target_segment_id = segment#4", and "UTC1", as shown in FIG. 24(b).

[0201] Moreover, the media access information "data3" includes "action command 'autostart'", "notification 'access ready'", "information_id1", and "segment #3" as shown in Fig. 24(c). Moreover, the media access information "data4" includes "action command 'autostart'", "notification 'access ready'", "information_id2", and "segment #4" as shown in Fig. 24(d).

[0202] 25 shows another example of media access control. Media access information "data1" is divided and inserted into three audio frames of the audio stream and sent. Upon receiving these three audio frames, the entire media access information "data1" is taken into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0203] This media access information "data1" includes "ID tables", "UI selection process", "notification 'preparing'", "information_id1", "reference TC = TC1", and "UTC1", as shown in FIG. 26(a).

[0204] At the time when this media access information "data1" is received, as shown in Fig. 25(a), a rectangular message field 801 is provided on the screen of the display panel 519, and for example, 'preparing' is displayed, to notify the user that the device is in the process of preparing for user selection. In addition, this screen displays a number of thumbnail images 802 for allowing the user to select playback media, based on the information of "UI selection process".

[0205] After that, the media access information "data2" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data2" is loaded into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0206] As shown in FIG. 26(b), this media access information "data2" includes "action command 'user selected'", "notification 'user selected'", "information_id1", and "offset time = oft1". The identification information "information_id" in this media access information "data2" is "information_id1", which is the same as "information_id1" in media access information "data1". This enables CPU 501 to determine that media access information "data2" is related to media access information "data1".

[0207] When the offset time indicated by "offset time = oft1" in the media access information "data2" has elapsed from the reference time indicated by the reference time code "reference TC = TC1" in the media access information "data1," the action command "user selected" indicated by "action command 'user selected'" is activated, and it becomes possible to select the playback media by selecting a specific thumbnail.

[0208] At this time, as shown in Fig. 25(b), for example, 'user selected' is displayed in rectangular message field 801 on the screen of display panel 519, informing the user that playback media can be selected. Note that Fig. 25(b) shows that thumbnail 802a has been selected by the user and its display state has changed. After the user has finished selecting playback media in this way, the rectangular message field 801 and the thumbnail display are erased at a prescribed timing.

[0209] In addition, if the current time (UTC) corresponding to the point in time when the offset time has elapsed from the reference time is later than the time indicated by "UTC1" in the media access information "data1", the time has expired and the action command "user selected" is not activated.

[0210] After that, the media access information "data3" is sent by being divided and inserted into three audio frames of the audio stream. By receiving these three audio frames, the entire media access information "data3" is taken into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0211] As shown in FIG. 26(c), this media access information "data3" includes "URL", "notification'preparing'", "information_id1", "reference TC = TC2", and "UTC1". The identification information "information_id" in this media access information "data3" is "information_id1", which is the same as "information_id1" in the media access information "data1" and "data2". This enables CPU 501 to determine that media access information "data3" is related to media access information "data1" and "data2".

[0212] At the time when this media access information "data3" is received, as shown in Figure 25 (c), a rectangular message field 803 is further provided on the screen of display panel 519, and a message such as 'preparing' is displayed, notifying the user that media access is being prepared.

[0213] After that, the media access information "data4" is inserted into one audio frame of the audio stream and sent. Upon receiving this one audio frame, the entire media access information "data4" is loaded into a buffer in the audio decoder 520 and then sent to the CPU 501.

[0214] As shown in FIG. 26(d), this media access information "data4" includes "action command 'autostart'", "notification 'access ready'", "information_id1", and "offset time = oft2". The identification information "information_id" in this media access information "data4" is "information_id1", which is the same as the "information_id1" in the media access information "data1", "data2", and "data3". This enables CPU 501 to determine that media access information "data4" is associated with media access information "data1", "data2", and "data3".

[0215] The action command "autostart" indicated by "action command 'autostart'" is activated when the offset time indicated by "offset time = oft2" in the media access information "data4" has elapsed from the reference time indicated by the reference time code in "reference TC = TC2" in the media access information "data3".

[0216] At this time, the "URL" of the media access information "data3" is used to access a server on the Internet. At this time, the "ID tables" and "period1" information of the media access information "data1" as well as the ID "select_ID" for indicating the user selection result related to the media access information "data2" are also sent to the server.

[0217] In this way, by sending the information of "ID tables", it is indicated to the server that the access is authorized. In addition, by sending the information of "select_ID" and "period1", the server plays the media data portion of the playback media selected by the user that corresponds to the scene indicated by "period1" of the audio stream, and sends the media data portion to the television receiver 500.

[0218] When the action command "autostart" of the media access information "data4" is activated in this manner, as shown in Fig. 25(d), for example, 'access ready' is displayed in rectangular message field 803 on the screen of display panel 519, informing the user that media access is in progress. Also, a new rectangular display field 804 is provided on the screen of display panel 519, and images based on the media data sent from the server, in this case video data, are displayed in this display field 804. Rectangular message field 803 is then erased at a predetermined timing.

[0219] In addition, if the current time (UTC) corresponding to the point in time when the offset time has elapsed from the reference time is later than the time indicated by "UTC1" in the media access information "data3", the time has expired and the action command "autostart" is not activated.

[0220] 25 and 26, the media access information "data2" and "data4" including an action command includes offset time information "offset time = oft1" and "offset time = oft2". However, by using the "target_segment_id" information indicating the "segment_id" of the media access information that specifies the offset time, it is also possible to include the offset time information "offset time = oft1" and "offset time = oft2" in the media access information "data1" and "data3".

[0221] "Example of checking the source of media data" As mentioned above, the universal metadata frame (see Figure 6) contains a 32-bit field called "organization_id." This field indicates an identification value that is uniquely assigned to each service transmitted in the user data area, or to the provider or standard organization of this service (e.g., "ATSC," "DVB," etc.). This "organization_id" can be used as check information to check the provider of media data obtained using media access information.

[0222] An example of checking the provider of media data using "organization_id" will be described using the service system of Fig. 27. In Fig. 27, a television receiver 500 is connected to the Internet. Also connected to the Internet are a server A and a server B. This example is a case where the television receiver 500 accesses server A using URL1 supplied by a broadcast service from broadcast wave A directly or via set-top box 200, and receives an application (media data) linked to broadcast A via the Internet.

[0223] URL1 is supplied to the television receiver 500 via broadcast wave A. An "organization_id" is added to this URL1. The television receiver 500 accesses server A using URL1. Server A performs authentication processing for the access from the television receiver 500 and returns an Ack response to the television receiver 500, and also notifies server B of URL2 of the IP address of the television receiver 500 in an inter-server access to cooperate with the television receiver 500, and transfers the access from the television receiver 500 to server B.

[0224] Server B transmits the media playback related information to the television receiver 500. This media playback related information is, for example, image information of a plurality of thumbnails for allowing the user to select the playback media. The television receiver 500 checks the source of the media playback related information to determine whether it is provided by the same service organization as the "organization_id" received from the A broadcast wave, and then transmits a media playback command to Server B.

[0225] The television receiver 500 performs this source check, for example, as follows. That is, the television receiver 500 recognizes, from a table or the like, the characters associated with the identification value indicated by the "organization_id" received from the A broadcast wave, "ATSC_ch5_net_sports" in this case. Note that the characters "ATSC_ch5_net_sports" may be associated with URL1 received together with the "organization_id" from the A broadcast wave.

[0226] The television receiver 500 checks the source by checking whether the media playback related information sent from server B to the television receiver 500 contains the characters “ATSC_ch5_net_sports” or whether the information obtained by accessing a URL (e.g., http: / / service.organization.information) included in the media playback related information contains the characters “ATSC_ch5_net_sports.”

[0227] After checking the provider to confirm that the provider is correct, the television receiver 500 sends a media playback command to server B as described above. Server B performs media playback in accordance with the media playback command, and transmits media playback data (media data) to the television receiver 500. The television receiver 500 performs output based on the media playback data, such as image display and audio output.

[0228] In the above example, "organization_id" is used as check information to check the source of the media data acquired using the media access information. However, the check information is not limited to "organization_id", and other check information may be added to the media access information and used to check the source.

[0229] As described above, in the transmission / reception system 10 shown in Fig. 1, the broadcast transmission device 100 sequentially inserts a predetermined number of related media access information for a series of media access controls into an audio stream (audio compressed data stream) and transmits the same. Therefore, the receiving side can perform a series of media access controls well.

[0230] 1, the broadcast transmission device 100 is capable of dividing and inserting media access information into a predetermined number of audio frames of an audio stream (audio compressed data stream). Therefore, even if the total size of the media access information is large, the size of information inserted into each audio frame can be suppressed, and the predetermined information can be transmitted satisfactorily without affecting the transmission of the audio compressed data.

[0231] 1, the television receiver 500 acquires a predetermined number of pieces of media access information for media access control that are sequentially inserted into the audio stream together with the video data and audio data as the first media data, and acquires the second media data based on the media access information. This allows the second media data to be presented well in correspondence with the media presentation of the first media data.

[0232] 1, the broadcast sending device 100 inserts information indicating that the encoded stream is to be prioritized as the transmission format of audio data into the layer of the transport stream as a container. This makes it possible to prioritize the format of the encoded stream as the transmission format of audio data in the set-top box 200 and the audio amplifier 300. This makes it possible to reliably supply the audio stream to the television receiver 500 with the media access information inserted in the audio stream.

[0233] 1, the broadcast sending device 100 adds check information (e.g., "organization_id") to the media access information inserted into the audio stream (audio compressed data stream) or the transport stream as a container, for checking the source of the media data acquired using the media access information. Therefore, the receiving side can simply and easily check the source of the media data acquired using the media access information based on the check information.

[0234] <2. Modifications> In the above embodiment, the broadcast transmitting device 100 sequentially inserts a predetermined number of pieces of media access information related to a series of media access controls into an audio stream (audio compressed data stream) and transmits the information. However, it is also conceivable that the broadcast transmitting device 100 sequentially inserts a predetermined number of pieces of media access information into other media streams such as a video stream and transmits the information. It is also conceivable that the broadcast transmitting device 100 sequentially inserts a predetermined number of pieces of media access information into a layer of a transport stream TS as a container and transmits the information.

[0235] In this case, Fig. 28 shows a configuration example of a stream generating unit 110A provided in the broadcast transmitting device 100. In Fig. 27, parts corresponding to those in Fig. 3 are given the same reference numerals, and detailed explanations thereof will be omitted as appropriate. This stream generating unit 110A has a control unit 111, a video encoder 112, an audio encoder 113A, and a multiplexer 114A.

[0236] In the audio encoder 113A, the audio data SA is encoded in the MPEG-H 3D Audio compression format to generate an audio stream (audio compressed data stream). Unlike the audio encoder 113 in the stream generation unit 110 in Fig. 3, this audio encoder 113A does not insert media access information into the audio stream.

[0237] The video stream generated by the video encoder 112 is supplied to a multiplexer 114A. Also, the audio stream generated by the audio encoder 113A is supplied to the multiplexer 114A. Then, in this multiplexer 114A, the streams supplied from the respective encoders are packetized and multiplexed, and a transport stream TS is obtained as transmission data.

[0238] At this time, in the multiplexer 114A, a predetermined number of pieces of media access information related to a series of media access controls are sequentially inserted as container target data into the layer of the transport stream TS as a container under the control of the control unit 111. For example, in the multiplexer 114A, a newly defined application descriptor (Application_descriptor) having media access information is inserted under an application information table (AIT).

[0239] Figure 29 shows an example of the structure (Syntax) of an application descriptor. The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an application descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0240] The 8-bit field "data_id" indicates the ID of the media access information. It is the same information as the "data_id" field in the universal metadata frame (see Figure 6) described above. Following the "data_id" field is the Access Information Data (Access_information_data()) field (see Figure 7-9) which contains the media access information.

[0241] Fig. 30 shows an example of the structure of a transport stream TS when an application descriptor (Application_descriptor) is inserted under the AIT. In this example, an audio stream (Audio coded stream) is inserted into the PES payload of the PES packet of the audio stream. However, access information data (Access_information_data()) including media access information (container target data) is not inserted into this audio stream.

[0242] In addition to the Program Map Table (PMT), the transport stream TS also contains an Application Information Table (AIT), which contains an application identifier (Application_id) and an application descriptor (see FIG. 29).

[0243] Fig. 31 shows a configuration example of a set-top box 200A in the case where the media access information is inserted into, for example, a layer of a transport stream TS as a container and transmitted as described above. In Fig. 31, the same reference numerals are given to parts corresponding to Fig. 17, and detailed description thereof is omitted as appropriate. The set-top box 200A has a CPU 201, a flash ROM 202, a DRAM 203, an internal bus 204, a remote control receiver 205, and a remote control transmitter 206. The set-top box 200A also has an antenna terminal 211, a digital tuner 212, a demultiplexer 213A, a video decoder 214, a data inserter 218, an audio framing unit 215, an HDMI transmitter 216, and an HDMI terminal 217.

[0244] In the demultiplexer 213, packets of the audio stream are extracted from the transport stream TS, and an audio stream (audio compressed data stream) is reconstructed. In addition, in the demultiplexer 213A, various descriptors and the like are extracted from the transport stream TS, and sent to the CPU 201. The descriptors include an application descriptor (see FIG. 29) having media access information.

[0245] The audio stream extracted by the demultiplexer 213A is supplied to a data insertion unit 218. Predetermined information is supplied to this data insertion unit 218 from the CPU 201. Under the control of the CPU 201, the data insertion unit 218 inserts media access information into the audio stream.

[0246] In this case, similarly to the audio encoder 113 of the stream generating unit 110 in Fig. 3, the media access information is divided and inserted into a predetermined number (including 1) of audio frames of the audio stream (see Figs. 13-15). At this time, information indicating the total size of the media access information is added to the first division information. In addition, information indicating whether it is the first division information or not and a count number in descending order as information indicating the division position are added to each division information.

[0247] In this case, the number of divisions is determined so that the bit rate of the audio stream into which the media access information is inserted falls within the transmission bandwidth capacity range of HDMI. As a result, depending on the overall size of the media access information, the entire media access information may be inserted into one audio frame without being divided.

[0248] The audio stream into which the media access information from the data inserting unit 218 has been inserted is framed by the audio framing unit 215 and then supplied to the HDMI transmitting unit 216. The set-top box 200A shown in Fig. 31 is otherwise configured in the same manner as the set-top box 200 shown in Fig. 17.

[0249] In addition, when the media access information is transmitted, for example, inserted into a layer of a transport stream TS as a container, as described above, in the television receiver 500 shown in Figure 19, the demultiplexer 513 extracts an application descriptor (see Figure 29) having the media access information, making it possible to use the media access information.

[0250] Also, in the above-described embodiment, the set-top box 200 is configured to receive a video stream and an audio stream from a broadcast signal sent from the broadcast sending device 100. However, the set-top box 200 may also be configured to receive a video stream and an audio stream from a distribution server (streaming server) via a network.

[0251] In the above embodiment, an example in which the container is a transport stream (MPEG-2 TS) is shown. However, the present technology can be similarly applied to a system in which data is delivered in a container of MP4 or other formats. For example, this is an MPEG-DASH-based stream delivery system, or a transmission / reception system that handles an MMT (MPEG Media Transport) structure transmission stream.

[0252] 32 shows an example of the structure of an MMT stream when media access information (container target data) is inserted into an audio stream and sent. In an MMT stream, there are MMT packets for each asset such as video and audio. In this example structure, there is an MMT packet for an audio asset identified by ID2 along with an MMT packet for a video asset identified by ID1.

[0253] Access information data (Access_information_data()) containing media access information is inserted into the universal metadata frame (universal_metadata_frame()) in a certain number (including 1) of audio frames of an audio asset (audio stream).

[0254] In addition, the MMT stream contains message packets such as PA (Packet Access) message packets. The PA message packets contain tables such as the MMT Packet Table (MMT Package Table). The MP table contains information for each asset. In this case, the audio asset information also includes an audio streaming descriptor (see Figure 12(a)).

[0255] Fig. 33 shows an example of the structure of an MMT stream when media access information (container target data) is inserted into a container and sent. In an MMT stream, there are MMT packets for each asset such as video and audio. In this example structure, there are MMT packets for an audio asset identified by ID2 along with an MMT packet for a video asset identified by ID1. In this example structure, unlike the example structure in Fig. 31, no media access information is included in the audio asset (audio stream).

[0256] Additionally, the MMT stream contains message packets such as PA (Packet Access) message packets. The PA message packet contains the MMT Packet Table (MPT: MMT Package Table) and other information. The MPT contains information for each asset. Additionally, the PA message packet contains an Application Information Table (AIT). An Application Descriptor (Application_descriptor) with access information data (Access_information_data()) is inserted under this AIT.

[0257] In addition, in the above embodiment, an example has been shown in which the audio compression format is MPEG-H 3D Audio, but the present technology can also be applied to cases in which the audio compression format is other audio compression formats such as AAC, AC3, AC4, etc.

[0258] Figure 34(a) shows the structure of the AC4 Simple Transport layer. There are a sync word field, a frame length field, a "RawAc4Frame" field as the coded data field, and a CRC field. As shown in Figure 34(b), the "RawAc4Frame" field starts with a TOC (Table Of Contents) field, followed by a predetermined number of substream fields.

[0259] As shown in Figure 35 (b), the substream (ac4_substream_data()) contains a metadata area (metadata), which contains a "umd_payloads_substream()" field. Universal data (universal_data()) is placed in the "umd_payload_byte" field within this "umd_payloads_substream()" field.

[0260] Figure 36 shows an example of the universal data structure (syntax), and Figure 37 shows the main information contents (semantics) in that structure example. The 1-bit field of "start_flag" indicates whether or not this is the start of container target data. "1" indicates that it starts from this packet, and "0" indicates that this packet is not the start. The 7-bit field of "fcounter" indicates the division position of the divided container target data in descending order as a count number, with "0" indicating the last divided part. If "start_flag" is "1" and "fcounter" is "0", it indicates that it is not divided.

[0261] When "start_flag" is "1", there is a 32-bit field "organization_id" and a 16-bit field "target_data_size". The "organization_id" field indicates an identification value that is uniquely assigned to each service transmitted in the user data area, or to the provider or standard organization of this service (e.g., "ATSC", "DVB", etc.). The "target_data_size" field indicates the data size of the container target data before division in bytes. The whole of the access information data (Access_information_data()) (see Figure 7) or a part of it (division information) is inserted into the "data_payload_byte" field.

[0262] Also, if the audio compression format is AC4, an AC4 data container descriptor (AC4_datacontainer_desucriptor) is inserted into the container layer.

[0263] Figure 38 shows an example of the structure (syntax) of an AC4 data container descriptor, and Figure 39 shows the main information content (semantics) of that structure example. The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an application descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0264] The 1-bit field of "umd_payload_embedded" indicates whether a UMD payload is inserted or not. "1" indicates that a UMD payload is inserted, and "0" indicates that a UMD payload is not inserted. When "umd_payload_embedded" is "1", the 5-bit field of "umd_payload_id" and the 11-bit field of "audio_stream_rate" are present.

[0265] The "umd_payload_id" field indicates an identification value of the UMD payload. A specific value is defined as this identification value. For example, "7" indicates that it is a universal data container format. The "audio_stream_rate" field indicates the delivery bit rate of the audio stream.

[0266] Fig. 40 shows an example of the structure of an MPEG-2 TS transport stream when the audio compression format is AC4. In this example structure, the portion related to the video stream is omitted. In this example structure, there is a PES packet "audio PES" of the audio stream identified by PID2. The PES packet consists of a PES header (PES_header) and a PES payload (PES_payload). DTS and PTS timestamps are inserted in the PES header.

[0267] An audio stream (Audio coded stream) is inserted into the PES payload of the PES packet of the audio stream. Access information data (Access_information_data()) (see Figures 7 to 9) including media access information (container target data) is inserted into the universal metadata (universal_metadata()) in a certain number of substreams (including 1) of this audio stream.

[0268] Additionally, MPEG-2 TS transport streams contain a PMT (Program Map Table) as PSI (Program Specific Information). PSI is information that describes which program each elementary stream in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program.

[0269] The PMT also contains an elementary stream loop that contains information related to each elementary stream. In this configuration example, there is an audio elementary stream loop (audio ES loop) that corresponds to the audio stream.

[0270] In this audio elementary stream loop, information such as stream type and PID (packet identifier) ​​corresponding to the audio stream is placed, as well as a descriptor describing information related to the audio stream. The value of the stream type "Stream_type" is set to "0x2C", and the PID information indicates PID1 that is added to the PES packet "audio PES" of the audio stream as described above. The above-mentioned AC4 data container descriptor (see Figure 38) is placed as one of the descriptors.

[0271] Additionally, an MPEG-2 TS transport stream contains an Event Information Table (EIT). A component descriptor is placed under this EIT. This component descriptor describes that the service contains meta-information for network connection.

[0272] 41 shows an example of the structure of an MMT transport stream when the audio compression format is AC4. In this example, the part related to the video asset (video stream) is omitted. In this example, there is an MMT packet of an audio asset (audio stream) identified by ID2.

[0273] Access information data (Access_information_data()) (see Figures 7 to 9) including media access information (container target data) is inserted into the universal metadata (universal_metadata()) in a predetermined number (including 1) of substreams of an audio asset (audio stream).

[0274] Additionally, MMT transport streams contain message packets such as PA (Packet Access) message packets. PA message packets contain tables such as the MP table (MPT: MMT Package Table). In the MPT, information such as asset type (Asset_type) and packet ID (Packet_id) corresponding to audio assets is placed, and a descriptor that describes information related to the audio asset is also placed. One of these descriptors is the AC4 data container descriptor (see Figure 38) mentioned above.

[0275] Additionally, the MMT transport stream contains an Event Information Table (EIT). Under this EIT, a component descriptor is placed. This component descriptor describes that the service contains meta-information for network connection.

[0276] Fig. 42 shows an example of the configuration of an MP4 stream (file) including data of an audio track (track A) when the audio compression format is AC4. The example shown is an example of a fragmented MP4. In the MP4 stream, a certain number of movie fragments are arranged, each of which is made up of a "moof" box that contains control information and an "mdat" box that contains the media data itself. Since the "mdat" box contains a fragment obtained by fragmenting the track data, the control information contained in the "moof" box is control information related to that fragment.

[0277] In the "audio bitstream" MP4 stream corresponding to the audio track, a certain number of AC4 frames are placed in the "mdat" box of each movie fragment. In this "audio bitstream" MP4 stream, a "traf" box exists in the "moof" box of each movie fragment, and a "tfdt" box exists in that box. This "tfdt" box contains the decode time "baseMediaDecodeTime" of the first access unit after the "moof" box.

[0278] Furthermore, within the "moof" box there is a "tfdt" box, within which there is an "sgpd" box, which in turn contains a "tscl" box. This "tscl" box contains the parameters "Audiostreamtype" and "Attribute". "Audiostreamtype = AC4" indicates that the audio compression format is AC4. "Attribute = soundumd" indicates that metadata (such as media access information) has been inserted within the AC4 track. Specifically, the contents of the AC4 Data Container Descriptor shown in Figure 38 above are described as "soundumd".

[0279] Fig. 43 shows an example of an MPD file description. Fig. 44 shows the contents of main information in the description example. As is well known in the art, in an MPEG-DASH-based stream delivery system, a media stream (MP4 stream) and an MPD file as a metafile are transmitted to a receiving side through a communication network transmission path.

[0280] " <adaptationset mimetype=""audio / mp4”" group=""1”">" indicates that an adaptation set (AdaptationSet) exists for the audio stream, that the audio stream is provided in an MP4 file structure, and that group 1 is assigned to the audio stream. <supplementarydescriptor schemeiduri=""urn:brdcst:codecType”" value=""AC4” / ">" indicates that the codec of the audio stream is AC4. "schemeIdUri="urn:brdcst:codecType" indicates the type of codec. For example, "value" can be "mpegh", "AAC", "AC3", or "AC4".

[0281] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:coordinatedControl”" value=""false” / ">" indicates that the net connection information is supplied only by the stream of this adaptation set. "schemeIdUri="urn:brdcst:coordinatedControl" indicates whether the information necessary for the net connection is supplied in a coordinated manner across multiple media streams. For example, when "value" is "true", it indicates that the net connection information is supplied in coordination with the streams of other adaptation sets. When "value" is "false", it indicates that the net connection information is supplied only by the stream of this adaptation set.

[0282] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:UMDContained”" value=""true” / ">" indicates that metadata is included in the audio stream. "schemeIdUri="urn:brdcst:UMDContained" indicates whether metadata is included in the audio stream. For example, when "value" is "true", it indicates that audio meta information is included. When "value" is "false", it indicates that audio meta information is not included.

[0283] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:metaInsertionFrequency”" value=""1” / ">" indicates that meta information is provided on an access unit basis. "schemeIdUri="urn:brdcst:metaInsertionFrequency" indicates the frequency at which meta information is provided on an access unit basis. For example, "1" indicates that one user data entry occurs in one access unit. "2" indicates that multiple user data entries occur in one access unit. "3" indicates that one or more user data entries occur during a period separated by a random access point.

[0284] Also," <supplementarydescriptor schemeiduri=""urn:brdcst:type”value="netlink” / ">" indicates that the type of meta-based service is Internet connection. "schemeIdUri="urn:brdcst:type"" indicates the type of meta-based service. For example, when "value" is "netlink", it indicates that the type of meta-based service is Internet connection.

[0285] In the above embodiment, an example has been shown in which the audio amplifier 300 is interposed between the set-top box 200 and the television receiver 500. However, a transmission / reception system 10A as shown in Fig. 45 in which the set-top box 200 is directly connected to the television receiver 500 may also be considered.

[0286] In this transmission / reception system 10A, the set-top box 200 and the television receiver 500 are connected via an HDMI cable 610. In this case, the set-top box 200 is the source, and the television receiver 500 is the destination. The audio amplifier 300 and the television receiver 500 are connected via an HDMI cable 620. In this case, the audio amplifier 300 is the source, and the television receiver 500 is the destination.

[0287] In this case, uncompressed video data and an audio stream into which media access information (container target data) is inserted are transmitted from the set-top box 200 to the television receiver 500 via the HDMI digital interface. Also, the audio stream itself or decoded audio data is transmitted from the television receiver 500 to the audio amplifier 300 using the HDMI audio return channel.

[0288] In the above embodiment, the transmitting / receiving system 10 has the set-top box 200 and the television receiver 500. However, a configuration in which a monitor device, a projector, or the like is provided instead of the television receiver 500 is also possible. Also, a configuration in which a recorder with a receiving function, a personal computer, or the like is provided instead of the set-top box 200 is also possible.

[0289] In the above embodiment, the receiving devices are connected by wire through an HDMI digital interface. However, the present invention can be applied to cases where the devices are connected by wire through a digital interface similar to HDMI, and even to cases where the devices are connected wirelessly.

[0290] In the above embodiment, the transmission / reception system 10 is shown in which the set-top box 200 receives the transport stream TS transmitted from the broadcast transmission device 100 via broadcast waves. However, as shown in Fig. 46, a transmission / reception system 10B may be considered in which the television receiver 500 directly receives the transport stream TS transmitted from the broadcast transmission device 100 via broadcast waves.

[0291] The present technology can also be configured as follows. (1) a transmitter for transmitting a container in a predetermined format including a media stream; An information insertion unit for sequentially inserting a predetermined number of pieces of media access information related to a series of media access controls into a layer of the media stream or a layer of the container. Transmitting device. (2) The above media access information includes identification information to distinguish it from other media access information. The transmitting device according to (1) above. (3) The above media access information includes identification information for associating it with other media access information. A transmitting device according to (1) or (2). (4) The media access information includes period information indicating a corresponding scene in the media stream. A transmitting device according to any one of (1) to (3). (5) The above media access information includes user interface information for allowing a user to select a playback medium. A transmitting device according to any one of (1) to (3). (6) The above media access information includes time information for managing the initiation of action commands. A transmitting device according to any one of (1) to (3). (7) The above media access information includes absolute time information indicating the deadline for media playback. A transmitting device according to any one of (1) to (3). (8) The above media access information includes notification information for notifying the user of the status. A transmitting device according to any one of (1) to (3). (9) The information insertion unit is Each of the pieces of division information obtained by dividing the media access portion can be inserted into a predetermined number of unit portions of the media stream. A transmitting device according to any one of (1) to (8). (10) the media stream is an audio compressed data stream; The information inserting unit inserts the division information into a user data area of ​​the audio frame as the unit part. The transmitting device according to (9) above. (11) a transmitting step of transmitting a container in a predetermined format including a media stream by a transmitting unit; An information insertion step of sequentially inserting a predetermined number of pieces of media access information related to a series of media access controls into a layer of the media stream or a layer of the container. Transmission method. (12) a first acquisition unit that acquires first media data and sequentially acquires a predetermined number of pieces of media access information for a series of media access controls; a second acquisition unit that acquires second media data related to the first media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Media processing device. (13) The first acquisition unit, A receiving unit for receiving a container in a predetermined format including a media stream, The media access information is inserted into a layer of the media stream or into a layer of the container; The first acquisition unit includes: a decoding processing unit that performs a decoding process on the media stream to obtain the first media data; The media access information may be extracted from a layer of the media stream or a layer of the container. The media processing device according to (12) above. (14) The first acquisition unit, a receiving unit that receives the video data as the first media data and the audio compressed data stream into which the media access information is inserted from an external device via a digital interface; a decoding processing unit that performs a decoding process on the audio compressed data stream to obtain audio data as the first media data; an information extractor for extracting the media access information from the audio compressed data stream; The media processing device according to (12) above. (15) a first acquisition step of acquiring first media data by a first acquisition unit and sequentially acquiring a predetermined number of pieces of media access information related to the first media data for a series of media access controls; a second acquisition step of acquiring, by a second acquisition unit, second media data related to the first media data based on the media access information; a presentation processing step of performing a media presentation process using the first media data and the second media data; Media processing methods. (16) A receiving unit for receiving a container in a predetermined format including a media stream, a predetermined number of related media access information for a series of media access controls are sequentially inserted into a layer of the media stream or a layer of the container; a decoding processing unit that performs a decoding process on the media stream to obtain first media data; an information extraction unit for extracting the media access information from a layer of the media stream or a layer of the container; a media data acquisition unit that acquires second media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Receiving device. (17) a receiving unit that receives, from an external device via a digital interface, a compressed audio data stream into which video data as first media data and a predetermined number of pieces of media access information for a series of media access controls are sequentially inserted; a decoding processing unit that performs a decoding process on the audio compressed data stream to obtain audio data as the first media data; an information extractor for extracting the media access information from the audio compressed data stream; a media data acquisition unit that acquires second media data based on the media access information; a presentation processing unit that performs a presentation process of the first media data and the second media data; Receiving device. (18) a transmitting unit for transmitting a container in a predetermined format including an audio encoded stream into which predetermined information is inserted; An information inserting unit that inserts information indicating that the encoded stream is to be prioritized as a transmission format for audio data into the layer of the container. Transmitting device. (19) The predetermined information is a predetermined number of related media access information for a series of media access controls. The transmitting device according to (18). (20) a transmitting step of transmitting, by a transmitting unit, a container of a predetermined format including an audio encoded stream in which predetermined information is inserted in a user data area; An information inserting step of inserting information indicating that the encoded stream is to be prioritized as a transmission format of the audio data into the layer of the container. Transmission method. (20) a transmitting unit for transmitting a container in a predetermined format including a media stream; An information insertion unit that inserts media access information into the layer of the media stream or the layer of the container by adding check information for checking a source of the media data obtained using the media access information. Transmitting device. (21) The above check information is An identification value uniquely assigned to each service according to the above media access information, or to the provider or standard organization of the service. The transmitting device according to (21) above. (23) a transmitting step of transmitting, by a transmitting unit, a container in a predetermined format including a media stream; An information inserting step of inserting media access information into a layer of the media stream or a layer of the container together with check information for checking a source of the media data obtained using the media access information. Transmission method. (24) A media access information acquisition unit for acquiring media access information, The media access information includes check information for checking a source of the media data obtained using the media access information. a media data acquisition unit that acquires media data based on the media access information; The information processing device further includes a provider check unit that checks a provider of the acquired media data based on the check information. Media processing device. (25) A media access information acquisition step of acquiring media access information by a media access information acquisition unit, The media access information includes check information for checking a source of the media data obtained using the media access information. a media data acquisition step of acquiring media data based on the media access information; The method further includes a source checking step of checking a source of the acquired media data based on the check information. Media processing methods.

[0292] The main feature of this technology is that it enables a series of media access controls to be performed effectively on the receiving side by sequentially inserting a predetermined number of related media access information for a series of media access controls into the media stream layer or container layer and transmitting them (see Figures 6-11 and 16). [Explanation of symbols]

[0293] 10, 10A, 10B...Transmitting and receiving system 21 Effective pixel section 22 Horizontal blanking period 23 Vertical blanking period 24 Video data section 25 Data island section 26. Control Section 31···HDMI transmitter 32···HDMI Receiver 33...DDC 34 CEC Line 35 HPD line 36 Power line 37 Reserve Line 100 Broadcast transmission device 110, 110A Stream generation unit 111 Control unit 111a···CPU 112 Video Encoder 113,113A···Audio Encoder 113a Audio encoding block 113b Audio Framing Section 114,114A···Multiplexer 200,200A···Set-top box (STB) 201···CPU 202 Flash ROM 203...DRAM 204... Internal bus 205 Remote control receiver 206···Remote control transmitter 211 Antenna terminal 212···Digital Tuner 213, 213A···Demultiplexer 214...Video decoder 215 Audio Framing Section 216 HDMI transmitter 217···HDMI terminal 218 Data insertion section 300···Audio amplifier (AMP) 301···CPU 302 Flash ROM 303...DRAM 304... Internal bus 305 Remote control receiver 306···Remote control transmitter 311...HDMI terminal 312 HDMI receiver 313 Audio Decoder 314 Audio processing circuit 315 Audio amplifier circuit 316 Audio output terminal 317···HDMI transmitter 318···HDMI terminal 400···Speaker System (SP) 500 ···Television receiver (TV) 501··CPU 502···Flash ROM 503··DRAM 504... Internal bus 505 Remote control receiver 506···Remote control transmitter 507 Communication Interface 511 Antenna terminal 512···Digital Tuner 513···Demultiplexer 514...Video Decoder 515···HDMI terminal 516···HDMI receiver 517 Video processing circuit 518 Panel drive circuit 519 Display panel 520...Audio Decoder 521 Audio processing circuit 522 Audio amplifier circuit 523···Speaker 610,620··HDMI cable< / supplementarydescriptor> < / supplementarydescriptor> < / supplementarydescriptor> < / supplementarydescriptor> < / supplementarydescriptor> < / adaptationset>

Claims

1. An acquisition unit for acquiring an audio stream; a decoding unit that performs a decoding process on the acquired audio stream to obtain uncompressed audio data; a processing unit that performs an upmix process or a downmix process on the audio data supplied from the decoding unit, Information processing device.

2. The audio stream is composed of MPEG Audio Stream Packets. The information processing device according to claim 1 .

3. The MPEG audio stream packet is composed of a header and a payload. The information processing device according to claim 2 .

4. The payload includes "SYNC" corresponding to a synchronization start code, "Frame" which is actual data of 3D audio transmission data, and "Config" which indicates the configuration of "Frame", The information processing device according to claim 3 .

5. The "Frame" includes channel-encoded data or object-encoded data constituting transmission data of 3D audio. The information processing device according to claim 4.

6. The object coding data is composed of SCE (Single Channel Element) coded sample data and metadata for mapping the coded sample data to speakers located at any positions for rendering. The information processing device according to claim 5 .

7. The metadata is included as an extension element (Ext_element), The information processing device according to claim 6.

8. The audio stream is included in a transport stream, the transport stream includes a descriptor describing information related to the audio stream; The information processing device according to claim 1 .

9. The descriptor has an 8-bit field "descriptor_tag" that is information indicating a descriptor type of the descriptor. The information processing device according to claim 8.

10. The descriptor has an 8-bit field "descriptor_length" which is information indicating the length or size of the descriptor. The information processing device according to claim 8.

11. A value from 0 to 7 is defined as the type (ExElementType) of the extension element (Ext_element). The information processing device according to claim 7.

12. If the value (Value) is 0, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_FILL". The information processing device according to claim 11.

13. When the value (Value) is 1, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_MPEGS". The information processing device according to claim 11.

14. When the value (Value) is 2, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_SAOC". The information processing device according to claim 11.

15. When the value (Value) is 3, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_AUDIOPREROLL". The information processing device according to claim 11.

16. When the value (Value) is 4, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_UNI_DRC". The information processing device according to claim 11.

17. If the value (Value) is 5, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_OBJ_METADATA". The information processing device according to claim 11.

18. When the value (Value) is 6, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_SAOC_3D". The information processing device according to claim 11.

19. When the value (Value) is 7, the type (ExElementType) of the extension element (Ext_element) is "ID_EXT_ELE_HOA". The information processing device according to claim 11.

20. A step of obtaining an audio stream; decoding the audio stream to obtain uncompressed audio data; performing an upmix process or a downmix process on the audio data. Information processing methods.

Images