Transmission device, transmission method, receiving device and receiving method

Abstract

The present invention relates to a transmission device, a transmission method, a receiving device and a receiving method. The present invention reduces the processing load on the receiving side when transmitting multiple types of audio data. A container of a predetermined format having a predetermined number of audio streams including multiple sets of encoded data is transmitted. For example, the multiple sets of encoded data include one or both of channel encoded data and object encoded data. Attribute information indicating the attributes of each of the multiple sets of encoded data is inserted into a layer of the container. For example, stream correspondence information indicating in which audio stream each of the multiple sets of encoded data is included is further inserted into the layer of the container.

Description

[0001] This application is a divisional application of the Chinese patent application with application number 201580045713.2. Technical Field

[0002] The present disclosure relates to a transmission device, a transmission method, a receiving device, and a receiving method, and particularly to a transmission device for transmitting various types of audio data, etc. Background Art

[0003] Conventionally, as a stereo (3D) sound technology, a technology for performing rendering by mapping encoded sample data to speakers existing at arbitrary positions based on metadata has been devised (for example, see Patent Document 1).

[0004] Reference List

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application National Publication (Publication) No. 2014-520491 Summary of the invention

[0007] Problems to be solved by the present invention

[0008] It can be considered that object coded data including coded sample data and metadata is transmitted together with channel coded data of 5.1 channels, 7.1 channels, etc., and sound reproduction with enhanced realism can be achieved on the receiving side.

[0009] An object of the present technology is to reduce the processing load on the receiving side when transmitting a plurality of types of audio data.

[0010] Solution to the problem

[0011] The concept of this technology is

[0012] Transmission equipment, including:

[0013] a transmission unit for transmitting a container of a predetermined format having a predetermined number of audio streams including a plurality of sets of encoded data; and

[0014] The information inserting unit is configured to insert attribute information indicating an attribute of each of the plurality of group coded data into the layer of the container.

[0015] In the present technology, a container having a predetermined format of a predetermined number of audio streams including a plurality of group coded data is transmitted by a transmission unit. For example, the plurality of group coded data may include any one or both of channel coded data and object coded data.

[0016] The attribute information indicating the attribute of each of the plurality of group coded data is inserted into the layer of the container by the information insertion unit. For example, the container may be a transport stream (MPEG-2 TS) adopted in the digital broadcasting standard. In addition, for example, the container may be a container of MP4 used in Internet delivery, etc., or a container of another format.

[0017] As described above, in the present technology, attribute information indicating the attribute of each of a plurality of group coded data included in a predetermined number of audio streams is inserted into the layer of the container. Therefore, on the receiving side, the attribute of each of the plurality of group coded data can be easily identified before decoding the coded data, and only the necessary group coded data can be selectively decoded for use, and the processing load can be reduced.

[0018] Incidentally, in the present technology, for example, the information insertion unit may further insert stream correspondence information indicating an audio stream including each of a plurality of group coded data into a layer of a container. In this case, for example, the container may be MPEG2-TS, and the information insertion unit may insert attribute information and stream correspondence information into an audio elementary stream loop corresponding to any one of a predetermined number of audio streams present under a program map table. As described above, the stream correspondence information is inserted into a layer of a container, so that an audio stream including necessary group coded data can be easily identified, and a processing load can be reduced on a receiving side.

[0019] For example, the stream correspondence information may be information indicating the correspondence between a group identifier for identifying each of a plurality of group coded data and a stream identifier for identifying a stream of each of a predetermined number of audio streams. In this case, for example, the information insertion unit may further insert stream identifier information indicating a stream identifier of each of the predetermined number of audio streams into a layer of a container. For example, the container may be an MPEG2-TS, and the information insertion unit may insert the stream identifier information into an audio elementary stream loop corresponding to each of a predetermined number of audio streams present under a program map table.

[0020] In addition, for example, the stream correspondence information may be information indicating the correspondence between a group identifier for identifying each of a plurality of group coded data and a data packet identifier to be attached during packetization of each of a predetermined number of audio streams. In addition, for example, the stream correspondence information may be information indicating the correspondence between a group identifier for identifying each of a plurality of group coded data and type information indicating a stream type of each of a predetermined number of audio streams.

[0021] In addition, another concept of this technology is

[0022] Receiving equipment, including:

[0023] a receiving unit for receiving a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container; and

[0024] A processing unit is configured to process a predetermined number of audio streams included in the received container based on the attribute information.

[0025] In the present technology, a container having a predetermined format including a predetermined number of audio streams of a plurality of group coded data is received by a receiving unit. For example, the plurality of group coded data may include any one or both of channel coded data and object coded data. Attribute information indicating an attribute of each of the plurality of group coded data is inserted into a layer of the container. The predetermined number of audio streams included in the received container is processed by a processing unit based on the attribute information.

[0026] As described above, in the present technology, based on the attribute information indicating the attribute of each of the plurality of group coded data inserted into the layer of the container, processing is performed on a predetermined number of audio streams included in the received container. For this reason, only the necessary group coded data can be selectively decoded for use, and the processing load can be reduced.

[0027] Incidentally, in the present technology, for example, stream correspondence information indicating an audio stream including each of a plurality of group coded data may be further inserted into the layer of the container, and the processing unit may process a predetermined number of audio streams based on the stream correspondence information in addition to the attribute information. In this case, the audio stream including the necessary group coded data can be easily identified, and the processing load can be reduced.

[0028] In addition, in the present technology, for example, the processing unit can selectively perform decoding processing on an audio stream including a set of encoded data that maintains an attribute conforming to a speaker configuration and user selection information based on the attribute information and the stream correspondence information.

[0029] In addition, another concept of the present technology is

[0030] Receiving equipment, including:

[0031] a receiving unit for receiving a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container;

[0032] a processing unit for selectively acquiring a predetermined set of encoded data from a predetermined number of audio streams contained in the received container based on the attribute information, and reconfiguring the audio stream including the predetermined set of encoded data; and

[0033] The stream transmission unit is used to transmit the audio stream reconfigured in the processing unit to an external device.

[0034] In the present technology, a container of a predetermined format having a predetermined number of audio streams including a plurality of group coded data is received by a receiving unit. Attribute information indicating an attribute of each of the plurality of group coded data is inserted into a layer of the container. The predetermined group coded data is selectively acquired from the predetermined number of audio streams based on the attribute information by a processing unit, and an audio stream including the predetermined group coded data is reconfigured. Then, the reconfigured audio stream is transmitted to an external device by a stream transmission unit.

[0035] As described above, in the present technology, based on the attribute information indicating the attribute of each of the plurality of group coded data inserted into the layer of the container, predetermined group coded data is selectively acquired from a predetermined number of audio streams, and the audio stream to be transmitted to the external device is reconfigured. The necessary group coded data can be easily acquired, and the processing load can be reduced.

[0036] Incidentally, in the present technology, for example, stream correspondence information indicating an audio stream including each of a plurality of group coded data may be further inserted into the layer of the container, and the processing unit may selectively acquire predetermined group coded data from a predetermined number of audio streams based on the stream correspondence information in addition to the attribute information. In this case, the audio stream including the predetermined group coded data can be easily identified, and the processing load can be reduced.

[0037] Effects of the Invention

[0038] According to the present technology, when transmitting multiple types of audio data, the processing load on the receiving side can be reduced. Incidentally, the advantageous effects described in this specification are merely examples, and the advantageous effects of the present technology are not limited thereto and may include additional effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 is a block diagram showing an example configuration of a transmission / reception system as an embodiment.

[0040] Figure 2 : is a diagram showing the structure of an audio frame (1024 samples) in 3D audio transmission data.

[0041] Figure 3 is a diagram showing an example configuration of 3D audio transmission data.

[0042] Figure 4 (a) and Figure 4 (b) in FIG. 1 is a diagram schematically showing example configurations of audio frames when transmission of 3D audio transmission data is performed in one stream and when transmission is performed in a plurality of streams, respectively.

[0043] Figure 5 : is a diagram showing an example of group division when transmission is performed in three streams in an example configuration of 3D audio transmission data.

[0044] Figure 6 It is a diagram showing the correspondence between groups and sub-streams in a group division example (three divisions) and the like.

[0045] Figure 7 : is a diagram showing an example of group division in which transmission is performed in two streams in an example configuration of 3D audio transmission data.

[0046] Figure 8 It is a diagram showing the correspondence between groups and sub-streams in a group division example (two divisions) and the like.

[0047] Fig. 9 is a block diagram showing an example configuration of a stream generation unit included in a service transmitter.

[0048] Fig.10 is a diagram showing a structural example of a 3D audio stream configuration descriptor.

[0049] Fig.11 3D audio stream configuration descriptor.

[0050] Fig.12 (a) and Fig.12 (b) in FIG. 1 is a diagram showing a structural example of a 3D audio substream ID descriptor and details of main information in the structural example, respectively.

[0051] Fig.13 is a diagram showing an example configuration of a transport stream.

[0052] Fig.14 is a block diagram illustrating an example configuration of a service receiver.

[0053] Fig.15 is a flowchart showing an example of audio decoding control processing by a CPU in a service receiver.

[0054] Fig.16 is a block diagram illustrating another example configuration of a service receiver. DETAILED DESCRIPTION

[0055] The following is a description of a mode for carrying out the present invention (hereinafter, this mode is referred to as an "embodiment"). Incidentally, the description will be made in the following order.

[0056] 1. Implementation Method

[0057] 2. Deformation

[0058] <1. Implementation Method>

[0059] [Example configuration of transmission / reception system]

[0060] Figure 1 An example configuration of a transmission / reception system 10 as an embodiment is shown. The transmission / reception system 10 is configured by a service transmitter 100 and a service receiver 200. The service transmitter 100 transmits a transport stream TS loaded on a broadcast wave or a network packet. The transport stream TS has a video stream and a predetermined number of audio streams including a plurality of sets of encoded data.

[0061] Figure 2 The structure of an audio frame (1024 samples) in the 3D audio transmission data processed in this embodiment is shown. The audio frame includes a plurality of MPEG audio stream packets (mpeg Audio Stream Packets). Each of the MPEG audio stream packets is configured by a header (Header) and a payload (Payload).

[0062] The header holds information such as a packet type (Packet Type), a packet label (Packet Label), and a packet length (Packet Length). The information defined by the packet type of the header is arranged in the payload. In the payload information, there is "SYNC" information corresponding to a synchronization start code, "Frame" information which is actual data of 3D audio transmission data, and "Config" information indicating the configuration of the "Frame" information.

[0063] The "frame" information includes object coding data and channel coding data configuring 3D audio transmission data. Here, the channel coding data is configured by coded sampling data such as a single channel element (SCE), a channel pair element (CPE), and a low frequency element (LFE). In addition, the object coding data is configured by the coded sampling data of the single channel element (SCE) and metadata for performing rendering by mapping the coded sampling data to a speaker existing in an arbitrary position. The metadata is included as an extension element (Ext_element).

[0064] Figure 3 An example configuration of 3D audio transmission data is shown. The example includes one channel coded data and two object coded data. The one channel coded data is channel coded data (CD) of 5.1 channels and includes coded sample data of SCE1, CPE1.1, CPE1.2, and LFE1.

[0065] The two object encoding data are immersive audio object (IAO) encoding data and speech dialogue object (SDO) encoding data. The immersive audio object encoding data is object encoding data for immersive sound, and includes encoding sample data SCE2 and metadata EXE_E1 (Object metadata) 2 for performing rendering by mapping the encoding sample data to speakers existing in arbitrary positions.

[0066] The speech dialogue object coding data is object coding data for speech languages. In this example, there are speech dialogue object coding data corresponding to language 1 and language 2, respectively. The speech dialogue object coding data corresponding to language 1 includes coding sample data SCE3 and metadata EXE_E1 (Object metadata) 3 for performing rendering by mapping the coding sample data to speakers existing in any position. In addition, the speech dialogue object coding data corresponding to language 2 includes coding sample data SCE4 and metadata EXE_E1 (Object metadata) 4 for performing rendering by mapping the coding sample data to speakers existing in any position.

[0067] The encoded data is distinguished by the concept of type through groups. In the example shown, the encoded channel data of 5.1 channels is in group 1, the immersive audio object encoded data is in group 2, the voice dialogue object encoded data of language 1 is in group 3, and the voice dialogue object encoded data of language 2 is in group 4.

[0068] In addition, data selected between groups on the receiving side can be registered to the switch group (SW Group), and the data can be encoded. In addition, groups can be bundled into preset groups (preset Group), and groups can be reproduced according to user conditions. In the example shown, Group 1, Group 2, and Group 3 are bundled into preset Group 1, and Group 1, Group 2, and Group 4 are bundled into preset Group 2.

[0069] return Figure 1 As described above, the service transmitter 100 transmits 3D audio transmission data including a plurality of sets of encoded data in one stream or multiple streams.

[0070] Figure 4 (a) schematically shows Figure 3In the example configuration of 3D audio transmission data of FIG. 1 , an example configuration of an audio frame when transmission is performed in one stream. In this case, the one stream includes channel coding data (CD), immersive audio object coding data (IAO), and voice dialogue object coding data (SDO), as well as "SYNC" information and "Config" information.

[0071] Figure 4 (b) schematically shows Figure 3 An example configuration of an audio frame when transmission is performed in multiple streams (each of the streams is referred to as a "substream" if appropriate) (here, three streams) in an example configuration of 3D audio transmission data. In this case, substream 1 includes channel coding data (CD) as well as "SYNC" information and "Config" information. In addition, substream 2 includes immersive audio object coding data (IAO) as well as "SYNC" information and "Config" information. In addition, substream 3 includes voice dialogue object coding data (SDO) as well as "SYNC" information and "Config" information.

[0072] Figure 5 Shown in Figure 3 1 is an example of group division when transmission is performed in three streams in an example configuration of 3D audio transmission data of FIG. In this case, substream 1 includes channel coded data (CD) distinguished as group 1. In addition, substream 2 includes immersive audio object coded data (IAO) distinguished as group 2. In addition, substream 3 includes speech dialogue object coded data (SDO) of language 1 distinguished as group 3 and speech dialogue object coded data (SDO) of language 2 distinguished as group 4.

[0073] Figure 6 Show Figure 5 Here, group ID is an identifier for identifying a group. Attribute represents an attribute of each of the group coded data. Switch Group ID is an identifier for identifying a switch group. Preset Group ID is an identifier for identifying a preset group. Sub Stream ID is an identifier for identifying a sub stream.

[0074] The correspondence shown indicates that the coded data belonging to group 1 is channel coded data, a switching group is not configured, and the data is included in substream 1. In addition, the correspondence shown indicates that the coded data belonging to group 2 is object coded data for immersive sound (immersive audio object coded data), a switching group is not configured, and the data is included in substream 2.

[0075] In addition, the correspondence shown indicates that the coded data belonging to group 3 is object coded data (speech dialogue object coded data) for the speech language of language 1, the switching group 1 is configured, and the data is included in substream 3. In addition, the correspondence shown indicates that the coded data belonging to group 4 is object coded data (speech dialogue object coded data) for the speech language of language 2, the switching group 1 is configured, and the data is included in substream 3.

[0076] In addition, the correspondence shown indicates that preset group 1 includes group 1, group 2, and group 3. In addition, the correspondence shown indicates that preset group 2 includes group 1, group 2, and group 4.

[0077] Figure 7 Shown in Figure 3 In the example configuration of 3D audio transmission data of FIG. 1 , a group division example of performing transmission in two streams is shown. In this case, substream 1 includes channel coded data (CD) classified as group 1 and immersive audio object coded data (IAO) classified as group 2. In addition, substream 2 includes speech dialogue object coded data (SDO) of language 1 classified as group 3 and speech dialogue object coded data (SDO) of language 2 classified as group 4.

[0078] Figure 8 Show Figure 7 The correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 2 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 3 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 4 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 5 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 6 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 7 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 8 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 9 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 10 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 11 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 12 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 13 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 14 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 15 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 16 shows the correspondence between the groups and substreams in the group division example (two divisions) of FIG. 1 and FIG. 17 shows the correspondence between the groups and

[0079] In addition, the correspondence shown indicates that the encoded data belonging to group 3 is object encoded data (speech dialog object encoded data) for the speech language of language 1, the switching group 1 is configured, and the data is included in the substream 2. In addition, the correspondence shown indicates that the encoded data belonging to group 4 is object encoded data (speech dialog object encoded data) for the speech language of language 2, the switching group 1 is configured, and the data is included in the substream 2.

[0080] In addition, the correspondence shown indicates that preset group 1 includes group 1, group 2, and group 3. In addition, the correspondence shown indicates that preset group 2 includes group 1, group 2, and group 4.

[0081] return Figure 1, the service transmitter 100 inserts attribute information indicating an attribute of each of the plurality of group coded data included in the 3D audio transmission data into the layer of the container. In addition, the service transmitter 100 inserts stream correspondence information indicating an audio stream including each of the plurality of group coded data into the layer of the container. In the present embodiment, for example, the stream correspondence information is information indicating correspondence between a group ID and a stream identifier.

[0082] For example, the service transmitter 100 inserts these attribute information and stream correspondence information as descriptors into any one of a predetermined number of audio streams existing under a program map table (PMT) (eg, an audio elementary stream loop corresponding to the most basic stream).

[0083] In addition, the service transmitter 100 inserts stream identifier information indicating a stream identifier of each of a predetermined number of audio streams into a layer of the container. For example, the service transmitter 100 inserts the stream identifier information as a descriptor into an audio elementary stream loop corresponding to each of a predetermined number of audio streams existing under a program map table (PMT).

[0084] The service receiver 200 receives a transport stream TS loaded on a broadcast wave or a network data packet and transmitted from the service transmitter 100. As described above, in addition to the video stream, the transport stream TS also has a predetermined number of audio streams including a plurality of group coded data configuring 3D audio transmission data. Then, attribute information indicating an attribute of each of the plurality of group coded data included in the 3D audio transmission data and stream correspondence information indicating an audio stream including each of the plurality of group coded data are inserted into a layer of a container.

[0085] The service receiver 200 selectively performs a decoding process on an audio stream including a group of encoded data maintaining the attributes conforming to the speaker configuration and the user selection information based on the attribute information and the stream correspondence information and obtains an audio output of a 3D audio.

[0086] [Stream generation unit of service transporter]

[0087] Fig. 9 FIG. 1 shows an example configuration of a stream generation unit 110 included in the service transmitter 100. The stream generation unit 110 has a video encoder 112, an audio encoder 113, and a multiplexer 114. Here, it is assumed that the audio transmission data is composed of one coded channel data and two object coded data, such as Figure 3 shown.

[0088] The video encoder 112 inputs video data SV, and performs encoding on the video data SV to generate a video stream (video elementary stream). The audio encoder 113 inputs channel data and immersive audio and voice dialogue object data as audio data SA.

[0089] The audio encoder 113 encodes the audio data SA and obtains 3D audio transmission data. The 3D audio transmission data includes channel coding data (CD), immersive audio object coding data (IAO) and voice dialogue object coding data (SDO). Figure 3 Then, the audio encoder 113 generates a plurality of (here, four) groups of encoded data (see Figure 4 (a) Figure 4 One or more audio streams (audio elementary streams) of (b)).

[0090] The multiplexer 114 packetizes each of a predetermined number of audio streams output from the audio encoder 113 and a video stream output from the video encoder 112 into PES packets and further into transport packets to multiplex the streams and obtain a transport stream TS as a multiplexed stream.

[0091] In addition, the multiplexer 114 inserts attribute information indicating the attributes of each of the plurality of group coded data and stream corresponding information indicating the audio stream including each of the plurality of group coded data under the program map table (PMT). For example, the multiplexer 114 inserts these pieces of information into the audio elementary stream loop corresponding to the most basic stream by using a 3D audio stream configuration descriptor (3Daudio_stream_config_descriptor). The descriptor will be described in detail later.

[0092] In addition, the multiplexer 114 inserts stream identifier information indicating a stream identifier of each of a predetermined number of audio streams under the program map table (PMT). The multiplexer 114 inserts information into an audio elementary stream loop corresponding to each of the predetermined number of audio streams by using a 3D audio substream ID descriptor (3Daudio_substreamID_descriptor). The descriptor will be described in detail later.

[0093] Now briefly describe Fig. 9 The operation of the stream generation unit 110 is shown. The video data is supplied to the video encoder 112. In the video encoder 112, encoding is performed on the video data SV, and a video stream including the encoded video data is generated. The video stream is supplied to the multiplexer 114.

[0094] The audio data SA is provided to the audio encoder 113. The audio data SA includes channel data and immersive audio and voice dialogue object data. In the audio encoder 113, encoding is performed on the audio data SA, and 3D audio transmission data is obtained.

[0095] In addition to the channel coded data (CD) (see Figure 3 ), the 3D audio transmission data also includes immersive audio object coding data (IAO) and voice dialogue object coding data (SDO). Then, in the audio encoder 113, one or more audio streams including four groups of coded data are generated (see Figure 4 (a) Figure 4 (b) in the figure.

[0096] The video stream generated by the video encoder 112 is supplied to the multiplexer 114. In addition, the audio stream generated by the audio encoder 113 is supplied to the multiplexer 114. In the multiplexer 114, the stream supplied from each encoder is packetized into PES packets, and further packetized into transport packets to be multiplexed, and a transport stream TS is obtained as a multiplexed stream.

[0097] In addition, in the multiplexer 114, for example, a 3D audio stream configuration descriptor is inserted into the audio elementary stream loop corresponding to the most basic stream. The descriptor includes attribute information indicating the attributes of each of the plurality of group coded data and stream correspondence information indicating the audio stream including each of the plurality of group coded data.

[0098] In addition, a 3D audio substream ID descriptor is inserted into an audio elementary stream loop corresponding to each of a predetermined number of audio streams in the multiplexer 114. The descriptor includes stream identifier information indicating a stream identifier of each of the predetermined number of audio streams.

[0099] [Details of 3D audio stream configuration descriptor]

[0100] Fig.10 The structure example (Syntax) of the 3D audio stream configuration descriptor (3Daudio_stream_config_descriptor) is shown. Fig.11 Shows the details of the main information (semantics) in the structure instance.

[0101] The 8-bit field of "descriptor_tag" indicates the descriptor type. Here, it indicates that the descriptor is a 3D audio stream configuration descriptor. The 8-bit field of "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0102] The 8-bit field of "NumOfGroups, N" indicates the number of groups. The 8-bit field of "NumOfPresetGroups, P" indicates the number of preset groups. The 8-bit field of "groupID", the 8-bit field of "attribute_of_groupID", the 8-bit field of "SwitchGroupID", and the 8-bit field of "audio_substreamID" are repeated by the number of groups.

[0103] The field of "groupID" indicates a group identifier. The field of "attribute_of_groupID" indicates an attribute of group encoding data. The field of "SwitchGroupID" is an identifier indicating the switch group to which the group belongs. "0" indicates that the group does not belong to any switch group. Anything other than "0" indicates a switch group to which the group is caused to belong. "audio_substreamID" is an identifier indicating an audio substream that includes the group.

[0104] In addition, the 8-bit field of "presetGroupID" and the 8-bit field of "NumOfGroups_in_preset, R" are repeated by the number of preset groups. The field of "presetGroupID" is an identifier indicating a bundle of preset groups. The field of "NumOfGroups_in_preset, R" indicates the number of groups belonging to the preset group. Then, for each preset group, the 8-bit field of "groupID" is repeated by the number of groups belonging to the preset group, and indicates the groups belonging to the preset group. The descriptor can be arranged under the extended descriptor.

[0105] [Details of 3D audio substream ID descriptor]

[0106] Fig.12 (a) in FIG. 1 shows a structure example (Syntax) of a 3D audio substream ID descriptor (3Daudio_substreamID_descriptor). Fig.12 (b) in the figure shows the details of the main information (semantics) in the structure instance.

[0107] The 8-bit field of "descriptor_tag" indicates the descriptor type. Here, it indicates that the descriptor is a 3D audio substream ID descriptor. The 8-bit field of "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor. The 8-bit field of "audio_substreamID" indicates the audio substream identifier. The descriptor can be arranged under the extended descriptor.

[0108] [Configuration of transport stream TS]

[0109] Fig.13 An example configuration of a transport stream TS is shown. This example configuration corresponds to a case where transmission is performed in two streams of 3D audio transmission data (see Figure 7 ). In the example configuration, there is a video stream PES packet "Video PES" identified by PID1. In addition, in the example configuration, there are two audio stream (audio substream) PES packets "Audio PES" identified by PID2 and PID3, respectively. The PES packet includes a PES header (PES_header) and a PES payload (PES_payload). In the PES header, the time stamps of DTS and PTS are inserted. The time stamps of PID2 and PID3 are appropriately attached so that the time stamps match each other during multiplexing, so that synchronization between the time stamps can be ensured for the entire system.

[0110] Here, the audio stream PES packet "Audio PES" identified by PID2 includes channel coded data (CD) classified as group 1 and immersive audio object coded data (IAO) classified as group 2. In addition, the audio stream PES packet "Audio PES" identified by PID3 includes speech dialogue object coded data (SDO) of language 1 classified as group 3 and speech dialogue object coded data (SDO) of language 2 classified as group 4.

[0111] In addition, the transport stream TS includes a program map table (PMT) as program specific information (PSI). PSI is information indicating the program to which each elementary stream included in the transport stream belongs. In PMT, there is a program loop (Program loop) that describes information related to the entire program.

[0112] In addition, in the PMT, there is an elementary stream loop that holds information related to each elementary stream. In the example configuration, there is a video elementary stream loop (video ES loop) corresponding to the video stream, and there are audio elementary stream loops (audio ES loops) corresponding to the two audio streams, respectively.

[0113] In the video elementary stream loop (video ES loop), information such as stream type and PID (packet identifier) ​​corresponding to the video stream is arranged, and a descriptor describing information related to the video stream is also arranged. As described above, the value of "Stream_type" of the video stream is set to "0x24", and the PID information indicates PID1 assigned to the video stream PES packet "video PES". The HEVC descriptor is arranged as one of the descriptors.

[0114] In addition, in the audio elementary stream loop (audio ES loop), information such as stream type and PID (packet identifier) ​​corresponding to the audio stream is arranged, and a descriptor describing information related to the audio is also arranged. As described above, the value of "Stream_type" of the audio stream is set to "0x2C", and the PID information indicates PID2 assigned to the audio stream PES packet "audioPES".

[0115] In the audio elementary stream loop (audio ES loop) corresponding to the audio stream identified by PID2, both the above-mentioned 3D audio stream configuration descriptor and the 3D audio substream ID descriptor are arranged. In addition, in the audio elementary stream loop (audio ES loop) corresponding to the audio stream identified by PID2, only the above-mentioned 3D audio substream ID descriptor is arranged.

[0116] [Example configuration of service receiver]

[0117] Fig.14 An example configuration of the service receiver 200 is shown. The service receiver 200 has a receiving unit 201, a demultiplexer 202, a video decoder 203, a video processing circuit 204, a panel driving circuit 205, and a display panel 206. In addition, the service receiver 200 has multiplexing buffers 211-1 to 211-N, a combiner 212, a 3D audio decoder 213, an audio output processing circuit 214, and a speaker system 215. In addition, the service receiver 200 has a CPU 221, a flash ROM 222, a DRAM 223, an internal bus 224, a remote control receiving unit 225, and a remote control transmitter 226.

[0118] The CPU 221 controls the operation of each unit in the service receiver 200. The flash ROM 222 stores control software and holds data. The DRAM 223 configures a work area of ​​the CPU 221. The CPU 221 deploys software and data read from the flash ROM 222 on the DRAM 223 and activates the software to control each unit of the service receiver 200.

[0119] The remote control receiving unit 225 receives a remote control signal (remote control code) transmitted from the remote control transmitter 226 and supplies the signal to the CPU 221. The CPU 221 controls each unit of the service receiver 200 based on the remote control code. The CPU 221, the flash ROM 222, and the DRAM 223 are connected to the internal bus 224.

[0120] The receiving unit 201 receives a transport stream TS loaded on a broadcast wave or a network packet and transmitted from the service transmitter 100. The transport stream TS has a predetermined number of audio streams including a plurality of group encoded data configuring 3D audio transmission data in addition to the video stream.

[0121] The demultiplexer 202 extracts video stream packets from the transport stream TS, and transmits the packets to the video decoder 203. The video decoder 203 reconfigures a video stream from the video packets extracted by the demultiplexer 202, and performs decoding processing to obtain uncompressed video data.

[0122] The video processing circuit 204 performs scaling processing, image quality adjustment processing, etc. on the video data obtained by the video decoder 203, and obtains video data for display. The panel driving circuit 205 drives the display panel 206 based on the image data for display obtained by the video processing circuit 204. For example, the display panel 206 is configured by a liquid crystal display (LCD), an organic electroluminescence (EL) display.

[0123] In addition, the demultiplexer 202 extracts information such as various descriptors from the transport stream TS and transmits the information to the CPU 221. The various descriptors include the above-mentioned 3D audio stream configuration descriptor (3Daudio_stream_config_descriptor) and 3D audio substream ID descriptor (3Daudio_substreamID_descriptor) (see Fig.13 ).

[0124] CPU 221 identifies an audio stream including group encoded data that maintains attributes that conform to the speaker configuration and viewer (user) selection information based on attribute information representing the attributes of each of the group encoded data included in these descriptors, stream relationship information representing the audio streams (substreams) including each group, and the like.

[0125] In addition, under the control of CPU 221, the demultiplexer 202 selectively extracts one or more audio stream data packets from a predetermined number of audio streams included in the transport stream TS through a PID filter, wherein the audio stream data packets include group encoding data maintaining attributes conforming to the speaker configuration and viewer (user) selection information.

[0126] The multiplexing buffers 211-1 to 211-N respectively receive audio streams extracted by the demultiplexer 202. Here, the number N of the multiplexing buffers 211-1 to 211-N is a necessary and sufficient number, and the number of audio streams extracted by the demultiplexer 202 is used in actual operation.

[0127] The combiner 212 reads the audio stream for each audio frame from each of the multiplexing buffers that respectively accommodate the audio streams extracted by the demultiplexer 202 of the multiplexing buffers 211-1 to 211-N, and provides the audio stream to the 3D audio decoder 213 as group encoded data that maintains attributes that conform to the speaker configuration and viewer (user) selection information.

[0128] The 3D audio decoder 213 performs a decoding process on the encoded data supplied from the combiner 212, and obtains audio data for driving each speaker in the speaker system 215. Three cases can be considered here, a case where the encoded data to be subjected to the decoding process includes only channel encoded data, a case where the encoded data includes only object encoded data, and a case where the further encoded data includes both channel encoded data and object encoded data.

[0129] When decoding the channel coded data, the 3D audio decoder 213 performs downmixing and upmixing processing on the speaker configuration of the speaker system 215, and obtains audio data for driving each speaker. In addition, when decoding the object coded data, the 3D audio decoder 213 calculates speaker rendering (mixing ratio for each speaker) based on the object information (metadata), and mixes the object audio data with the audio data for driving each speaker according to the calculation result.

[0130] The audio output processing circuit 214 performs necessary processing (such as D / A conversion and amplification) on the audio data for driving each speaker obtained by the 3D audio decoder 213, and provides the audio data to the speaker system 215. The speaker system 215 includes a plurality of speakers of a plurality of channels, such as 2 channels, 5.1 channels, 7.1 channels, and 22.2 channels.

[0131] Now briefly describe Fig.14 The operation of the service receiver 200 shown in FIG. 2 is a diagram of a receiving unit 201. In the receiving unit 201, a transport stream TS loaded on a broadcast wave or a network data packet and transmitted from the service transmitter 100 is received. In addition to the video stream, the transport stream TS also has a predetermined number of audio streams, and the audio stream includes a plurality of group encoding data configuring 3D audio transmission data. The transport stream TS is provided to the demultiplexer 202.

[0132] In the demultiplexer 202, a video stream packet is extracted from the transport stream TS, and the video stream packet is supplied to the video decoder 203. In the video decoder 203, a video stream is reconfigured from the video packet extracted by the demultiplexer 202, and a decoding process is performed, and uncompressed video data is obtained. The video data is supplied to the video processing circuit 204.

[0133] In the video processing circuit 204, scaling processing, image quality adjustment processing, etc. are performed on the video data obtained by the video decoder 203, and video data for display is obtained. The video data for display is supplied to the panel drive circuit 205. In the panel drive circuit 205, the display panel 206 is driven based on the video data for display. Therefore, an image corresponding to the video data for display is displayed on the display panel 206.

[0134] In addition, in the demultiplexer 202, information such as various descriptors is extracted from the transport stream TS and transmitted to the CPU 221. The various descriptors include a 3D audio stream configuration descriptor and a 3D audio substream ID descriptor. In the CPU 221, based on the attribute information, stream relationship information, etc. included in these descriptors, an audio stream (substream) including group coded data that maintains attributes conforming to the speaker configuration and viewer (user) selection information is identified.

[0135] In addition, in the demultiplexer 202, under the control of the CPU 221, one or more audio stream data packets from a predetermined number of audio streams included in the transport stream TS are selectively extracted through a PID filter, the audio stream data packets including group encoding data maintaining attributes conforming to the speaker configuration and viewer selection information.

[0136] The audio streams extracted by the demultiplexer 202 are respectively received in corresponding multiplexing buffers of the multiplexing buffers 211-1 to 211-N. In the combiner 212, the audio streams are read for each audio frame from each of the multiplexing buffers that respectively receive the audio streams, and the audio streams are provided to the 3D audio decoder 213 as group coded data that maintains attributes conforming to the speaker configuration and viewer selection information.

[0137] In the 3D audio decoder 213 , a decoding process is performed on the encoded data supplied from the combiner 212 , and audio data for driving each speaker in the speaker system 215 is obtained.

[0138] Here, when the channel coded data is decoded, downmixing and upmixing are performed on the speaker configuration of the speaker system 215, and audio data for driving each speaker is obtained. In addition, when the object coded data is decoded, the speaker rendering (mixing ratio for each speaker) is calculated based on the object information (metadata), and the object audio data is mixed with the audio data for driving each speaker according to the calculation result.

[0139] The audio data for driving each speaker obtained by the 3D audio decoder 213 is supplied to the audio output processing circuit 214. In the audio output processing circuit 214, necessary processing (such as D / A conversion and amplification) is performed on the audio data for driving each speaker. Then, the processed audio data is supplied to the speaker system 215. Thus, an audio output corresponding to the display image on the display panel 206 is obtained from the speaker system 215.

[0140] Fig.15 Show Fig.14 2 is an example of an audio decoding control process of the CPU 221 in the service receiver 200 shown. In step ST1, the CPU 221 starts the process. Then, in step ST2, the CPU 221 detects the receiver speaker configuration, that is, the speaker configuration of the speaker system 215. Next, in step ST3, the CPU 221 obtains selection information related to the audio output by the viewer (user).

[0141] Next, in step ST4, the CPU 221 reads "groupID", "attribute_of_GroupID", "switchGroupID", "presetGroupID", and "Audio_substreamID" of the 3D audio stream configuration descriptor (3Daudio_stream_config_descriptor). Then, in step ST5, the CPU 221 identifies the substream ID (subStreamID) of the audio stream (substream) to which the group that holds the attributes that conform to the speaker configuration and the viewer selection information belongs.

[0142] Next, in step ST6, the CPU 221 checks the identified substream ID (subStreamID) with the substream ID (subStreamID) of the 3D audio substream ID descriptor (3Daudio_substreamID_descriptor) of each audio stream (substream), selects a matching substream ID through a PID filter (PID filter), and obtains the substream ID in each of the multiplexing buffers. Then, in step ST7, the CPU 221 reads the audio stream (substream) for each audio frame from each of the multiplexing buffers, and provides the necessary group encoding data to the 3D audio decoder 213.

[0143] Next, in step ST8, the CPU 221 determines whether to decode the object coded data. When the object coded data is decoded, in step ST9, the CPU 221 calculates the speaker rendering (mixing ratio for each speaker) by the azimuth (azimuth information) and the elevation (elevation information) based on the object information (metadata). After that, the CPU 221 proceeds to step ST10. Incidentally, when the object coded data is not decoded in step ST8, the CPU 221 immediately proceeds to step ST10.

[0144] In step ST10, the CPU 221 determines whether to decode the channel coded data. When the channel coded data is decoded, in step ST11, the CPU 221 performs downmixing and upmixing processing on the speaker configuration of the speaker system 215, and obtains audio data for driving each speaker. After that, the CPU 221 proceeds to step ST12. Incidentally, when the object coded data is not decoded in step ST10, the CPU 221 immediately proceeds to step ST12.

[0145] When the object coded data is decoded, the CPU 221 mixes the object audio data with the audio data for driving each speaker according to the calculation result in step ST9, and then performs dynamic range control in step ST12. Thereafter, in step ST13, the CPU 21 ends the processing. Incidentally, when the object coded data is not decoded, the CPU 221 skips step ST12.

[0146] As mentioned above, in Figure 1 In the transmission / reception system 10 shown, the service transmitter 100 inserts attribute information indicating the attribute of each of the plurality of group coded data included in a predetermined number of audio streams into the layer of the container. Therefore, on the receiving side, the attribute of each of the plurality of group coded data can be easily recognized before decoding of the coded data, and only the necessary group coded data can be selectively decoded for use, and the processing load can be reduced.

[0147] In addition, Figure 1 In the transmission / reception system 10 shown, the service transmitter 100 inserts stream correspondence information indicating an audio stream including each of a plurality of group coded data into a layer of a container. Therefore, on the receiving side, the audio stream including the necessary group coded data can be easily identified, and the processing load can be reduced.

[0148] <2. Transformation>

[0149] Incidentally, in the above-mentioned embodiment, the service receiver 200 is configured to selectively extract an audio stream including group encoded data maintaining attributes conforming to a speaker configuration and viewer selection information from a plurality of audio streams (sub-streams) transmitted from the service transmitter 100, and perform decoding processing to obtain audio data for driving a predetermined number of speakers.

[0150] However, it is also possible to consider selectively extracting one or more audio streams from a plurality of audio streams (sub-streams) transmitted from the service transmitter 100 as a service receiver, the audio stream maintaining group encoding data that conforms to the attributes of the speaker configuration and viewer selection information, to reconfigure the audio stream having the group encoding data that maintains the attributes that conform to the speaker configuration and viewer selection information, and to deliver the reconfigured audio stream to a device (including a DLNA device) connected to a local network.

[0151] Fig.16 An example configuration of a service receiver 200A for delivering a reconfigured audio stream to a device connected to a local network as described above is shown. Fig.16 In, equivalent to Fig.14 The components shown are composed of Fig.14 The same reference numerals as used in the drawings are used to represent the same reference numerals as used in the drawings, and their detailed description will not be repeated here.

[0152] In the demultiplexer 202, under the control of the CPU 221, one or more audio stream packets among a predetermined number of audio streams included in the transport stream TS are selectively extracted through a PID filter, the audio stream packets including group encoding data maintaining attributes conforming to the speaker configuration and viewer selection information.

[0153] The audio streams extracted by the demultiplexer 202 are respectively received in corresponding multiplexing buffers among the multiplexing buffers 211-1 to 211-N. In the combiner 212, the audio stream is read for each audio frame from each of the multiplexing buffers receiving the audio streams, and the audio stream is provided to the stream reconfiguration unit 231.

[0154] In the stream reconfiguration unit 231, a predetermined set of encoded data maintaining the attributes conforming to the speaker configuration and the viewer selection information is selectively acquired, and the audio stream maintaining the predetermined set of encoded data is reconfigured. The reconfigured audio stream is provided to the delivery interface 232. Then, delivery (transmission) is performed from the delivery interface 232 to the device 300 connected to the local network.

[0155] The local network connection includes an Ethernet connection and a wireless connection such as “WiFi” or “Bluetooth.” Incidentally, “WiFi” and “Bluetooth” are registered trademarks.

[0156] In addition, the device 300 includes surround speakers, a second display, and an audio output device attached to the network terminal. The device 300 receiving the delivery of the reconfigured audio stream performs the same Fig.14 The 3D audio decoder 213 in the service receiver 200 performs a similar decoding process and obtains audio data for driving a predetermined number of speakers.

[0157] In addition, as a service receiver, a configuration can also be considered in which the above-mentioned reconfigured audio stream is transmitted to a device connected via a digital interface such as "High-Definition Multimedia Interface (HDMI)", "Mobile High-Definition Link (MHL)" or "DisplayPort". By the way, "HDMI" and "MHL" are registered trademarks.

[0158] In addition, in the above-mentioned embodiment, the stream correspondence information inserted into the layer of the container is information indicating the correspondence between the group ID and the substream ID. That is, the substream ID is used to associate the group and the audio stream (substream) with each other. However, it is also possible to consider using a packet identifier (Packet ID: PID) or a stream type (stream_type) for associating the group and the audio stream (substream) with each other. By the way, when the stream type is used, it is necessary to change the stream type of each audio stream (substream).

[0159] In addition, in the above-mentioned embodiment, it has been shown that by providing "attribute_of_groupID" (see Fig.10 ) field to transmit an instance of the attribute information of each of the group coded data. However, the present technology includes a method in which, by defining a specific meaning of the value of the group ID (GroupID) itself between the transmitter and the receiver, the type (attribute) of the coded data can be identified when a specific group ID is identified. In this case, the group ID is used as a group identifier and also as the attribute information of the group coded data, so that the field of "attribute_of_groupID" is unnecessary.

[0160] In addition, in the above-mentioned embodiment, an example has been shown in which a plurality of group coded data includes both channel coded data and object coded data (see Figure 3 ). However, the present technology can also be similarly applied to a case where a plurality of group coded data includes only channel coded data or only object coded data.

[0161] In addition, in the above-mentioned embodiment, an example in which the container is a transport stream (MPEG-2TS) has been shown. However, the present technology can also be similarly applied to a system that performs delivery through a container of MP4 or another format. For example, it is a streaming delivery system based on MPEG-DASH, or a transmission / reception system that processes an MPEG media transport (MMT) structure transport stream.

[0162] Incidentally, the present technology can also be embodied in the structure described below.

[0163] (1) A transmission device comprising:

[0164] a transmission unit for transmitting a container of a predetermined format having a predetermined number of audio streams including a plurality of sets of encoded data; and

[0165] The information inserting unit is configured to insert attribute information indicating an attribute of each of the plurality of group coded data into the layer of the container.

[0166] (2) The transmission device according to (1), wherein:

[0167] The information inserting unit further inserts stream corresponding information indicating an audio stream including each of the plurality of sets of encoded data into the layer of the container.

[0168] (3) The transmission device according to (2), wherein:

[0169] The stream correspondence information is information indicating the correspondence between a group identifier for identifying each of a plurality of group encoded data and a stream identifier for identifying each of a predetermined number of audio streams.

[0170] (4) The transmission device according to (3), wherein:

[0171] The information inserting unit further inserts stream identifier information indicating a stream identifier of each of a predetermined number of audio streams into the layer of the container.

[0172] (5) The transmission device according to (4), wherein:

[0173] The container is MPEG2-TS, and

[0174] The information inserting unit inserts stream identifier information into an audio elementary stream loop corresponding to each of a predetermined number of audio streams existing under a program map table.

[0175] (6) The transmission device according to (2), wherein:

[0176] The stream correspondence information is information indicating the correspondence between a group identifier for identifying each of a plurality of group encoded data and a data packet identifier to be attached during packetization of each of a predetermined number of audio streams.

[0177] (7) The transmission device according to (2), wherein:

[0178] The stream correspondence information is information indicating the correspondence between a group identifier for identifying each of a plurality of group encoded data and type information indicating a stream type of each of a predetermined number of audio streams.

[0179] (8) The transmission device according to any one of (2) to (7), wherein:

[0180] The container is MPEG2-TS, and

[0181] The information inserting unit inserts the attribute information and the stream corresponding information into an audio elementary stream loop corresponding to any one of a predetermined number of audio streams existing under the program map table.

[0182] (9) The transmission device according to any one of (1) to (8), wherein:

[0183] The plurality of group coded data include either or both of channel coded data and object coded data.

[0184] (10) A transmission method, comprising:

[0185] a transmitting step for transmitting, from a transmission unit, a container of a predetermined format having a predetermined number of audio streams including a plurality of sets of encoded data; and

[0186] The information inserting step is for inserting attribute information indicating the attribute of each of the plurality of group coded data into the layer of the container.

[0187] (11) A receiving device comprising:

[0188] a receiving unit for receiving a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container; and

[0189] A processing unit is configured to process a predetermined number of audio streams included in the received container based on the attribute information.

[0190] (12) The receiving device according to (11), wherein:

[0191] Stream correspondence information indicating an audio stream including each of the plurality of sets of encoded data is further inserted into the layer of the container, and

[0192] The processing unit processes a predetermined number of audio streams based on the stream correspondence information in addition to the attribute information.

[0193] (13) The receiving device according to (12), wherein:

[0194] The processing unit selectively performs a decoding process on the audio stream including the group encoded data maintaining the attribute conforming to the speaker configuration and the user selection information based on the attribute information and the stream correspondence information.

[0195] (14) The receiving device according to any one of (11) to (13), wherein:

[0196] The plurality of group coded data include either or both of channel coded data and object coded data.

[0197] (15) A receiving method, comprising:

[0198] a receiving step for receiving, by a receiving unit, a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container; and

[0199] A processing step is provided for processing a predetermined number of audio streams included in the received container based on the attribute information.

[0200] (16) A receiving device comprising:

[0201] a receiving unit for receiving a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container;

[0202] a processing unit for selectively acquiring a predetermined set of encoded data from a predetermined number of audio streams included in the received container based on the attribute information, and reconfiguring the audio stream including the predetermined set of encoded data; and

[0203] The stream transmission unit is used to transmit the audio stream reconfigured in the processing unit to an external device.

[0204] (17) The receiving device according to (16), wherein:

[0205] Stream correspondence information indicating an audio stream including each of the plurality of sets of encoded data is further inserted into the layer of the container, and

[0206] The processing unit selectively acquires a predetermined set of encoded data from a predetermined number of audio streams based on the stream correspondence information in addition to the attribute information.

[0207] (18) A receiving method, comprising:

[0208] a receiving step for receiving, by a receiving unit, a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container;

[0209] a processing step for selectively acquiring a predetermined set of encoded data from a predetermined number of audio streams included in the received container based on the attribute information, and reconfiguring the audio streams including the predetermined set of encoded data; and

[0210] The streaming step is used to transmit the audio stream reconfigured in the processing step to an external device.

[0211] The main feature of the present technology is that attribute information indicating the attribute of each of a plurality of group coded data included in a predetermined number of audio streams and stream correspondence information indicating an audio stream including each of the plurality of group coded data are inserted into a layer of a container (see Fig.13 ), which can reduce the processing load on the receiving side.

[0212] Reference Symbols List

[0213] 10 Transmission / reception system

[0214] 100 Service Transmitter

[0215] 110 Stream Generation Unit

[0216] 112 Video Encoder

[0217] 113 Audio Codec

[0218] 114 Multiplexer

[0219] 200, 200A Service Receiver

[0220] 201 Receiving unit

[0221] 202 Demultiplexer

[0222] 203 Video Decoder

[0223] 204 Video Processing Circuit

[0224] 205 Panel drive circuit

[0225] 206 Display Panel

[0226] 211-1 to 211-N Multiplexing buffer

[0227] 212 Combiner

[0228] 213 3D Audio Decoder

[0229] 214 Audio output processing circuit

[0230] 215 Speaker System

[0231] 221 CPU

[0232] 222 Flash ROM

[0233] 223 DRAM

[0234] 224 Internal bus

[0235] 225 Remote Control Receiver Unit

[0236] 226 Remote Control Transmitter

[0237] 231 Stream Reconfiguration Unit

[0238] 232 Transfer Interface

[0239] 300 devices.

Claims

1. A transmission device, comprising: a transmission unit for transmitting a container of a predetermined format having a predetermined number of audio streams including a plurality of sets of encoded data; as well as an information inserting unit, configured to insert attribute information representing an attribute of each of the plurality of group coded data into a layer of the container, wherein: The information inserting unit further inserts stream corresponding information indicating an audio stream including each of the plurality of sets of encoded data into the layer of the container, The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and a stream identifier for identifying each of the predetermined number of audio streams, and Data selected between groups on the receiving side is registered to the switching group and encoded.

2. The transmission device according to claim 1, wherein: The information inserting unit further inserts stream identifier information indicating a stream identifier of each of the predetermined number of audio streams into the layer of the container.

3. The transmission device according to claim 2, wherein: The container is MPEG2-TS, and The information inserting unit inserts the stream identifier information into an audio elementary stream loop corresponding to each of the predetermined number of audio streams existing under a program map table.

4. The transmission device according to claim 1, wherein: The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and type information indicating a stream type of each of the predetermined number of audio streams.

5. The transmission device according to claim 1, wherein: The container is MPEG2-TS, and The information inserting unit inserts the attribute information and the stream correspondence information into an audio elementary stream loop corresponding to any one of the predetermined number of audio streams existing under a program map table.

6. The transmission device according to claim 1, wherein: The plurality of group coded data include any one or both of channel coded data and object coded data.

7. A transmission method, comprising: a transmitting step for transmitting, from a transmission unit, a container of a predetermined format having a predetermined number of audio streams including a plurality of sets of encoded data; as well as an information inserting step for inserting attribute information representing the attribute of each of the plurality of group coded data into the layer of the container, wherein: further inserting stream correspondence information indicating an audio stream including each of the plurality of sets of encoded data into the layer of the container, and The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and a stream identifier for identifying each of the predetermined number of audio streams.

8. The transmission method according to claim 7, wherein: Stream identifier information indicating a stream identifier of each of the predetermined number of audio streams is inserted into the layer of the container.

9. The transmission method according to claim 8, wherein: The container is MPEG2-TS, and The stream identifier information is inserted into an audio elementary stream loop corresponding to each of the predetermined number of audio streams existing under a program map table.

10. The transmission method according to claim 7, wherein: The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and type information indicating a stream type of each of the predetermined number of audio streams.

11. The transmission method according to claim 7, wherein: The container is MPEG2-TS, and The attribute information and the stream correspondence information are inserted into an audio elementary stream loop corresponding to any one of the predetermined number of audio streams existing under a program map table.

12. The transmission method according to claim 7, wherein: The plurality of group coded data include any one or both of channel coded data and object coded data.

13. A receiving device, comprising: a receiving unit for receiving a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container; as well as a processing unit, configured to process the predetermined number of audio streams included in the received container based on the attribute information, wherein: Stream correspondence information indicating an audio stream including each of the plurality of sets of encoded data is further inserted into the layer of the container, and The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and a stream identifier for identifying each of the predetermined number of audio streams.

14. The receiving device according to claim 13, wherein: The processing unit processes the predetermined number of audio streams based on the stream correspondence information in addition to the attribute information.

15. The receiving device according to claim 14, wherein: The processing unit selectively performs a decoding process on an audio stream including group coded data, the group coded data maintaining the attribute conforming to the speaker configuration and the user selection information, based on the attribute information and the stream correspondence information.

16. The receiving device according to claim 13, wherein: The plurality of group coded data include any one or both of channel coded data and object coded data.

17. A receiving method, comprising: a receiving step for receiving, by a receiving unit, a container having a predetermined format including a predetermined number of audio streams of a plurality of group coded data, attribute information indicating an attribute of each of the plurality of group coded data being inserted into a layer of the container; as well as a processing step for processing the predetermined number of audio streams included in the received container based on the attribute information, wherein Stream correspondence information indicating an audio stream including each of the plurality of sets of encoded data is further inserted into the layer of the container, and The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and a stream identifier for identifying each of the predetermined number of audio streams.

18. The receiving method according to claim 17, wherein: The predetermined number of audio streams are processed based on the stream correspondence information in addition to the attribute information.

19. The receiving method according to claim 18, wherein: Based on the attribute information and the stream correspondence information, a decoding process is selectively performed on an audio stream including group coded data that maintains an attribute conforming to a speaker configuration and user selection information.

20. The receiving method according to claim 17, wherein: The plurality of group coded data include any one or both of channel coded data and object coded data.

21. A receiving device, comprising: a receiving unit for receiving a container having a predetermined format including a predetermined number of audio streams of a plurality of sets of encoded data, attribute information indicating an attribute of each of the plurality of sets of encoded data being inserted into a layer of the container; a processing unit for selectively acquiring a predetermined set of encoded data from the predetermined number of audio streams included in the received container based on the attribute information, and reconfiguring the audio stream including the predetermined set of encoded data; as well as A stream transmission unit, configured to transmit the audio stream reconfigured in the processing unit to an external device, wherein: Stream correspondence information indicating an audio stream including each of the plurality of sets of encoded data is further inserted into the layer of the container, and The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and a stream identifier for identifying each of the predetermined number of audio streams.

22. The receiving device according to claim 21, wherein The processing unit selectively acquires the predetermined set of encoded data from the predetermined number of audio streams based on the stream correspondence information in addition to the attribute information.

23. A receiving method, comprising: a receiving step for receiving, by a receiving unit, a container having a predetermined format including a predetermined number of audio streams of a plurality of group coded data, attribute information indicating an attribute of each of the plurality of group coded data being inserted into a layer of the container; a processing step for selectively acquiring a predetermined set of coded data from the predetermined number of audio streams included in the received container based on the attribute information, and reconfiguring the audio streams including the predetermined set of coded data; as well as A stream transmission step for transmitting the audio stream reconfigured in the processing step to an external device, wherein: Stream correspondence information indicating an audio stream including each of the plurality of sets of encoded data is further inserted into the layer of the container, and The stream correspondence information is information indicating correspondence between a group identifier for identifying each of the plurality of group encoded data and a stream identifier for identifying each of the predetermined number of audio streams.

Images