Transmitting device, receiving device and receiving method

JP2025041862AActive Publication Date: 2025-03-26SONY GROUP CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024228460
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2015-06-17
Filing Date
2024-12-25
Publication Date
2025-03-26
Estimated Expiration
2036-06-13

AI Technical Summary

Benefits of technology

【0018】 本技術によれば、受信側でオブジェクトコンテントの音圧調整を良好に行い得る。なお、本明細書に記載された効果はあくまで例示であって限定されるものではなく、また付加的な効果があってもよい。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025041862000001_ABST
    Figure 2025041862000001_ABST
Patent Text Reader

Abstract

To enable good sound pressure adjustment of an object content at a receiving end.SOLUTION: An audio stream having encoded data of a predetermined number of object contents is generated, and a container of a predetermined format containing this audio stream is transmitted, then information indicating a permissible range of increase or decrease of sound pressure for each object content is inserted into a layer of the audio stream and / or a layer of the container. Based on this information, On a receiving side, sound pressure for each object content increases and decreases within the allowable range.SELECTED DRAWING: Figure 10
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present technology relates to a transmitting device, a transmitting method, a receiving device, and a receiving method, and in particular to a transmitting device or the like that transmits an audio stream having encoded data of a predetermined number of object contents. [Background technology]

[0002] 2. Description of the Related Art Conventionally, a technique has been proposed as a stereoscopic (3D) audio technique in which encoded sample data is mapped to speakers located at arbitrary positions based on metadata and then rendered (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2014-520491 Summary of the Invention [Problem to be solved by the invention]

[0004] It is conceivable that various types of object content coded data consisting of coded sample data and metadata can be transmitted together with channel coded data such as 5.1 channels, 7.1 channels, etc., to enable audio reproduction with enhanced realism at the receiving end. For example, object content such as dialogue language may be difficult to hear depending on the background sound or viewing environment.

[0005] An object of the present technology is to enable good sound pressure adjustment of object content on the receiving side. [Means for solving the problem]

[0006] The concept of this technology is as follows: an audio encoding unit for generating an audio stream having encoded data of a predetermined number of object contents; a transmitter for transmitting a container in a predetermined format including the audio stream; An information inserting unit is provided for inserting information indicating an allowable range of increase or decrease in sound pressure for each object content into the layer of the audio stream and / or the layer of the container. Located in the transmitting device.

[0007] In the present technology, an audio encoding unit generates an audio stream having encoded data of a predetermined number of object contents, and an information inserting unit inserts information indicating an allowable range of increase or decrease in sound pressure for each object content into a layer of the audio stream and / or a layer of a container.

[0008] For example, the information indicating the allowable range of increase and decrease in sound pressure for each object content is information on the upper and lower limits of sound pressure. Also, for example, the coding format of the audio stream may be MPEG-H 3D Audio, and the information inserting unit may include an extension element having information indicating the allowable range of increase and decrease in sound pressure for each object content in the audio frame.

[0009] In this way, in the present technology, information indicating the allowable range of increase or decrease in sound pressure for each object content is inserted into the audio stream layer and / or the container layer, so that the receiving side can easily adjust the increase or decrease in sound pressure for each object content within the allowable range by using this inserted information.

[0010] In addition, in the present technology, for example, each of the predetermined number of object contents may belong to one of a predetermined number of content groups, and the information inserting unit may insert information indicating the allowable range of increase / decrease in sound pressure for each content group into the audio stream layer and / or the container layer. In this case, it is sufficient to send information indicating the allowable range of increase / decrease in sound pressure for the number of content groups, and it is possible to efficiently transmit information indicating the allowable range of increase / decrease in sound pressure for each object content.

[0011] In addition, in the present technology, for example, factor type information indicating which of a plurality of factor types is to be applied may be added to the information indicating the allowable range of increase / decrease in sound pressure for each object content. In this case, it is possible to apply an appropriate factor type for each object content.

[0012] Another concept of the present technology is a receiving unit for receiving a container in a predetermined format including an audio stream having encoded data of a predetermined number of object contents; A control unit is provided for controlling a sound pressure increase / decrease process for increasing / decreasing the sound pressure for the object content selected by the user. in the receiving device.

[0013] In the present technology, a receiving unit receives a container in a predetermined format including an audio stream having encoded data of a predetermined number of object contents, and a control unit controls a sound pressure increase / decrease process for increasing / decreasing the sound pressure for the object contents related to a user selection.

[0014] In this way, in the present technology, the sound pressure of the object content selected by the user is increased or decreased, so that, for example, it is possible to increase the sound pressure of a specific object content and decrease the sound pressure of the other object contents, and it is possible to effectively adjust the sound pressure of a specific number of object contents.

[0015] In the present technology, for example, information indicating the allowable range of increase / decrease in sound pressure for each object content is inserted into the audio stream layer and / or the container layer, the control unit further controls an information extraction process for extracting information indicating the allowable range of increase / decrease in sound pressure for each object content from the audio stream layer and / or the container layer, and the sound pressure increase / decrease process may increase / decrease the sound pressure for the object content related to the user's selection based on the extracted information. In this case, it becomes easy to adjust the sound pressure of each object content within the allowable range.

[0016] In addition, in the present technology, for example, in the sound pressure increase / decrease process, when the sound pressure for the object content related to the user selection is increased, the sound pressure for the other object contents may be decreased, and when the sound pressure for the object content related to the user selection is decreased, the sound pressure for the other object contents may be increased. In this case, it is possible to keep the sound pressure of the entire object content constant without requiring the user to perform operations.

[0017] In addition, in the present technology, for example, the control unit may further control a display process for displaying a user interface screen showing the sound pressure state of the object content whose sound pressure is increased or decreased by the sound pressure increase / decrease process. In this case, the user can easily check the sound pressure state of each object content and can easily set the sound pressure. Effect of the Invention

[0018] According to the present technology, the sound pressure of object content can be adjusted satisfactorily on the receiving side. Note that the effects described in this specification are merely examples and are not limiting, and additional effects may also be provided. [Brief description of the drawings]

[0019] [Figure 1] 1 is a block diagram showing an example of the configuration of a transmission / reception system according to an embodiment; [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of transmission data of MPEG-H 3D Audio. [Diagram 3] 1 is a diagram showing an example of the structure of an audio frame in transmission data of MPEG-H 3D Audio. FIG. [Figure 4] 13 is a diagram showing the correspondence between the type (ExElementType) of an extension element and its value (Value). FIG. [Diagram 5] FIG. 13 is a diagram showing an example of the structure of a content enhancement frame that includes, as an extension element, information indicating the allowable range of increase or decrease in sound pressure for each content group. [Figure 6] This figure shows the contents of main information in an example of the content enhancement frame structure. [Figure 7] 11 is a diagram showing an example of a sound pressure value (factor value) indicated by information indicating an allowable range of increase or decrease in sound pressure. FIG. [Figure 8] FIG. 13 is a diagram illustrating an example of the structure of an audio content enhancement descriptor. [Figure 9] 4 is a block diagram showing an example of the configuration of a stream generating unit included in the service transmitter. FIG. [Figure 10] FIG. 2 is a diagram illustrating an example of the structure of a transport stream TS. [Figure 11] 1 is a block diagram showing a configuration example of a service receiver; [Figure 12] 2 is a block diagram showing an example of the configuration of an audio decoding unit; [Figure 13] 13 is a diagram showing an example of a user interface screen showing the current sound pressure state of each object content. FIG. [Figure 14] 13 is a flowchart showing an example of a sound pressure increase / decrease process in the object enhancer in response to a unit operation by a user. [Figure 15] 11A and 11B are diagrams for explaining examples of sound pressure adjustment of object content and the effects thereof. [Figure 16]13 is a diagram showing another example of the sound pressure value (factor value) indicated by the information indicating the allowable range of increase or decrease in sound pressure. FIG. [Figure 17] A figure showing another example structure of a content enhancement frame that includes information indicating the allowable range of increase or decrease in sound pressure for each content group as an extension element. [Figure 18] This figure shows the contents of main information in an example of the content enhancement frame structure. [Figure 19] FIG. 13 is a diagram showing another example structure of an audio content enhancement descriptor. [Figure 20] 13 is a flowchart showing another example of the sound pressure increase / decrease process in the object enhancer in response to a unit operation by the user. [Figure 21] A diagram showing an example of the structure of an MMT stream. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] Hereinafter, modes for carrying out the invention (hereinafter, referred to as "embodiments") will be described. The description will be made in the following order. 1. Embodiment 2. Variations

[0021] <1. Preferred embodiment> [Example of transmission and reception system configuration] 1 shows an example of the configuration of a transmission / reception system 10 according to an embodiment. This transmission / reception system 10 is made up of a service transmitter 100 and a service receiver 200. The service transmitter 100 transmits a transport stream TS via broadcast waves or network packets.

[0022] The transport stream TS includes an audio stream, or a video stream and an audio stream. The audio stream includes channel-encoded data and encoded data of a predetermined number of object contents (object-encoded data). In this embodiment, the encoding format of the audio stream is MPEG-H 3D Audio.

[0023] The service transmitter 100 inserts information (information on upper and lower limits) indicating the allowable range of increase and decrease in sound pressure for each object content into the audio stream layer and / or the transport stream TS layer as a container. For example, each of a predetermined number of object contents belongs to one of a predetermined number of content groups, and the service transmitter 200 inserts information indicating the allowable range of increase and decrease in sound pressure for each content group into the audio stream layer and / or the container layer.

[0024] Fig. 2 shows an example of the structure of MPEG-H 3D Audio transmission data. This example structure consists of one channel coded data and six object coded data. The one channel coded data is 5.1 channel coded data (CD) and consists of coded sample data of SCE1, CPE1.1, CPE1.2, and LFE1.

[0025] Of the six object codings, the first three belong to the dialog language object content group codings (DOD): they are codings of the Object for dialog language for the first, second and third language, respectively.

[0026] The coded data for the dialogue language objects corresponding to the first, second and third languages ​​consists of coded sample data SCE2, SCE3 and SCE4, respectively, and metadata (Object metadata) for mapping and rendering the data to speakers located at any position.

[0027] Among the six coded object data, the remaining three coded object data belong to the coded data (SEO) of the content group for sound effect objects. These three coded object data are coded data of sound effect objects (Object for sound effect) corresponding to the first, second, and third sound effects, respectively.

[0028] The encoded data for the sound effect objects corresponding to the first, second, and third sound effects consist of encoded sample data SCE5, SCE6, and SCE7, respectively, and metadata (Object metadata) for mapping and rendering the data to speakers located at any position.

[0029] Encoded data is classified into groups according to type. In this configuration example, the channel encoded data for 5.1 channels is group 1. The encoded data for dialogue language objects corresponding to the first, second, and third languages ​​are group 2, group 3, and group 4, respectively. The encoded data for sound effect objects corresponding to the first, second, and third sound effects are group 5, group 6, and group 7, respectively.

[0030] Moreover, those that can be selected between groups on the receiving side are registered in a switch group (SW Group) and encoded. In this configuration example, groups 2, 3, and 4 that belong to the content group of the dialogue language object are set to switch group 1 (SW Group 1). Also, groups 5, 6, and 7 that belong to the content group of the sound effect object are set to switch group 2 (SW Group 2).

[0031] Figure 3 shows an example of the structure of an audio frame in MPEG-H 3D Audio transmission data. This audio frame is made up of multiple MPEG Audio Stream Packets. Each MPEG Audio Stream Packet is made up of a header and a payload.

[0032] The header has information such as packet type, packet label, and packet length. The payload contains information defined by the packet type in the header. This payload information contains "SYNC", which is the synchronization start code, "Frame", which is the actual data for the 3D audio transmission, and "Config", which indicates the configuration of this "Frame".

[0033] A "Frame" includes channel-encoded data and object-encoded data that constitute the transmission data of 3D audio. Here, the channel-encoded data is composed of encoded sample data such as SCE (Single Channel Element), CPE (Channel Pair Element), and LFE (Low Frequency Element). The object-encoded data is composed of encoded sample data of SCE (Single Channel Element) and metadata for mapping it to a speaker located at an arbitrary position and rendering it. This metadata is included as an extension element (Ext_element).

[0034] In this embodiment, an element (Ext_content_enhancement) having information indicating the allowable range of increase or decrease in sound pressure for each content group is newly defined as an extension element (Ext_element). Accordingly, configuration information of the element (content_enhancement config) is newly defined in "Config".

[0035] 4 shows the correspondence between the type (ExElementType) of the extension element (Ext_element) and its value (Value). For example, 128 is newly defined as the value of the type "ID_EXT_ELE_content_enhancement".

[0036] Figure 5 shows an example of the syntax of a content enhancement frame (Content_Enhancement_frame()) that includes information indicating the allowable range of increase or decrease in sound pressure for each content group as an extension element. Figure 6 shows the semantics of the main information in the example.

[0037] The 8-bit field "num_of_content_groups" indicates the number of content groups. The 8-bit field "content_group_id", the 8-bit field "content_type", the 8-bit field "content_enhancement_plus_factor", and the 8-bit field "content_enhancement_minus_factor" are repeated for the number of content groups.

[0038] The "content_group_id" field indicates the ID (identification) of the content group. The "content_type" field indicates the type of the content group. For example, "0" indicates "dialog language", "1" indicates "sound effect", "2" indicates "BGM", and "3" indicates "spoken subtitles".

[0039] The "content_enhancement_plus_factor" field indicates the upper limit for increasing or decreasing the sound pressure. For example, as shown in the table of FIG. 7, "0x00" indicates 1 (0 dB), "0x01" indicates 1.4 (+3 dB), ..., and "0xFF" indicates infinite (+infinite dB). The "content_enhancement_minus_factor" field indicates the lower limit for increasing or decreasing the sound pressure. For example, as shown in the table of FIG. 7, "0x00" indicates 1 (0 dB), "0x01" indicates 0.7 (-3 dB), ..., and "0xFF" indicates 0.00 (-infinite dB). The table of FIG. 7 is shared in the service receiver 200.

[0040] In this embodiment, an audio content enhancement descriptor (Audio_Content_Enhancement descriptor) is newly defined, which has information indicating the allowable range of increase or decrease in sound pressure for each content group. This descriptor is then inserted into an audio elementary stream loop that exists under a program map table (PMT).

[0041] Figure 8 shows an example of the structure (Syntax) of an audio content enhancement descriptor. The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an audio content enhancement descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0042] The 8-bit field "num_of_content_groups" indicates the number of content groups. The 8-bit field "content_group_id", the 8-bit field "content_type", the 8-bit field "content_enhancement_plus_factor", and the 8-bit field "content_enhancement_minus_factor" are repeated for each content group. The information in each field is the same as that explained in the content enhancement frame (see Figure 5) above.

[0043] Returning to Fig. 1, the service receiver 200 receives a transport stream TS transmitted by the service transmitter 100 via broadcast waves or network packets. This transport stream TS includes an audio stream in addition to a video stream. The audio stream includes channel-encoded data constituting the transmission data of 3D audio, and encoded data of a predetermined number of object contents (object-encoded data).

[0044] Information indicating the allowable range of increase or decrease in sound pressure for each object content is inserted into the audio stream layer and / or the transport stream TS layer as a container. For example, information indicating the allowable range of increase or decrease in sound pressure for a predetermined number of content groups is inserted. Here, one content group includes one or more object contents.

[0045] The service receiver 200 performs a decoding process on the video stream to obtain video data, and also performs a decoding process on the audio stream to obtain audio data of 3D audio.

[0046] The service receiver 200 processes the increase / decrease in sound pressure for the object content related to the user selection. At this time, the service receiver 200 limits the range of increase / decrease in sound pressure based on the allowable range of increase / decrease in sound pressure for each object content inserted in the layer of the audio stream and / or the layer of the transport stream TS as a container.

[0047] [Stream generation part of the service transmitter] 9 shows an example of the configuration of the stream generation unit 110 included in the service transmitter 100. The stream generation unit 110 has a control unit 111, a video encoder 112, an audio encoder 113, and a multiplexer 114.

[0048] The video encoder 112 receives video data SV and encodes the video data SV to generate a video stream (video elementary stream). The audio encoder 113 receives object data of a predetermined number of content groups as audio data SA together with channel data. Each content group includes one or more object contents.

[0049] The audio encoder 113 encodes the audio data SA to obtain 3D audio transmission data, and generates an audio stream (audio elementary stream) including the 3D audio transmission data. The 3D audio transmission data includes channel encoded data as well as object encoded data of a predetermined number of content groups.

[0050] For example, as shown in the configuration example of FIG. 2, it includes channel coded data (CD), coded data of a content group of dialogue language objects (DOD), and coded data of a content group of sound effect objects (SEO).

[0051] The audio encoder 113 inserts information indicating the allowable range of increase / decrease in sound pressure for each content group into the audio stream under the control of the control unit 111. In this embodiment, a newly defined element (Ext_content_enhancement) having information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted as an extension element (Ext_element) into the audio frame (see Figs. 3 and 5).

[0052] The multiplexer 114 packetizes the video stream output from the video encoder 112 and a predetermined number of audio streams output from the audio encoder 113 into PES packets, and then packetizes and multiplexes the packets to obtain a transport stream TS as a multiplexed stream.

[0053] The multiplexer 114, under the control of the control unit 111, inserts information indicating the allowable range of increase / decrease in sound pressure for each content group into the transport stream TS as a container. In this embodiment, a newly defined audio content enhancement descriptor (Audio_Content_Enhancement descriptor) having information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted into the audio elementary stream loop existing under the PMT (see FIG. 8).

[0054] The operation of the stream generation unit 110 shown in Fig. 9 will be briefly described. Video data is supplied to a video encoder 112. In this video encoder 112, the video data SV is encoded to generate a video stream including the encoded video data. This video stream is supplied to a multiplexer 114.

[0055] The audio data SA is supplied to the audio encoder 113. The audio data SA includes channel data and object data of a predetermined number of content groups, where each content group includes one or more object contents.

[0056] The audio encoder 113 encodes the audio data SA to obtain 3D audio transmission data. This 3D audio transmission data includes channel encoded data as well as object encoded data of a predetermined number of content groups. The audio encoder 113 then generates an audio stream including this 3D audio transmission data.

[0057] At this time, in the audio encoder 113, information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted into the audio stream under the control of the control unit 111. That is, a newly defined element (Ext_content_enhancement) having information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted into the audio frame as an extension element (Ext_element) (see Figs. 3 and 5).

[0058] The video stream generated by the video encoder 112 is supplied to the multiplexer 114. Also, the audio stream generated by the audio encoder 113 is supplied to the multiplexer 114. In the multiplexer 114, the streams supplied from the respective encoders are PES packetized, and further transport packetized and multiplexed, thereby obtaining a transport stream TS as a multiplexed stream.

[0059] At this time, in the multiplexer 114, under the control of the control unit 111, information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted into the transport stream TS as a container. That is, a newly defined audio content enhancement descriptor (Audio_Content_Enhancement descriptor) having information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted into the audio elementary stream loop existing under the PMT (see FIG. 8).

[0060] [Transport Stream TS Structure] Fig. 10 shows an example of the structure of a transport stream TS. In this example structure, there is a PES packet "video PES" for a video stream identified by PID1, and there is also a PES packet "audio PES" for an audio stream identified by PID2. A PES packet consists of a PES header (PES_header) and a PES payload (PES_payload). DTS and PTS timestamps are inserted in the PES header.

[0061] An audio stream (Audio coded stream) is inserted into the PES payload of the PES packet of the audio stream. A content enhancement frame (Content_Enhancement_frame()) that contains information indicating the allowable range of increase or decrease in sound pressure for each content group is inserted into the audio frame of this audio stream.

[0062] The transport stream TS also contains a PMT (Program Map Table) as PSI (Program Specific Information). The PSI is information that describes which program each elementary stream in the transport stream belongs to. The PMT contains a program loop that describes information related to the entire program.

[0063] The PMT also contains elementary stream loops that contain information related to each elementary stream. In this configuration example, there is a video elementary stream loop (video ES loop) corresponding to the video stream, and an audio elementary stream loop (audio ES loop) corresponding to the audio stream.

[0064] In the video elementary stream loop (video ES loop), information such as stream type and PID (packet identifier) ​​corresponding to the video stream is placed, and a descriptor describing information related to the video stream is also placed. The value of "Stream_type" of this video stream is set to "0x24", and the PID information indicates PID1 assigned to the PES packet "video PES" of the video stream as described above. As one of the descriptors, an HEVC descriptor is placed.

[0065] In addition, the audio elementary stream loop (audio ES loop) contains information such as the stream type and PID (packet identifier) ​​for each audio stream, as well as a descriptor describing information related to the audio stream. The value of "Stream_type" for this audio stream is set to "0x2C", and the PID information indicates PID2, which is added to the PES packet "audio PES" of the audio stream as described above. One of the descriptors is the audio content enhancement descriptor (Audio_Content_Enhancement descriptor), which contains information indicating the allowable range of increase or decrease in sound pressure for each content group.

[0066] [Example of service receiver configuration] 11 shows an example of the configuration of a service receiver 200. This service receiver 200 has a receiving section 201, a demultiplexer 202, a video decoding section 203, a video processing circuit 204, a panel driving circuit 205, and a display panel 206. This service receiver 200 also has an audio decoding section 214, an audio output circuit 215, and a speaker system 216. This service receiver 200 also has a CPU 221, a flash ROM 222, a DRAM 223, an internal bus 224, a remote control receiving section 225, and a remote control transmitter 226.

[0067] The CPU 221 controls the operation of each part of the service receiver 200. The flash ROM 222 stores control software and data. The DRAM 223 constitutes a work area for the CPU 221. The CPU 221 loads software and data read from the flash ROM 222 onto the DRAM 223, starts up the software, and controls each part of the service receiver 200.

[0068] The remote control receiving unit 225 receives a remote control signal (remote control code) transmitted from the remote control transmitter 226, and supplies it to the CPU 221. The CPU 221 controls each unit of the service receiver 200 based on the remote control code. The CPU 221, the flash ROM 222, and the DRAM 223 are connected to an internal bus 224.

[0069] The receiving unit 201 receives a transport stream TS transmitted by broadcast waves or network packets from the service transmitter 100. This transport stream TS has an audio stream in addition to a video stream. The audio stream has channel-encoded data and encoded data of a predetermined number of object contents (object-encoded data), which constitute the transmission data of 3D audio.

[0070] Information indicating the allowable range of increase or decrease in sound pressure for a given number of content groups is inserted in the audio stream layer and / or the transport stream TS layer as a container. Note that one content group includes one or more object contents.

[0071] Here, a newly defined element (Ext_content_enhancement) that has information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted as an extension element (Ext_element) into the audio frame (see Figures 3 and 5). Also, a newly defined audio content enhancement descriptor (Audio_Content_Enhancement descriptor) that has information indicating the allowable range of increase / decrease in sound pressure for each content group is inserted into the audio elementary stream loop under the PMT (see Figure 8).

[0072] The demultiplexer 202 extracts the video stream from the transport stream TS and sends it to the video decoding unit 203. The video decoding unit 203 performs a decoding process on the video stream to obtain uncompressed video data.

[0073] The video processing circuit 204 performs scaling processing, image quality adjustment processing, and the like on the video data obtained by the video decoding unit 203 to obtain video data for display. The panel driving circuit 205 drives the display panel 206 based on the image data for display obtained by the video processing circuit 204. The display panel 206 is composed of, for example, an LCD (Liquid Crystal Display), an organic EL display (organic electroluminescence display), or the like.

[0074] The demultiplexer 202 also extracts various information such as descriptor information from the transport stream TS and sends it to the CPU 221. This various information also includes an audio content enhancement descriptor having information indicating the allowable range of increase or decrease in sound pressure for each of the above-mentioned content groups. The CPU 221 can recognize the allowable range (upper limit, lower limit) of increase or decrease in sound pressure for each content group using this descriptor.

[0075] The demultiplexer 202 also extracts an audio stream from the transport stream TS and sends it to an audio decoding unit 214. The audio decoding unit 214 performs a decoding process on the audio stream to obtain audio data for driving each speaker that constitutes a speaker system 216.

[0076] In this case, with regard to the encoded data of a predetermined number of object contents contained in the audio stream, the audio decoding unit 214, under the control of the CPU 221, decodes only the encoded data of one of the object contents selected by the user, for the encoded data of multiple object contents that constitute a switch group.

[0077] Furthermore, the audio decoding unit 214 extracts various information inserted in the audio stream and transmits it to the CPU 221. This various information also includes an element having information indicating the allowable range of increase or decrease in sound pressure for each of the above-mentioned content groups. The CPU 221 can recognize the allowable range (upper limit, lower limit) of increase or decrease in sound pressure for each of the content groups by using this element.

[0078] The audio decoding unit 214 also processes the increase and decrease of the sound pressure for the object content selected by the user under the control of the CPU 221. At this time, the range of increase and decrease of the sound pressure is limited based on the allowable range (upper limit, lower limit) of the increase and decrease of the sound pressure for each object content inserted in the layer of the audio stream and / or the layer of the transport stream TS as a container. The details of this audio decoding unit 214 will be described later.

[0079] The audio output processing circuit 215 performs necessary processing such as D / A conversion and amplification on the audio data for driving each speaker obtained by the audio decoding unit 214, and supplies the audio data to a speaker system 216. The speaker system 216 includes multiple channels, such as 2 channels, 5.1 channels, 7.1 channels, and 22.2 channels.

[0080] "Example of audio decoding section configuration" 12 shows an example of the configuration of the audio decoding unit 214. The audio decoding unit 214 includes a decoder 231, an object enhancer 232, an object renderer 233, and a mixer 234.

[0081] The decoder 231 performs a decoding process on the audio stream extracted by the demultiplexer 202 to obtain object data of a predetermined number of object contents together with the channel data. This decoder 213 performs a process that is substantially the reverse of that of the audio encoder 113 of the stream generating unit 110 in Fig. 9. Note that, with respect to the multiple object contents that constitute a switch group, under the control of the CPU 221, only the object data of any one of the object contents selected by the user is obtained.

[0082] The decoder 231 also extracts various information inserted in the audio stream and transmits it to the CPU 221. This information also includes an element having information indicating the allowable range of increase or decrease in sound pressure for each content group. The CPU 221 can recognize the allowable range (upper limit, lower limit) of increase or decrease in sound pressure for each content group using this element.

[0083] The object enhancer 232 performs sound pressure increase / decrease processing on object content related to user selection from among a predetermined number of object data obtained by the decoder 231. When increasing / decreasing sound pressure, the object enhancer 232 is provided with a target content (target_content) indicating the object content for which sound pressure should be increased / decreased, a command indicating whether to increase or decrease, and an allowable range (upper limit, lower limit) for increasing / decreasing sound pressure for the target content in response to a user operation from the CPU 221.

[0084] The object enhancer 232 changes the sound pressure of the object content of the target content (target_content) by a predetermined amount in the direction (increase or decrease) indicated by the command (command) for each unit operation by the user. In this case, if the sound pressure is already within the limit value indicated by the allowable range (upper limit value, lower limit value), the sound pressure is left unchanged.

[0085] Also, the object enhancer 232 changes the sound pressure by a certain amount (predetermined amount) by referring to the table in Fig. 7. For example, if the current state is 1 (0 dB) and the user's unit operation is an increase, the state is changed to 1.4 (+3 dB). Also, if the current state is 1.4 (+3 dB) and the user's unit operation is an increase, the state is changed to 1.9 (+6 dB).

[0086] Also, for example, if the current state is 1 (0 dB) and the user's unit operation is a decrease, the state is changed to 0.7 (-3 dB). Also, for example, if the current state is 0.7 (-3 dB) and the user's unit operation is an increase, the state is changed to 0.5 (-6 dB).

[0087] Furthermore, when increasing or decreasing the sound pressure, the object enhancer 232 sends information indicating the sound pressure state of each object data to the CPU 221. Based on this information, the CPU 221 displays a user interface screen indicating the current sound pressure state of each object content on a display unit, for example, the display panel 206, to facilitate the user's sound pressure setting.

[0088] Figure 13 shows an example of a user interface screen that displays the sound pressure status. In this example, there are two object contents: a dialogue language object (DOD) and a sound effect object (SEO) (see Figure 2). The hatched mark indicates the current sound pressure status. Note that "plus_i" indicates the upper limit and "minus_i" indicates the lower limit.

[0089] 14 shows an example of a process of increasing or decreasing sound pressure in the object enhancer 232 in response to a unit operation by the user. The object enhancer 232 starts the process in step ST1. After that, the object enhancer 232 proceeds to the process in step ST2.

[0090] In this step ST2, the object enhancer 232 judges whether the command is an increase command. If it is an increase command, the object enhancer 232 proceeds to the processing of step ST3. In this step ST3, the object enhancer 232 increases the sound pressure of the object content of the target content (target_content) by a predetermined amount if it is not at the upper limit value. After the processing of step ST3, the object enhancer 232 ends the processing in step ST4.

[0091] If the command is not an increase command in step ST2, that is, if the command is a decrease command, the object enhancer 232 proceeds to processing in step ST5. In this step ST5, the object enhancer 232 decreases the sound pressure of the object content of the target content (target_content) by a predetermined amount if it is not at the lower limit. After processing in step ST5, the object enhancer 232 ends the processing in step ST4.

[0092] Returning to Fig. 12, the object renderer 233 performs rendering processing on the object data of a predetermined number of object contents obtained through the object enhancer 232 to obtain channel data of a predetermined number of object contents. Here, the object data is composed of audio data of an object sound source and position information of the object sound source. The object renderer 233 obtains channel data by mapping the audio data of the object sound source to an arbitrary speaker position based on the position information of the object sound source.

[0093] The mixer 234 combines the channel data obtained by the decoder 231 with the channel data of each object content obtained by the object renderer 233 to obtain audio data (channel data) for driving each speaker that constitutes the speaker system 216.

[0094] The operation of the service receiver 200 shown in Fig. 11 will now be briefly described. The receiver 201 receives a transport stream TS transmitted by broadcast waves or network packets from the service transmitter 100. This transport stream TS includes an audio stream in addition to a video stream.

[0095] The audio stream has channel-encoded data and a predetermined number of object content encoded data (object-encoded data), which constitute the transmission data of 3D audio. Each of the predetermined number of object contents belongs to one of a predetermined number of content groups. In other words, one or more object contents belong to one content group.

[0096] This transport stream TS is supplied to a demultiplexer 202. In the demultiplexer 202, a video stream is extracted from the transport stream TS and supplied to a video decoding unit 203. In the video decoding unit 203, a decoding process is performed on the video stream to obtain uncompressed video data. This video data is supplied to a video processing circuit 204.

[0097] In the image processing circuit 204, the video data is subjected to a scaling process, an image quality adjustment process, and the like to obtain video data for display. This video data for display is supplied to a panel driving circuit 205. In the panel driving circuit 205, a display panel 206 is driven based on the video data for display. As a result, an image corresponding to the video data for display is displayed on the display panel 206.

[0098] In addition, the demultiplexer 202 extracts various information such as descriptor information from the transport stream TS and sends it to the CPU 221. This information also includes an audio content enhancement descriptor having information indicating the allowable range of increase or decrease in sound pressure for each content group. The CPU 221 recognizes the allowable range (upper limit, lower limit) of increase or decrease in sound pressure for each content group using this descriptor.

[0099] Furthermore, the demultiplexer 202 extracts an audio stream from the transport stream TS and sends it to an audio decoding unit 214. The audio decoding unit 214 performs a decoding process on the audio stream to obtain audio data for driving each speaker that constitutes a speaker system 216.

[0100] In this case, in the audio decoding unit 214, among the encoded data of a predetermined number of object contents contained in the audio stream, with regard to the encoded data of multiple object contents constituting a switch group, under the control of the CPU 221, only the encoded data of any one of the object contents selected by the user is to be decoded.

[0101] Furthermore, the audio decoding unit 214 extracts various information inserted in the audio stream and transmits it to the CPU 221. This various information also includes an element having information indicating the allowable range of increase or decrease in sound pressure for each of the above-mentioned content groups. The CPU 221 recognizes the allowable range (upper limit, lower limit) of increase or decrease in sound pressure for each content group from this element.

[0102] Furthermore, the audio decoding unit 214 performs processing for increasing or decreasing the sound pressure for the object content related to the user selection under the control of the CPU 221. At this time, the audio decoding unit 214 limits the range of increase or decrease in sound pressure based on the allowable range (upper limit value, lower limit value) of increase or decrease in sound pressure for each object content.

[0103] That is, in this case, in response to user operation, the CPU 221 provides the audio decoding unit 214 with a target content (target_content) indicating the object content for which sound pressure should be increased or decreased, a command indicating whether to increase or decrease, and the allowable range (upper limit, lower limit) for increasing or decreasing the sound pressure for the target content.

[0104] Then, in the audio decoding unit 214, for each unit operation by the user, the sound pressure of the object data belonging to the content group of the target content (target_content) is changed by a predetermined amount in the direction (increase or decrease) indicated by the command (command). In this case, if the sound pressure is already within the limit value indicated by the allowable range (upper limit value, lower limit value), the sound pressure is left as it is without being changed.

[0105] The audio data for driving each speaker obtained by the audio decoding unit 214 is supplied to an audio output processing circuit 215. The audio output processing circuit 215 performs necessary processing such as D / A conversion and amplification on the audio data. The processed audio data is then supplied to a speaker system 216. As a result, the speaker system 216 produces an audio output corresponding to the image displayed on the display panel 206.

[0106] As described above, in the transmission / reception system 10 shown in Fig. 1, the service receiver 200 processes the increase / decrease of the sound pressure for the object content related to the user selection. Therefore, for example, it is possible to increase the sound pressure of a specific object content and decrease the sound pressure of the other object contents, and it is possible to effectively adjust the sound pressure of a specific number of object contents.

[0107] Fig. 15(a) shows a schematic diagram of the waveform of the audio data of the object content of the dialogue language, and Fig. 15(b) shows a schematic diagram of the waveform of the audio data of the other object contents. Fig. 15(c) shows a schematic diagram of the waveform of the audio data when they are put together. In this case, the amplitude of the waveform of the audio data of the dialogue language is greater than that of the audio data of the other object contents, so the sound of the dialogue language is masked by the sounds of the other object contents, making it very difficult to hear.

[0108] Fig. 15(d) shows a schematic waveform of the audio data of the dialogue language object content with increased sound pressure, Fig. 15(e) shows a schematic waveform of the audio data of the other object content with decreased sound pressure, and Fig. 15(f) shows a schematic waveform of the combined audio data.

[0109] In this case, the amplitude of the waveform of the dialogue language audio data is greater than the amplitude of the waveform of the audio data of the other object contents, so the dialogue language sound is not masked by the sound of the other object contents and becomes easier to hear. Also, in this case, the sound pressure of the dialogue language object content is increased, but the sound pressure of the other object contents is decreased, so the overall sound pressure of the object content is kept constant.

[0110] 1, the service transmitter 100 inserts information indicating the allowable range of increase or decrease in sound pressure for each object content into the audio stream layer and / or the transport stream TS layer as a container. Therefore, the receiver can easily adjust the increase or decrease in sound pressure for each object content within the allowable range by using this inserted information.

[0111] 1, the service transmitter 100 inserts information indicating the allowable range of increase / decrease in sound pressure for each content group to which a predetermined number of object contents belong, into the transport stream TS as a layer and / or container of the audio stream. Therefore, it is only necessary to send information indicating the allowable range of increase / decrease in sound pressure for the number of content groups, and it becomes possible to efficiently transmit information indicating the allowable range of increase / decrease in sound pressure for each object content.

[0112] <2. Modifications> In the above embodiment, an example was shown in which there is one factor type for the information indicating the allowable range of increase or decrease in sound pressure for each object content, and therefore for each content group (see FIG. 7). However, it is also possible to make the factor type for the information indicating the allowable range of increase or decrease in sound pressure for each object content selectable from a plurality of types.

[0113] 16 shows an example of a table in which the factor type of information indicating the allowable range of increase or decrease in sound pressure for each content group can be selected from multiple types. This example shows a case in which there are two factor types: "factor_1" and "factor_2."

[0114] In this case, for a content group designated "factor_1", the receiving side refers to the "factor_1" portion of the table to recognize the upper and lower limits of the sound pressure, and also recognizes the range of change in the increase / decrease adjustment of the sound pressure. Similarly, for a content group designated "factor_2", the receiving side refers to the "factor_2" portion of the table to recognize the upper and lower limits of the sound pressure, and also recognizes the range of change in the increase / decrease adjustment of the sound pressure.

[0115] For example, even if the "content_enhancement_plus_factor" is the same at "0x02", if "factor_1" is specified, the upper limit is recognized as 1.9 (+6 dB), and if "factor_2" is specified, the upper limit is recognized as 3.9 (+12 dB). Also, if there is an increase command from 1 (0 dB), if "factor_1" is specified, it will change to 1.4 (+3 dB), and if "factor_2" is specified, it will change to 1.9 (+6 dB). Also, for any factor, if the specified value is "0x00", both the upper and lower limits are 0 dB, which means that the sound pressure cannot be changed for the target content group.

[0116] Figure 17 shows an example of the syntax of a content enhancement frame (Content_Enhancement_frame()) in which the factor type of information indicating the allowable range of increase or decrease in sound pressure for each content group can be selected from multiple types. Figure 18 shows the semantics of the main information in this example.

[0117] The 8-bit field "num_of_content_groups" indicates the number of content groups. The 8-bit field "content_group_id", the 8-bit field "content_type", the 8-bit field "factor_type", the 8-bit field "content_enhancement_plus_factor", and the 8-bit field "content_enhancement_minus_factor" are repeated for the number of content groups.

[0118] The "content_group_id" field indicates the ID (identification) of the content group. The "content_type" field indicates the type of content group. For example, "0" indicates "dialog language", "1" indicates "sound effect", "2" indicates "BGM", and "3" indicates "spoken subtitles". The "factor_type" field indicates the applied factor type. For example, "0" indicates "factor_1" and "1" indicates "factor_2".

[0119] The "content_enhancement_plus_factor" field indicates the upper limit for increasing or decreasing the sound pressure. For example, as shown in the table in Fig. 16, when the applied factor type is "factor_1", "0x00" indicates 1 (0 dB), "0x01" indicates 1.4 (+3 dB), ..., and "0xFF" indicates infinite (+infinite dB), and when the applied factor type is "factor_2", "0x00" indicates 1 (0 dB), "0x01" indicates 1.9 (+6 dB), ..., and "0x7F" indicates infinite (+infinite dB).

[0120] The "content_enhancement_minus_factor" field indicates the lower limit of the increase or decrease in sound pressure. For example, as shown in the table in Fig. 16, when the applied factor type is "factor_1", "0x00" indicates 1 (0 dB), "0x01" indicates 0.7 (-3 dB), ..., "0xFF" indicates 0.00 (-infinit dB), and when the applied factor type is "factor_2", 0x00" indicates 1 (0 dB), "0x01" indicates 0.5 (-6 dB), ..., "0x7F" indicates 0.00 (-infinit dB).

[0121] FIG. 19 shows an example of the syntax of an audio content enhancement descriptor (Audio_Content_Enhancement descriptor) in the case where the factor type of information indicating the allowable range of increase or decrease in sound pressure for each content group can be selected from multiple types.

[0122] The 8-bit field "descriptor_tag" indicates the descriptor type. In this case, it indicates that it is an audio content enhancement descriptor. The 8-bit field "descriptor_length" indicates the length (size) of the descriptor, and indicates the number of subsequent bytes as the length of the descriptor.

[0123] The 8-bit field "num_of_content_groups" indicates the number of content groups. The 8-bit field "content_group_id", the 8-bit field "content_type", the 8-bit field "factor_type", the 8-bit field "content_enhancement_plus_factor", and the 8-bit field "content_enhancement_minus_factor" are repeated for each content group. The information in each field is the same as that explained in the content enhancement frame (see Figure 17) above.

[0124] In the above embodiment, an example has been shown in which the sound pressure of the object content of the target content (target_content) selected by the user is changed by a predetermined amount in the direction (increase or decrease) indicated by the command (command) in the service receiver 200. However, when increasing or decreasing the sound pressure of the object content of the target content (target_content), it is also possible to automatically increase or decrease the sound pressure of other object contents in the opposite direction.

[0125] In this way, for example, the user can cause the service receiver 200 to execute the processes in Figures 15(d) and (e) simply by performing an operation to increase the object content of the dialogue language.

[0126] The flowchart in Fig. 20 shows an example of the sound pressure increase / decrease process in the object enhancer 232 (see Fig. 12) in response to the user's unit operation in this case. The object enhancer 232 starts the process in step ST11. After that, the object enhancer 232 proceeds to the process in step ST12.

[0127] In this step ST12, the object enhancer 232 judges whether the command is an increase command or not. If it is an increase command, the object enhancer 232 proceeds to the process of step ST13. In this step ST13, the object enhancer 232 increases the sound pressure of the object content of the target content (target_content) by a predetermined amount if it is not at the upper limit value.

[0128] Next, in step ST14, the object enhancer 232 reduces the sound pressure of the other object content that is not the target content (target_content) in order to keep the overall sound pressure of the object content constant. In this case, the sound pressure is reduced by an amount corresponding to the increase in sound pressure of the object content of the target content (target_content). In this case, the other object content related to the sound pressure reduction is set to either one or a plurality of object contents. After the process of step ST14, the object enhancer 232 ends the process in step ST15.

[0129] If the command is not an increase command in step ST12, that is, if the command is a decrease command, the object enhancer 232 proceeds to the process of step ST16. In step ST16, the object enhancer 232 decreases the sound pressure of the object content of the target content (target_content) by a predetermined amount if the sound pressure is not at the lower limit.

[0130] Next, in step ST17, the object enhancer 232 increases the sound pressure of the other object content that is not the target content (target_content) in order to keep the overall sound pressure of the object content constant. In this case, the sound pressure is reduced by an amount corresponding to the increase in the sound pressure of the object content of the target content (target_content). In this case, the other object content related to the sound pressure reduction is set to either one or a plurality of object contents. After the process of step ST17, the object enhancer 232 ends the process in step ST15.

[0131] In the above embodiment, an example is shown in which information indicating the allowable range of increase or decrease in sound pressure for each content group is inserted into both the audio stream layer and the transport stream TS layer as a container. However, it is also possible to insert this information only into the audio stream layer or only into the transport stream TS layer as a container.

[0132] In the above embodiment, an example in which the container is a transport stream (MPEG-2 TS) is shown. However, the present technology can be similarly applied to a system in which data is delivered in a container of MP4 or other formats. For example, this is an MPEG-DASH-based stream delivery system, or a transmission / reception system that handles an MMT (MPEG Media Transport) structure transmission stream.

[0133] 21 shows an example of the structure of an MMT stream. In an MMT stream, there are MMT packets for each asset such as video and audio. In this example structure, there are MMT packets for an audio asset identified by ID2 along with an MMT packet for a video asset identified by ID1.

[0134] A content enhancement frame (Content_Enhancement_frame()) is inserted into the audio frames of the audio asset (audio stream) containing information indicating the allowable range of increase or decrease in sound pressure for each content group.

[0135] Additionally, MMT streams contain message packets such as PA (Packet Access) message packets. PA message packets contain tables such as the MMT Package Table. MP tables contain information for each asset. Corresponding to audio assets (audio streams), Audio_Content_Enhancement descriptors are placed, which contain information indicating the allowable range of increase or decrease in sound pressure for each content group.

[0136] The present technology can also be configured as follows. (1) an audio encoding unit for generating an audio stream having encoded data of a predetermined number of object contents; a transmitter for transmitting a container in a predetermined format including the audio stream; An information inserting unit is provided for inserting information indicating an allowable range of increase or decrease in sound pressure for each object content into the layer of the audio stream and / or the layer of the container. Transmitting device. (2) each of the predetermined number of object contents belongs to one of a predetermined number of content groups; The information inserting unit inserts information indicating an allowable range of increase or decrease in sound pressure for each content group into a layer of the audio stream and / or a layer of the container. The transmitting device according to (1) above. (3) The encoding format of the audio stream is MPEG-H 3D Audio, The information inserting unit includes an extension element having information indicating a permissible range of increase or decrease in sound pressure for each of the object contents in the audio frame. A transmitting device according to (1) or (2). (4) The information indicating the allowable range of increase or decrease in sound pressure for each of the object contents is accompanied by factor selection information indicating one of a number of factors. A transmitting device according to any one of (1) to (3). (5) an audio encoding step for generating an audio stream having encoded data of a predetermined number of object contents; a transmitting step of transmitting a container in a predetermined format including the audio stream by a transmitting unit; An information inserting step of inserting information indicating an allowable range of increase or decrease in sound pressure for each object content into a layer of the audio stream and / or a layer of the container. Transmission method. (6) a receiving unit for receiving a container in a predetermined format including an audio stream having encoded data of a predetermined number of object contents; A processing unit is provided for increasing or decreasing the sound pressure for the object content selected by the user. Receiving device. (7) information indicating a permissible range of increase or decrease in sound pressure for each object content is inserted into the layer of the audio stream and / or the layer of the container; an information extracting unit for extracting information indicating an allowable range of increase or decrease in sound pressure for each object content from the audio stream layer and / or the container layer, The processing unit processes the increase and decrease of the sound pressure for the object content related to the user selection based on the extracted information. The receiving device according to (6) above. (8) The processing unit is When the sound pressure is increased for the object content related to the user selection, the sound pressure is decreased for the other object contents, and when the sound pressure is decreased for the object content related to the user selection, the sound pressure is increased for the other object contents. A receiving device according to (6) or (7). (9) A display control unit that displays a UI screen showing a sound pressure state of the object content subjected to sound pressure increase / decrease processing by the processing unit. A receiving device according to any one of (6) to (8). (10) a receiving step of receiving, by a receiving unit, a container in a predetermined format including an audio stream having encoded data of a predetermined number of object contents; A processing step for processing sound pressure increase / decrease for object content related to user selection is included. Receiving method.

[0137] The main feature of this technology is that it inserts information indicating the allowable range of increase or decrease in sound pressure for each object content into the audio stream layer and / or container layer, enabling the receiving side to appropriately adjust the increase or decrease in sound pressure of each object content within the allowable range (see Figures 9 and 10). [Explanation of symbols]

[0138] 10. Transmitting and receiving system 100···Service transmitter 110 Stream generation unit 111 Control unit 112 Video Encoder 113 Audio Encoder 114 Multiplexer 200 Service Receiver 201... Receiving unit 202 Demultiplexer 203 Video decoding section 204...Image processing circuit 205 Panel drive circuit 206 Display panel 214 Audio Decoder 215 Audio output processing circuit 216···Speaker System 221···CPU 222...Flash ROM 223...DRAM 224... Internal bus 225 Remote control receiver 226···Remote control transmitter 231... Decoder 232...Object Enhancer 233...Object Renderer 234···Mixer

Claims

1. an audio encoding unit for generating an audio stream having encoded data of a predetermined number of object contents; a transmitter for transmitting a container in a predetermined format including the audio stream; An information inserting unit is provided for inserting information indicating an allowable range of increase or decrease in sound pressure for each object content into the layer of the audio stream and / or the layer of the container. Transmitting device.

2. Each of the predetermined number of object contents belongs to one of a predetermined number of content groups; The information inserting unit inserts information indicating an allowable range of increase or decrease in sound pressure for each content group into a layer of the audio stream and / or a layer of the container. The transmitting device according to claim 1 .

3. The encoding format of the audio stream is MPEG-H 3D Audio, The information inserting unit includes an extension element having information indicating a permissible range of increase or decrease in sound pressure for each of the object contents in the audio frame. The transmitting device according to claim 1 .

4. The information indicating the allowable range of increase or decrease in sound pressure for each object content is added with factor type information indicating which of a plurality of factor types is to be applied. The transmitting device according to claim 1 .

5. an audio encoding step for generating an audio stream having encoded data of the content of a predetermined number of objects; a transmitting step of transmitting a container in a predetermined format including the audio stream by a transmitting unit; An information inserting step of inserting information indicating an allowable range of increase or decrease in sound pressure for each object content into a layer of the audio stream and / or a layer of the container. Transmission method.

6. a receiving unit for receiving a container in a predetermined format including an audio stream having encoded data of a predetermined number of object contents; A control unit is provided for controlling a sound pressure increase / decrease process for increasing / decreasing the sound pressure for the object content selected by the user. Receiving device.

7. information indicating a permissible range of increase or decrease in sound pressure for each object content is inserted into a layer of the audio stream and / or a layer of the container; the control unit further controls an information extraction process for extracting information indicating an allowable range of increase or decrease in sound pressure for each object content from the audio stream layer and / or the container layer; In the sound pressure increase / decrease process, sound pressure is increased / decreased for the object content related to the user selection based on the extracted information.

7. The receiving device according to claim 6.

8. In the above sound pressure increase / decrease process, When the sound pressure is increased for the object content related to the user selection, the sound pressure is decreased for the other object contents, and when the sound pressure is decreased for the object content related to the user selection, the sound pressure is increased for the other object contents.

7. The receiving device according to claim 6.

9. The control unit further controls a display process for displaying a user interface screen showing a sound pressure state of the object content whose sound pressure is increased or decreased by the sound pressure increase / decrease process.

7. The receiving device according to claim 6.

10. a receiving step of receiving, by a receiving unit, a container in a predetermined format including an audio stream having encoded data of a predetermined number of object contents; A sound pressure increase / decrease processing step is provided for increasing / decreasing the sound pressure for the object content selected by the user. Receiving method.

Citation Information

Patent Citations

  • Stream playback device

    JP2009151926A

  • Apparatus and method for generating an audio output signal using object-based metadata.

    JP2011528200A

  • Encoding and playback of 3D audio soundtracks

    JP2014525048A

  • Transmitting device, transmitting method, receiving device and receiving method

    JP6308311B2

  • Systems and tools for improved 3D audio creation and expression

    JP2014520491A