Receiving device, broadcasting device, broadcasting system, receiving method, and program

Abstract

To allow a mechanism for selecting desired audio to be efficiently provided.SOLUTION: A receiving unit receives, through a broadcast, multiplexed data in which an audio asset in the same package and an MMT package table (MPT) that provides information constituting the package are multiplexed. A separation unit separates the MPT from the multiplexed data. When the MPT includes selectable information indicating a selectable element of the audio asset, an audio processing unit outputs the selectable information, and processes the audio asset according to selection information selected from the selectable information.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a receiving device, a broadcasting device, a broadcasting system, a receiving method, and a program.

Background Art

[0002] In television broadcast services, audio and video contents constituting a program are multiplexed and transmitted. As multiplexing and transmission methods, for example, the MPEG-2 TS method, the MMT (MPEG Media Transport) method, etc. have been used. Audio is transmitted as an elementary stream (ES: Elementary Stream) for each channel. The composition of audio provided in a broadcast service is described by multiplexing information including the ES constituting the program and the attributes for each ES, and is transmitted together with the content. In the MPEG-2 TS method and the MMT method, the multiplexing information is represented using a PMT (Program Map Table) and an MPT (MMT Package Table), respectively. The ES corresponds to an asset in the MMT method.

[0003] A receiving device that provides a broadcast service may generate and present a list representing, as options, audio having attributes that can be provided, by referring to the multiplexing information. A user who visually views the presented list selects one channel of audio according to their preferences and viewing environment. The receiving device separates the audio data selected by the user from the broadcast data and outputs the audio obtained by decoding.

[0004] In the next-generation terrestrial digital system (hereinafter referred to as the "terrestrial digital system"), the MPEG-H 3D Audio method or the Dolby (registered trademark) AC-4 method may be adopted as the audio encoding method. In the MPEG-H 3D Audio method and the Dolby (registered trademark) AC-4 method, it is possible to transmit, as elements, a plurality of types of audio corresponding to various usage forms using one asset in one broadcast program. Therefore, it has been studied to enable the selection of any of the plurality of types of elementary audio as elements according to the user's preferences and viewing environment. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Patent No. 5957161 [Overview of the project] [Problems that the invention aims to solve]

[0006] Under conventional methods, it is conceivable to analyze the attributes of each audio asset described in the multiplexing information transmitted in multiplex with the content, and then construct the choices accordingly. However, in the MPEG-H 3D Audio and Dolby® AC-4 formats, only a single asset is provided for each program. Simply analyzing the multiplexing information as in conventional methods does not allow for the identification of the type of audio element being transmitted or the attributes of each individual audio element. Consequently, it is not possible to obtain choices. While it is conceivable to analyze the content of the received audio asset to identify the type of audio element and its attributes, this requires significant processing load and hardware resources. [Means for solving the problem]

[0007] The present invention has been made to solve the above problems, and one aspect of the present invention is a receiving device comprising: a receiving unit that receives multiplexed data in broadcast, in which audio assets in the same package and an MMT package table (MPT) that provides information constituting the package are multiplexed; a separation unit that separates the MPT from the multiplexed data; and an audio processing unit that outputs selectable information indicating selectable elements of the audio assets when the MPT includes selectable information, and processes the audio assets according to the selected information selected from the selectable information. [Effects of the Invention]

[0008] According to embodiments of the present invention, a mechanism for selecting a desired voice can be efficiently provided. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic block diagram showing an example of the functional configuration of the broadcasting system according to this embodiment. [Figure 2] This is a schematic block diagram showing an example of the functional configuration of the broadcasting device according to this embodiment. [Figure 3] This is a schematic block diagram showing an example of the functional configuration of the receiving device according to this embodiment. [Figure 4] This figure shows an example of a descriptor according to this embodiment. [Figure 5] This figure shows an example of a preset voice set in a descriptor. [Figure 6] This figure shows a first example of the settings screen according to this embodiment. [Figure 7] This figure shows a second example of the settings screen according to this embodiment. [Figure 8] This figure shows a third example of the settings screen according to this embodiment. [Figure 9] This flowchart shows an example of the receiving process according to this embodiment. [Modes for carrying out the invention]

[0010] Embodiments of the present invention will be described below with reference to the drawings. First, an overview of the broadcasting system 1 according to this embodiment will be described. Figure 1 is a schematic block diagram showing an example of the functional configuration of the broadcasting system 1 according to this embodiment. Broadcasting system 1 consists of a broadcasting device 10 and a receiving device 20. In the example in Figure 1, there is one receiving device 20, but generally there can be multiple.

[0011] The broadcasting device 10 generates multiplexed data by multiplexing at least an audio asset and an MMT package table (MPT: MPEG Media Transport Package Table), and sends the generated multiplexed data to the broadcast transmission path BT. The audio asset consists of data that indicates audio as a component of a package. A package refers to a unit of content. A package corresponds to a broadcast program (event) and is associated with a broadcast service. In this embodiment, one package contains a single audio asset. The MPT is a data table that provides information that constitutes the multiplexed package, including that audio asset.

[0012] The broadcast transmission path BT is a transmission path that enables the one-way transmission of broadcast signals to an unspecified and multiple destinations to the receiving device 20. The broadcast transmission path BT is typically formed by broadcast waves in a predetermined frequency band. The broadcast transmission path BT may also include a communication network as part of its configuration. Such a communication network may be any type of network, such as the Internet, a public wireless network, a local area network, or a dedicated line.

[0013] The receiving device 20 receives multiplexed data transmitted using the broadcast transmission path BT and separates the MPT from the received multiplexed data. The receiving device 20 analyzes the multiplexed information of the package transmitted by the separated MPT. When the receiving device 20 contains selectable information indicating selectable elements of an audio asset (referred to as "selectable elements" in this application), it outputs such selectable information. The receiving device 20 processes the audio asset according to the selected information selected from the output selectable information. The selectable information indicates the characteristics of the audio derived from the audio stream that constitutes the audio asset, as selectable elements. Selectable elements may include preset audio, audio output characteristics, etc. The receiving device 20 processes the audio asset according to the selected information selected from the selectable information.

[0014] Next, a functional configuration example of the broadcast device 10 according to the present embodiment will be described. FIG. 2 is a schematic block diagram showing a functional configuration example of the broadcast device 10 according to the present embodiment. The broadcast device 10 includes a content editing unit 120, a multiplexing unit 126, a modulation unit 128, and a transmission unit 130.

[0015] The content editing unit 120 acquires a plurality of materials as respective element contents, and edits broadcast content having the acquired element contents. The edited broadcast content forms one package and is broadcast as a program. In the present application, an element content consisting of audio is referred to as "element audio". Audio serving as a material In the present embodiment, the broadcast content includes a single audio asset and a video asset as its components. The audio asset includes an audio stream, that is, continuously-time audio data. The audio asset includes one or more element audios and is configured so that selectable elements (referred to as "selectable elements" in the present application) are derived. The content editing unit 120 outputs the content data of the edited package to the multiplexing unit 126. The output content data includes an audio asset and a video asset. The content data may be configured to include element contents such as audio and video, including broadcast content. The broadcast content is configured as a digital document described using a markup language such as HTML (Hypertext Modeling Language), a script language, or the like. For the broadcast content, the presentation start time, presentation end time, display area, etc. for each element content can be specified. The broadcast content can also be regarded as a program describing commands for presenting the content.

[0016] The content editing unit 120 includes an audio encoding unit 122 and a video encoding unit 124. The audio encoding unit 122 acquires audio data of one or more channels as elemental content, and generates an audio asset forming a single audio stream from the acquired audio data using a predetermined audio encoding method. As the audio encoding method (audio compression method), for example, a method defined in MPEG-H Part3 3D Audio can be used. The audio encoding unit 122 processes, for example, elemental audio which is one or more elemental contents.

[0017] One type of elemental audio or a combination of a plurality of elemental audios can be preset as preset audio. The setting information of the preset audio may include output characteristics for each elemental audio as its playback mode. As selectable items, individual preset audios to be played back, detailed settings, etc. can be items of selectable elements. In the detailed settings, output characteristics for each elemental audio can be specified. As the output characteristics, for example, volume can be applied. When a plurality of elemental audios are included in the preset audio, the volume ratio for each elemental audio is specified as the output characteristics.

[0018] The audio encoding unit 122 may encode multi-channel audio as elemental audio. As the multi-channel audio, for example, audio related to an audio mode such as 5.1-channel surround or 22.1-channel surround may be applied. The multi-channel audio may be used for stereophonic playback. In that case, for example, the target direction of the perceived sound can be included in the output characteristics as a selectable element.

[0019] The video encoding unit 124 acquires video data representing high-resolution video as elemental content, and generates a video asset forming a video stream from the acquired video using a predetermined video encoding method.

[0020] The multiplexing unit 126 receives content data from the content organization unit 120. The multiplexing unit 126 multiplexes the input content data and multiplexing information (control information) that indicates the information constituting the package using a predetermined multiplexing method, and generates multiplexed data. For example, the MMT-TLV (MPEG Media Transport-Type Length Value) method can be used as the multiplexing method. The multiplexing information is described using, for example, an MMT package table (MPT). The MPT may describe, for example, the assets constituting the package, the attributes of each asset, and the selectable elements of the audio asset. The multiplexing unit 126 subdivides the content data and multiplexing information into blocks of a predetermined amount of information to generate MMTP packets and constructs a TLV packet that stores the MMTP packets acquired at predetermined transmission time intervals. The multiplexing unit 126 outputs a TLV stream consisting of a series of TLV packets as multiplexed data to the modulation unit 128.

[0021] The modulation unit 128 modulates the multiplexed data input from the multiplexing unit 126 using a predetermined modulation scheme and converts it into a broadcast signal. Examples of predetermined modulation schemes include 64QAM (Quadrature Amplitude Modulation) and 256QAM. The modulation unit 128 outputs the converted broadcast signal to the transmission unit 130. The transmitting unit 130 transmits the broadcast signal input from the modulation unit 128 to the broadcast transmission line BT. The transmitting unit 130 is, for example, a transmitter and is connected to an antenna. The transmitting unit 130 upconverts the input broadcast signal from the base frequency to a predetermined carrier frequency and supplies it to the antenna as a transmission signal. The antenna then transmits a broadcast wave that carries the broadcast signal.

[0022] Next, an example of the functional configuration of the receiving device 20 according to this embodiment will be described. Figure 3 is a schematic block diagram showing an example of the functional configuration of the receiving device 20 according to this embodiment. The receiving device 20 is composed of a receiving unit 212, a demodulation unit 214, a separation unit 216, an audio decoding unit 222, an image decoding unit 232, a presentation processing unit 240, a playback unit 250, a display unit 260, and an input unit 270.

[0023] The receiving unit 212 receives the broadcast signal transmitted via the broadcast transmission line BT and outputs the received broadcast signal to the demodulation unit 214. The receiving unit 212 is, for example, a tuner and is connected to an antenna. The receiving unit 212 downconverts the carrier frequency component of the received signal obtained by the antenna to the base frequency and outputs it to the demodulation unit 214 as a broadcast signal. The carrier frequency is specified as the carrier frequency corresponding to the broadcast channel indicated by the presentation processing unit 240.

[0024] The demodulation unit 214 demodulates the broadcast signal input from the receiving unit 212 using a predetermined demodulation method and converts it into multiplexed data. The demodulation unit 214 outputs the converted multiplexed data to the separation unit 216. The demodulation method used corresponds to the modulation method used to modulate the transmitted multiplexed data.

[0025] The separation unit 216 separates the multiplexing information and content from the multiplexed data input from the demodulation unit 214. When the MMT-TLV method is used as the multiplexing method, the separation unit 216 extracts MMTP packets from the TLV packets, which are the units of the TLV stream that make up the multiplexed data. The separation unit 216 can extract the multiplexing information and content data from the extracted MMTP packets, respectively. The separation unit 216 refers to the MPT which describes the separated multiplexing information and identifies audio assets and video assets as assets that constitute the package components. The separation unit 216 separates the identified audio assets and outputs the separated audio assets to the audio decoding unit 222. The separation unit 216 separates the identified video assets and outputs the separated video assets to the video decoding unit 232. The separation unit 216 also outputs the separated MPT to the presentation processing unit 240. If the content data includes data broadcasting content, the separation unit 216 may output the data broadcasting content to the presentation processing unit 240.

[0026] The audio decoding unit 222 decodes the audio asset input from the separation unit 216 using a predetermined audio decoding method and outputs the decoded audio asset to the presentation processing unit 240. The audio decoding unit 222 may use an audio decoding method that corresponds to the audio encoding method used to encode the audio asset. The video decoding unit 232 decodes the video asset input from the separation unit 216 using a predetermined video decoding method and outputs the decoded video asset to the presentation processing unit 240. The video decoding unit 232 may use a video decoding method that corresponds to the video encoding method used to encode the video asset.

[0027] The presentation processing unit 240 performs processing to present the broadcast content received via broadcast. The functions of the presentation processing unit 240 can be realized by executing a browser as a program and executing commands written in the data content on the browser. That is, the functions of the presentation processing unit 240 may be realized by the computer system of the receiving device 20 analyzing the commands written in the data broadcast content input from the separation unit 216 and executing the processing indicated by the analyzed commands, as processing instructed by commands written in the browser as a program. The data broadcast content may, for example, instruct the start and end of the presentation of elemental content constituting the broadcast content, the display area of ​​the video, etc. In this application, the execution of processes indicated by instructions written in application programs such as browsers, or other programs, may be referred to as "executing a program" or "program execution."

[0028] The presentation processing unit 240 controls the reception of broadcast content and the presentation of the received broadcast content based on instructions from the operation signals input from the input unit 270. For example, the presentation processing unit 240 instructs the receiving unit 212 to start receiving broadcast content based on the operation signal (start reception). At this time, the presentation processing unit 240 starts outputting audio data indicating audio based on the audio asset input from the audio decoding unit 222 to the playback unit 250. The presentation processing unit 240 also starts outputting display data representing video based on the video asset input from the video decoding unit 232 to the display unit 260. Furthermore, the presentation processing unit 240 instructs the receiving unit 212 to stop receiving broadcast content based on the operation signal input from the input unit 270 (stop reception). At this time, the presentation processing unit 240 stops outputting audio data based on the audio asset input from the audio decoding unit 222 to the playback unit 250. The presentation processing unit 240 also stops outputting display data representing video based on the video asset input from the video decoding unit 232 to the display unit 260. The display processing unit 240 notifies the receiving unit 212 of the broadcast channel indicated by the operation signal and starts receiving the broadcast content on the notified broadcast channel (channel switching).

[0029] The presentation processing unit 240 includes an audio processing unit 242 and a video processing unit 244. The audio processing unit 242 performs processing to play back the audio represented by the audio asset input from the audio decoding unit 222. The audio processing unit 242 determines whether the audio asset input from the audio decoding unit 222 contains selectable information in the MPT input from the separation unit 216. If selectable information is included, the audio processing unit 242 generates a settings screen representing the selectable information. The video processing unit 244 outputs display data with the generated settings screen superimposed to the display unit 260. The user can view the selectable information displayed on the settings screen and learn about the selectable elements that can be selected regarding the received audio.

[0030] The audio processing unit 242 identifies the selection information indicated by the operation signal input from the input unit 270, and processes the audio asset based on the item selected according to the identified selection information. The audio processing unit 242 outputs the audio data obtained through processing to the playback unit 250. As described above, the selectable information indicates the characteristics of the audio that can be derived from the audio stream that constitutes the audio asset, as selectable elements. The audio processing unit 242 derives audio having the characteristics indicated by the selection information from the audio stream. For example, if the selectable information indicates multiple types of preset audio, the audio processing unit 242 identifies one type of preset audio indicated by the selection information and outputs audio data indicating the identified preset audio as the output audio to the playback unit 250.

[0031] More specifically, the selectable information indicates whether the output characteristics of the elemental audio or preset audio obtained from the audio stream constituting the audio asset can be adjusted. When adjustable, the selectable information may include adjustable items, which are the items that can be adjusted. Adjustable items may include, for example, volume, target position, or a combination thereof. The audio processing unit 242 may output guidance information for adjusting the output characteristics on a settings screen. When adjustment of the output characteristics is instructed by the selection information transmitted by the operation signal, the audio processing unit 242 may output a settings screen representing the adjustable items. The audio processing unit 242 may process the target elemental audio or preset audio according to the output characteristics instructed by the selection information regarding the adjustable items. More specifically, when the volume of multiple elemental audios is set as an adjustable item, the audio processing unit 242 mixes the elemental audios according to the volume instructed by the selection information to generate the output audio.

[0032] Furthermore, adjustable items may include the target direction for each elemental audio obtained from the audio stream that constitutes the audio asset. If the playback unit 250 can play multi-channel audio, the audio processing unit 242 processes the elemental audio so that it is perceived in the target direction indicated by the selection information. Here, the audio processing unit 242 refers to the setting information of the target direction and volume ratio for each audio channel that has been set in advance for its multi-channel audio playback method, and identifies the volume ratio for each audio channel that corresponds to the target direction indicated for the elemental audio. The audio processing unit 242 distributes the elemental audio according to the identified volume ratio, and the audio distributed to each channel becomes the output audio. Specific examples of selectable elements and setting screens will be described later.

[0033] The video processing unit 244 performs processing to play back the video represented by the video assets input from the video decoding unit 232. The video processing unit 244 generates a display screen in which the video represented by the video assets is arranged in a predetermined display area, and outputs display data representing the generated display screen to the display unit 260. The video processing unit 244 outputs display data representing various setting screens to the display unit 260 based on the instructions of the operation signals input from the input unit 270.

[0034] The display unit 260 includes a device for displaying various display screens indicated by display data input from the display processing unit 240. The display unit 260 includes, for example, a display. The playback unit 250 includes a device for playing back audio indicated by audio data input from the presentation processing unit 240. The playback unit 250 includes, for example, a speaker. The playback unit 250 may also be a multi-channel audio playback system consisting of multiple speakers.

[0035] The input unit 270 receives user input and outputs an operation signal corresponding to the received input to the display processing unit 240. The input unit 270 may be equipped with general-purpose components such as a mouse or touch panel, or it may be equipped with dedicated components such as buttons, levers, or knobs. The touch sensor used as the input unit 270 and the display used as the display unit 260 may be integrated so as to overlap each other and configured as a touch panel. The input unit 270 may include an operation signal sensor that detects operation signals from other devices (for example, a remote control device, a smartphone, etc.). The operation signal sensor outputs the detected operation signal to the presentation processing unit 240.

[0036] Next, we will describe examples of descriptors for describing the structure and attributes of audio assets that make up a package. Figure 4 shows an example of the structure of a Next-Generation Audio Descriptor (Next-Generation Audio_Descriptor()). Next-Generation Audio Descriptors are used to describe basic information for identifying parameters of audio streams based on next-generation audio encoding schemes such as MPEG-H 3D Audio and Dolby® AC-4. Descriptors described in a Next-Generation Audio Descriptor include descriptor tags (descriptor_tag), descriptor length (descriptor_length), audio type (nga_type), profile level (Profile_Level), preset audio (preset()), and interactive items (interactive()).

[0037] The descriptor tag (descriptor_tag) contains a predetermined descriptor used to identify this descriptor. The `descriptor_length` parameter specifies the number of bytes that represent the amount of information contained within this descriptor. The audio type (nga_type) contains a value indicating the audio encoding method used for encoding. In the example in Figure 4, either 1 is used to indicate MPEG-H, or 2 is used to indicate Dolby® AC-4. The Profile Level describes the profile and level. A profile represents a set of functions defined for a specific purpose or application. A level indicates the amount of hardware resources required, such as processing load and memory usage. These depend on the number of channels in the audio stream, the number of preset voices, and the sampling frequency of the audio per channel.

[0038] The preset audio (preset()) describes the number of preset audios transmitted in the audio stream that constitutes the audio asset, and the content (attributes) of each preset audio. A preset audio refers to a predetermined audio setting, such as a single type of elemental audio, a set of multiple types of elemental audio, or their playback modes, that is transmitted in the audio stream. The interactive() field indicates whether an interactive item exists and, if so, describes the items that can be selected by the user. The interactive() field contains the above-mentioned selectable information. As described above, the selectable information indicates the characteristics of the audio derived from the transmitted audio stream as elements that can be selected by the user. Selectable information may include adjustable audio output characteristics. Adjustable output characteristics may be specified for each element audio, regardless of whether it is set as a preset audio, or for each element audio set as a preset audio or for each set of elements audio.

[0039] Figure 5 shows an example of preset audio settings for a descriptor. Figure 5 illustrates a case where four types of preset audio are set for a single program. In this example, the four preset audios include "Japanese Main," "English Main," "Japanese Dialogue Emphasis," and "Japanese Commentary." In this example, any of the four preset audios can be selected. "Japanese Main" indicates an audio mode in which background audio and Japanese audio are presented. "Japanese Main" can be set as the primary audio without any special operation. "English Main" indicates an audio mode in which English audio is presented instead of Japanese audio. "Emphasis on Japanese Dialogue" is a mode that emphasizes the Japanese dialogue audio more than "Main Japanese." When dialogue audio is emphasized, the volume of the dialogue audio is set to be higher than the volume of the Japanese audio in "Main Japanese."

[0040] Under "Japanese Dialogue Emphasis," "Advanced Settings" is described in the "User Interaction" column. "Advanced Settings" indicates that detailed output characteristics can be adjusted according to user actions. The types of adjustable output characteristics (e.g., volume ratio for each element voice), the element voices to be adjusted, and the setting values ​​for those output characteristics (e.g., initial values) can be described using interactive items (interactive()). The "Japanese Commentary Audio" mode adds Japanese commentary audio in addition to the regular Japanese audio. In this example, the volume of the Japanese commentary audio may be the same as the volume of the regular Japanese audio. In the "Japanese Commentary Audio" section, "Advanced Settings" are described in the "User Operation" column. Regarding "Advanced Settings," the types of adjustable output characteristics, the element audio to be adjusted, and the setting values ​​(e.g., initial values) of those output characteristics may be described using interactive items (interactive()).

[0041] Next, an example of a settings screen according to this embodiment will be described. The audio processing unit 242 refers to the preset audio described in the next-generation audio descriptor to determine whether there are any selectable preset audios, and if so, to identify which preset audios are selectable. The audio processing unit 242 also refers to the description of the interactive item to determine whether there are any adjustable output characteristic items, and if so, to identify the setting information related to those items. The setting information specifies the element audio or preset audio to be adjusted, and the type and content of its output characteristics. The audio processing unit 242 generates a settings screen representing the identified selectable information and outputs display data showing the generated settings screen.

[0042] Figure 6 shows an example of a settings screen according to this embodiment. The settings screen illustrated in Figure 6 is an example of a preset voice selection screen for selecting one type of preset voice from a plurality of preset voices. This preset voice selection screen shows the selectable preset voices and their descriptions in each row, and the string "Detailed Settings" is displayed for preset voices that allow detailed output characteristics to be set. This "Detailed Settings" display is guidance information to inform the user that the output characteristics can be adjusted. The "Detailed Settings" display is displayed as a link so that the user can instruct to adjust the output characteristics by pressing it. In this application, "pressed" includes not only the meaning of actually pressing but also the meaning of the display area being indicated by operation.

[0043] Here, it is shown that one of the four preset voices exemplified in Figure 5 can be selected, and detailed output characteristics can be selected for each of the "Japanese dialogue emphasis" and "Japanese commentary voice" options. The preset voice to be presented is switched cyclically by operations such as pressing the up and down buttons that make up the input unit 270, or rotating the up and down dial. In the example in Figure 6, "English Main" is selected, and the selected preset voice and the string representing its commentary are displayed enclosed in a frame. The audio processing unit 242 selects the audio data related to "English Main" as the preset voice from the audio assets input from the audio decoding unit 222, and outputs the selected audio data to the playback unit 250. The playback unit 250 plays "English Main" as the preset voice.

[0044] In the example in Figure 7, the display of detailed settings for "Japanese dialogue emphasis" is shown when pressed. At this time, the audio processing unit 242 selects audio data related to background audio and Japanese dialogue audio as preset audio elements related to "Japanese dialogue emphasis" from the audio assets input from the audio decoding unit 222. The audio processing unit 242 adjusts the volume of each of the background audio and Japanese dialogue audio using a predetermined gain for "Japanese dialogue emphasis". The audio processing unit 242 mixes the Japanese audio and dialogue audio after volume adjustment and synthesizes the output audio. The audio processing unit 242 outputs audio data indicating the synthesized output audio to the playback unit 250.

[0045] Detailed settings can be selected, for example, by pressing the right button on the remote controller (which acts as the input unit 270) or by rotating the left or right dial. When the audio processing unit 242 detects the selection of an item in the detailed settings, it refers to the interactive items and identifies the types, content, and element voices of the adjustable output characteristics as selectable information related to "Japanese dialogue emphasis." For each identified element voice, the audio processing unit 242 generates a detailed settings screen that shows the type and content of the output characteristics as adjustable items, and outputs display data representing the detailed settings screen to the display unit 260. The user can understand the selectable elements by viewing the selectable information from the settings screen displayed on the display unit 260, and can select any of the selectable elements through operation.

[0046] Figure 8 shows an example of a settings screen for setting the output characteristics of each elemental sound, including whether playback is necessary, the volume, and the target direction, as adjustable items. The labels "Group 1," "Group 2," and "Group 3" in the first column from the left indicate elemental sounds whose output characteristics can be adjusted. Each group can be specified as a type of sound, such as a character in a drama, human speech, music, or other noises. The ON / OFF buttons in the second column from the left, labeled "ON" or "OFF," indicate whether the output of the corresponding elemental sound is necessary each time they are pressed. The dial in the third column from the left is a screen component for adjusting the volume of the corresponding elemental sound by rotating it. The slider bar in the fourth column from the left is a screen component for setting the target direction of the corresponding elemental sound by manipulating its position. The target direction is the direction in which the sound presented by the multi-channel sound system as the playback unit 250 is intended to be perceived by the user (the listener). A multi-channel sound system comprises multiple speakers positioned at different locations, and the target direction is adjusted (sound rendering) by changing the volume ratio between the speakers or speakers (channels) that emit sound. Standard speaker placement and listening positions are defined for each sound system. Under these definitions, the relationship between the target direction and the volume ratio for each speaker (sound channel) is predetermined in the sound processing unit 242. For example, the sine law, tangent law, or VBAP (Vector Based Amplitude Panning) method may be used to define the relationship between the target direction and the volume ratio for each sound channel.

[0047] In the example in Figure 8, "Group 1" and "Group 2" are instructed to be "ON," and "Group 3" is instructed to be "OFF." At this time, the audio processing unit 242 selects audio data related to "Group 1" and "Group 2" from the element audio related to "Japanese dialogue emphasis" as preset audio. The audio processing unit 242 adjusts the volume so that the instructed volume is obtained for each of "Group 1" and "Group 2." The audio processing unit 242 distributes the audio data to each channel at a volume ratio corresponding to the instructed target direction for each of "Group 1" and "Group 2" after volume adjustment. The audio processing unit 242 mixes the audio data distributed to each channel between "Group 1" and "Group 2," which are element audio instructed to be "ON." The audio processing unit 242 outputs audio data to the playback unit 250, with the audio obtained by mixing on each channel as the output audio. As a result, the user can hear the audio at the instructed volume and target direction for each of "Group 1" and "Group 2."

[0048] Note that while the example in Figure 8 assumes that the playback unit 250 can play multi-channel audio, it is not limited to this. The audio processing unit 242 may identify the model of the playback unit 250 connected to it and determine whether or not the playback unit 250 can play multi-channel audio. If multi-channel audio cannot be played, the audio processing unit 242 may omit the screen components related to setting the target direction and omit audio rendering in the target direction.

[0049] Next, an example of the receiving process according to this embodiment will be described. Figure 9 is a flowchart showing an example of the receiving process according to this embodiment. (Step S202) The receiving unit 212 receives the broadcast signal transmitted via the broadcast transmission line BT. The demodulation unit 214 demodulates the broadcast signal and acquires multiplexed data. (Step S204) The separation unit 216 separates the MPT, which indicates the package configuration, and the audio assets from the acquired multiplexed data. (Step S206) The audio processing unit 242 determines whether the separated MPT contains selectable information indicating selectable elements of the audio asset. If it is determined that it contains selectable information (Step S206 YES), the process proceeds to Step S208. If it is determined that it does not contain selectable information (Step S206 NO), the audio asset is processed according to the parameters described in the MPT without generating a settings screen, and the audio data obtained from the processing is output to the playback unit 250. After that, the process shown in Figure 9 is terminated.

[0050] (Step S208) The audio processing unit 242 generates a setting screen representing the selectable information and outputs display data showing the generated setting screen to the display unit 260. (Step S210) The audio processing unit 242 waits for an operation signal input from the input unit 270 and determines whether or not selection information has been acquired by the operation signal. If it has been acquired (Step S210 YES), it outputs to Step S212. If it has not been acquired (Step S210 NO), the process in Step S210 is repeated. (Step S212) The audio processing unit 242 processes the audio asset according to the selected item and / or value according to the acquired selection information. (Step S214) The audio processing unit 242 outputs audio data indicating the output audio obtained through processing to the playback unit 250. After that, the process shown in Figure 9 is terminated.

[0051] As described above, the broadcasting device 10 according to this embodiment includes a multiplexing unit 126 that generates multiplexed data by multiplexing audio assets in the same package and MPTs that provide information constituting the package, and a transmission unit 130 that transmits the multiplexed data by broadcast, and when the audio assets include selectable elements, the MPT includes selectable information indicating those selectable elements. The receiving device 20 includes a receiving unit 212 that receives multiplexed data from broadcast, which is multiplexed with audio assets in the same package and MPTs that provide information constituting the package; a separation unit 216 that separates the MPTs from the multiplexed data; and an audio processing unit 242 that outputs selectable information when the MPTs include selectable information indicating selectable elements of the audio assets, and processes the audio assets according to the selected information selected from the selectable information. This configuration presents selectable information indicating the selectable elements described in the MPT, and then presents audio processed according to the selected items and values. Since the selectable information can be obtained without analyzing the content of the audio asset, a mechanism is efficiently provided that allows the user to arbitrarily select the desired type of audio from the selectable elements.

[0052] Furthermore, the audio asset is a single audio stream, and the selectable information may indicate the characteristics of the audio that can be derived from the audio stream as selectable elements. The audio processing unit 242 may derive audio having the characteristics indicated by the selection information from the audio stream. In this configuration, when multiple selectable elements can be provided in a single audio stream, the audio with the characteristics indicated by the user is indicated by the selection information, by referring to the presented selectable information.

[0053] Furthermore, when the selectable information indicates at least two types of preset audio that can be derived from the audio stream, the audio processing unit 242 may output the preset audio indicated by the selection information from among the at least two types of preset audio. With this configuration, when multiple types of preset voices are available, one of the preset voices can be arbitrarily selected, and the selected preset voice will be played.

[0054] Furthermore, the selectable information indicates whether the output characteristics of the audio asset can be adjusted. When the output characteristics can be adjusted, the selectable information further indicates the adjustable items, and the audio processing unit 242 outputs guidance information for adjusting the output characteristics. When the selection information instructs adjustment of the output characteristics, the audio processing unit 242 outputs the adjustable items and processes the audio asset according to the output characteristics instructed for the adjustable items. This configuration allows the user to be notified of the availability of output characteristics for an audio asset, and if the output characteristics are adjustable, the adjustable items. Furthermore, the user can specify the output characteristics for the adjustable items. Therefore, audio with the specified output characteristics will be played.

[0055] Furthermore, the adjustable items include the volume of at least two elemental audio components that can be derived from a single audio stream constituting the audio asset, and the audio processing unit 242 may mix the elemental audio components according to the volume indicated by the selection information. This configuration informs the user that the volume of multiple audio elements can be adjusted. As a result, the audio elements are played at the specified volume.

[0056] Furthermore, the receiving device 20 is connected to a receiving unit capable of reproducing multi-channel audio, and the adjustable items include target directions for each elemental audio that can be derived from a single audio stream constituting an audio asset, and the audio processing unit 242 may process the elemental audio so that it is perceived in the target direction indicated by the selection information. This configuration informs the user that the target direction of the elemental audio is adjustable. As a result, the audio is played in the direction that is perceived as the specified target direction.

[0057] Although embodiments of this invention have been described in detail above with reference to the drawings, the specific configurations are not limited to the embodiments described above, and include designs and the like that do not depart from the spirit of this invention. The configurations described in the embodiments described above can be combined in any way.

[0058] For example, the number of elemental voices included in an audio asset, the number of selectable preset voices, the sets of elemental voices that make up each preset voice, the output characteristics of selectable elemental voices or preset voices, and their respective settings can all be set arbitrarily. In addition, the number, content, size, and position of various display information on the settings screen, detailed settings screen, and other display screens can all be set arbitrarily. Furthermore, the audio processing unit 242 may determine whether the selectable elements obtained from the MPT can be realized by the processing capabilities of the audio decoding unit 222 or the playback unit 250. The audio processing unit 242 may reject any selectable elements that it determines cannot be realized and may not include them in the settings screen.

[0059] Furthermore, some components of the receiving device 20 may be omitted, or other components may be added. For example, in the receiving device 20, any one of the playback unit 250, the display unit 260, and the input unit 270, or any combination thereof, may be omitted if they can be connected to other functional units of the receiving device 20 in an input / output manner. Alternatively, the functionality of the receiving device 20 described above may be realized by recording a program for realizing the functions of part or all of the receiving device 20, for example, the separation unit 216, the audio decoding unit 222, the video decoding unit 232, and the presentation processing unit 240, on a computer-readable recording medium, and then having a computer system read and execute the program recorded on this recording medium. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer system" may also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines.

[0060] Furthermore, "computer-readable recording media" refers to portable media such as flexible disks, magneto-optical disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. Thus, the recording media on which the program is stored may also be non-transient recording media such as CD-ROMs. In addition, recording media include internal or external recording media accessible from the distribution server for the purpose of distributing the program. The program code stored on the distribution server's recording media may be different from the program code in a format executable on the terminal device. In other words, as long as it can be downloaded from the distribution server and installed in a format executable on the terminal device, the format in which it is stored on the distribution server is irrelevant.

[0061] Furthermore, the program may be divided into multiple parts, downloaded at different times, and then integrated on the terminal device, or different distribution servers may be used to distribute each of the divided programs. The programs for realizing the functions of each part may be configured individually. For example, the functions of the presentation processing unit 240 may be realized by the computer system executing a browser as a program. Here, as processing related to the browser, the computer system may syntactically analyze the instructions written in the application that is transported as part of the content or separately from the content in the broadcast signal, and execute the processing instructed by the identified instructions to realize part of the functions of the presentation processing unit 240. "Computer-readable recording medium" includes volatile memory (e.g., RAM) inside the computer system that acts as a server or client when a program is transmitted over a network, which holds the program for a certain period of time. In addition, the above program may be for realizing part of the functions described above. Furthermore, the above functions may be realized in combination with a program already recorded in the computer system, a so-called differential file (differential program).

[0062] 1…Broadcasting system, 10…Transmitter, 20…Receiver, 120…Content configuration unit, 122…Audio coding unit, 124…Video coding unit, 126…Multiplexing unit, 128…Modulation unit, 130…Transmission unit, 212…Receiver, 214…Demodulation unit, 216…Separation unit, 222…Audio decoding unit, 232…Video decoding unit, 240…Presentation processing unit, 242…Audio processing unit, 244…Video processing unit, 250…Playback unit, 260…Display unit, 270…Input unit

Claims

1. Receiving an MMT package table (MPT) via broadcast, the MMT package table providing information constituting an audio stream and a package including the audio stream; Presenting predefined audio presets for configuring a program based on the MPT; Select one of the presets based on a user operation. Receiving device.

2. The MPT describes the selectable presets, Presenting the presets selectable based on the MPT 2. The receiving device according to claim 1.

3. Present information indicating the contents of the preset based on the MPT.

2. The receiving device according to claim 1.

4. The presets are presented in a categorized manner based on the contents of the presets.

4. The receiving device according to claim 3.

5. A receiving method in a receiving device, comprising: Receiving an MMT package table (MPT) via broadcast, the MMT package table providing information constituting an audio stream and a package including the audio stream; Presenting predefined audio presets for configuring a program based on the MPT; Select one of the presets based on a user operation. Receiving method.

Images