Receiving device, broadcasting system, receiving method, and program

Abstract

To provide a broadcasting system, a receiving device, a receiving method, and a program for reducing a load required for setting of acoustic characteristics for each object.SOLUTION: In a broadcasting system, a receiving device includes a separation unit that separates control information indicating a composition of a program, and at least an audio asset of the program from a broadcast signal, and a control unit including an audio processing unit that adjusts characteristics of an audio component for each object and stores user-set values indicating the characteristics of the audio components set according to input when the control information includes object information regarding an object organization of the audio asset, and adjusts the characteristics of the audio components for each object according to the user-set values set in the first program when the program is changed to a second program having a common object composition with the first program.SELECTED DRAWING: Figure 2

Description

Technical Field

[0004]

[0001] The present invention relates to a receiving apparatus, a broadcast system, a receiving method, and a program.

Background Art

[0002] Object-based audio (OBA) is an acoustic playback method for playing back sounds synthesized by adjusting the characteristics of each material constituting the sound. With OBA, the reproduced sound can be customized. For example, it is possible to adjust the volume of a specific object according to the viewer's preference. In recent years, the application of OBA to broadcasting has been studied.

[0003] On the other hand, a receiving apparatus has been proposed that can set any one of a plurality of audio modes. For example, the receiving apparatus described in Patent Document 1 outputs the audio of a television broadcast in a predetermined audio mode when the received television broadcast is an audio multiplex broadcast, and in a state where another audio mode different from the steady audio mode set as the steady audio mode is selected, when the normal broadcast state in which the television broadcast has switched from an audio multiplex broadcast to a normal broadcast continues for more than a predetermined time, the audio of the television broadcast is output in the steady audio mode at the next audio multiplex broadcast in the television broadcast, and when the normal broadcast state ends within the predetermined time, the audio output unit is controlled to output the audio of the television broadcast in another audio mode at the next audio multiplex broadcast.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, the composition of objects providing individual materials, including the performers in the program, typically differs from program to program. Therefore, users are required to set the audio characteristics for each object for each program. On the other hand, it is not practical for the receiving device to retain the settings set by the user for each object. Alternatively, the receiving device could retain the settings only if the viewing time for that program exceeds a certain period after the settings have been made. If the viewing time falls below this period due to channel switching, the end of broadcast time, etc., the settings will not be retained. [Means for solving the problem]

[0006] The present invention has been made to solve the above problems, and one aspect of the present invention is a receiving device comprising: a separation unit that separates control information indicating the structure of a program from a broadcast signal and at least the audio assets of the program; and an audio processing unit that adjusts the characteristics of the audio components for each object when the control information includes object information relating to the object organization of the audio assets, wherein the audio processing unit stores user setting values ​​indicating the characteristics of the audio components set according to the input, and when changed to a second program having the same object organization as the first program, adjusts the characteristics of the audio components for each object according to the user setting values ​​set in the first program.

[0007] Another aspect of the present invention is a receiving method in a receiving device equipped with a separation unit for separating control information indicating the structure of a program from at least the audio assets of the program from a broadcast signal, wherein the receiving method includes: a first step of adjusting the characteristics of the audio components for each object when the control information includes object information relating to the object organization of the audio assets; a second step of saving user setting values ​​indicating the characteristics of the audio components set according to the input; and a third step of adjusting the characteristics of the audio components for each object according to the user setting values ​​set in the first program when the program is changed to a second program having the same object organization as the first program. [Effects of the Invention]

[0008] According to this embodiment, the burden associated with setting the acoustic characteristics for each object can be reduced. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic block diagram showing an example configuration of a broadcasting system according to the first embodiment. [Figure 2] This is a schematic block diagram showing an example of the functional configuration of a receiving device according to the first embodiment. [Figure 3] This is a schematic block diagram showing an example of the functional configuration of the audio processing unit according to the first embodiment. [Figure 4] This figure shows an example configuration of an audio selection descriptor according to the first embodiment. [Figure 5] This figure shows an example of the classification of setting values ​​for the audio broadcaster ID according to the first embodiment. [Figure 6] This figure shows an example of the classification of setting values ​​for audio preset selection IDs according to the first embodiment. [Figure 7] This figure shows an example of setting object information according to the first embodiment. [Figure 8] This is a flowchart illustrating the rendering settings process according to the first embodiment. [Figure 9] This flowchart shows an example of user configuration processing according to the first embodiment. [Figure 10] This shows a first execution example of the rendering settings process according to the first embodiment. [Figure 11] This figure shows a second example of the rendering settings process according to the first embodiment. [Figure 12] A third example of the rendering settings process according to the first embodiment is shown. [Figure 13] This figure shows an example configuration of an audio selection descriptor according to the second embodiment. [Figure 14] This figure shows an example of the classification of setting values ​​for audio broadcast genre IDs according to the second embodiment. [Figure 15]An execution example of the rendering setting process according to the second embodiment is shown. [Figure 16] It is a diagram showing a configuration example of the MH - audio component descriptor according to the third embodiment. [Figure 17] It is a flowchart showing an execution example of the audio processing according to the third embodiment.

Modes for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. <First Embodiment> First, an overview of the broadcast system 1 according to the first embodiment will be described. FIG. 1 is a schematic block diagram showing a configuration example of the broadcast system 1 according to the present embodiment. The broadcast system 1 includes a broadcast device 10 and a reception device 20.

[0011] The broadcast device 10 acquires a program package and control information indicating the configuration of the program. The package refers to a unit of content corresponding to a program (event) and is associated with a broadcast service. The package is composed of a plurality of assets that become components. The plurality of assets include at least one audio asset. In addition to the audio asset, other types of components such as video assets and data broadcast assets may be included. The broadcast device 10 multiplexes the acquired package and control information to form multiplexed data, modulates the formed multiplexed data, and transmits a broadcast signal including the multiplexed data to a broadcast transmission line.

[0012] Generally, the audio of a program includes one or a plurality of audio materials as elements. The audio from a plurality of sound sources is mixed (mixed) in the process of program production to obtain a single - channel audio. Usually, the acoustic characteristics of a single - channel audio are adjusted collectively and not adjusted for each sound source. In this embodiment, some or all of the sound sources that form the audio of a program may be set as objects. In that case, the receiving device 20 applies OBA to reproduce the transmitted audio. In OBA, the acoustic characteristics of the audio components can be adjusted for each object. The characteristic values representing the adjustable acoustic characteristics include, for example, volume. The audio asset may be composed of audio components for each object. In that case, the control information includes object information regarding the object composition of the audio asset. The audio asset is encoded using, for example, MPEG-H 3D-Audio or AC-4 as the audio encoding method. MPEG-H 3D-Audio or AC-4 constitutes an audio asset in which the audio of a plurality of objects forms a single audio stream. In the following description, the acoustic characteristics of the audio or audio components may be simply referred to as "characteristics".

[0013] The broadcasting device 10 may acquire the content to be the material as element content and edit the acquired element content as an asset. The broadcasting device 10 may configure control information including information indicating the type of the edited asset. For example, individual audio materials may be used as audio components for each object, and information such as the types of those materials and the default setting values of their characteristics may be included in the object information. The default setting values may be set by the content producer or editor. The default setting values may be used as initial values in OBA as described later. In the following description, the default setting values may be referred to as "default values". The default values may be included in the audio asset in association with the audio data of the audio components for each object. On the other hand, the setting values of the characteristics of the audio components set by user operations may be referred to as "user setting values".

[0014] The broadcasting device 10 may perform content organization processing according to operation signals input in response to user operations, or according to a pre-set program or rules. The broadcasting device 10 may acquire data broadcasting content for presenting program content from an external source, or it may generate it during the content organization process. The data broadcasting content may, for example, indicate the start and end of presentation of individual elemental content, the display area of ​​the video, etc. The broadcasting device 10 may also include one or both of an audio encoder for encoding acquired audio data and a video encoder for encoding video data.

[0015] The receiving device 20 receives a broadcast signal from the broadcasting device 10 via the broadcast transmission line. The receiving device 20 demodulates the received broadcast signal and obtains the multiplexed data contained in the broadcast signal. The receiving device 20 separates control information from the obtained multiplexed data and separates the program assets by referring to the separated control information. The receiving device 20 is controlled by input operation signals according to user operations. The receiving device 20 converts the separated assets into presentation data that can be viewed. For example, the receiving device 20 decodes the encoded stream that constitutes the audio asset and generates audio data for presenting the audio. When the control information includes object information, the receiving device 20 allows adjustment of the characteristics of the audio components of each object that constitutes the object configuration. The receiving device 20 stores parameters indicating the characteristics of the audio components of the object instructed according to the operation signals input according to user operations as user settings. Generally, the received program changes over time or due to changes in the selected programming channel. When the program to be received is changed to the second program, the receiving device 20 adjusts the characteristics of the audio components for each object according to the user settings, if the object arrangement of the audio assets of the second program is the same as the object arrangement of the first program for which user settings have been saved.

[0016] An "object" is a unit that allows for adjustment of the characteristics of an audio component. Each object may be associated with a single sound source. An individual object may include, for example, the voice of one performer, or the sound of an object. As the speaker's voice, known dialogue voices, such as the lines spoken by each performer or the narration, may be used. The voices used as objects are not limited to voices obtained through actual speech, but may also be synthesized voices synthesized from text. Sounds may include musical tones from individual instruments, sound effects from individual objects, etc. The object configuration is defined using at least the number of objects in the program's audio. The object configuration may also be defined by including information such as the type and attributes of each object. As attributes for each object, for example, language may be used. Furthermore, in this application, "audio component" mainly refers to the voice related to individual objects, that is, the part of the program's audio that is handled by individual objects. An audio component may correspond to the audio material related to the sound source that forms the object.

[0017] A broadcast transmission line is a transmission line that enables the one-way transmission of various signals and data. A broadcast transmission line is composed of broadcast waves in part or in whole. The carrier frequency of a broadcast transmission line is associated with predetermined programming channels. A broadcast transmission line may be composed of a communication network in part. The communication network may be one of the following, or a combination thereof, such as the Internet, a Virtual Private Network (VPN), a Wide Area Network (WAN), or a Local Area Network (LAN).

[0018] The broadcasting equipment 10 comprises facilities primarily used or managed by broadcasting operators. The receiving device 20 is primarily used or owned by the user, the viewer. The receiving device 20 may be configured as a dedicated television receiving device, a video playback system, etc., or it may be any other electronic device that can receive broadcast signals and be connected to a sound-displaying unit that presents sound. The other electronic device may be any of the following: a personal computer (PC), a tablet device, a mobile phone (including so-called smartphones), etc.

[0019] In this application, "viewing" means either seeing or hearing, or both. Furthermore, "viewing" may also mean processing to make various types of presented content viewable, such as "receiving" a program or "presenting" content based on a broadcast signal. "Presentation" means either or both "displaying" to make it visible or "broadcasting" to make it audible. In this application, the execution of the processes indicated by the instructions written in an application program, app, or other program may be referred to as "executing a program" or "program execution."

[0020] Next, an example of the functional configuration of the receiving device 20 according to this embodiment will be described. Figure 2 is a schematic block diagram showing an example of the functional configuration of the receiving device 20 according to this embodiment. The receiving device 20 is comprised of a broadcast receiving unit 212, a demodulation unit 214, a separation unit 216, a control unit 220, a presentation unit 240, and an input unit 250.

[0021] The broadcast receiving unit 212 receives broadcast signals transmitted via the broadcast transmission line and outputs the received broadcast signals to the demodulation unit 214. The broadcast receiving unit 212 is, for example, a tuner and is connected to an antenna. The broadcast receiving unit 212 receives broadcast waves as broadcast signals that have a carrier frequency corresponding to the programming channel indicated by the control unit 220 and that are received by the antenna.

[0022] The demodulation unit 214 demodulates the broadcast signal input from the broadcast reception unit 212 using a predetermined demodulation method and converts it into multiplexed data. The demodulation unit 214 outputs the converted multiplexed data to the separation unit 216. As the demodulation method, a method corresponding to the modulation method used to modulate the transmitted multiplexed data (e.g., 16QAM: Quadrature Amplitude Modulation, 64QAM, etc.) is used. As the multiplexing method, for example, the MMT-TLV (MPEG Media Transport Type Length Value) method can be used. When the MMT-TLV method is used, the multiplexed data becomes a TLV stream. The TLV stream is a data stream containing a series of TLV packets multiplexed using the MMT-TLV method.

[0023] The separation unit 216 separates the multiplexed data input from the demodulation unit 214 into the package provided in the broadcast service and the control information related to that broadcast. The control information describes the configuration of the package provided in the broadcast service as a table or message. In the MMT system, the control information is described in information tables such as the MPT (MMT Package Table) and MH-EIT (Event Information Table). The MPT includes a list of assets that make up the package in the service provided at that time, as well as location information indicating their location. The MH-EIT includes program information such as broadcast time and program name for each event (program).

[0024] The separation unit 216 extracts the MPT from the input control signals, refers to the extracted MPT, and separates the individual assets that make up the content package. The separation unit 216 outputs the separated MPT, MH-EIT, and individual assets to the content decoding unit 224.

[0025] The control unit 220 is comprised of a receiving control unit 222, a content decoding unit 224, an audio processing unit 226, and a video processing unit 228. The control unit 220 may include a computer system including a processor, and the processor may execute a predetermined program to realize its functions. When data broadcasting content is acquired as an asset constituting a package, the computer system may execute a browser as a program and execute commands written in the data content on the browser to realize some or all of the functions of the control unit 220.

[0026] The reception control unit 222 receives the broadcast signal and performs control to present the content carried by the received broadcast signal. The reception control unit 222 instructs the broadcast reception unit 212 to start receiving the program based on an instruction from an operation signal input from the input unit 250, for example. At this time, the reception control unit 222 stops the output of audio data from the audio processing unit 226 to the display unit 240, and stops the output of video data from the video processing unit 228 to the display unit 240. The reception control unit 222 instructs the broadcast reception unit 212 to stop receiving the program based on the instructions from the operation signal. At this time, the reception control unit 222 stops the output of audio data from the audio processing unit 226 to the display unit 240, and stops the output of video data from the video processing unit 228 to the display unit 240. The reception control unit 222, for example, instructs the broadcast reception unit 212 to select the programming channel for receiving the broadcast signal according to the operation signal input from the input unit 250 (channel selection).

[0027] The audio processing unit 226 receives the MPT, MH-EIT, and audio assets from the separation unit 216. The audio processing unit 226 decodes the audio assets and performs predetermined post-processing on the audio data obtained by decoding to generate output audio data that indicates the output audio. The audio processing unit 226 identifies the object configuration indicated by the object information contained in the MPT, and if user settings are saved for each object in the identified object configuration, it adopts the saved user settings as the settings for the audio components of that object. The audio processing unit 226 adopts and saves the settings for the audio components of the object indicated by the operation signal input from the input unit 250. The audio processing unit 226 adjusts the acoustic characteristics using the settings adopted for each object, and outputs the output audio data synthesized by mixing the adjusted audio components between the objects to the presentation unit 240. If the MPT does not contain object information, the audio processing unit 226 outputs the audio data obtained by decoding directly to the presentation unit 240 as output audio data.

[0028] The video processing unit 228 receives video assets and MPT from the separation unit 216. The video processing unit 228 refers to the MPT and identifies a decoding method corresponding to the video encoding method instructed for that video asset. The video processing unit 228 decodes the input audio asset using the identified decoding method. The video encoding method can be, for example, HEVC (High-Efficiency Video Coding) or VVC (Versatile Video Coding). The video processing unit 228 performs predetermined post-processing on the video data obtained by decoding to generate output video data that represents the output video. The video processing unit 228, for example, assigns the decoded video to a display area of ​​a predetermined display format to synthesize the output video. The video processing unit 228 outputs the output video data that represents the generated output video to the presentation unit 240.

[0029] The presentation unit 240 includes a device for presenting content based on output data input from the control unit 220. The presentation unit 240 includes, for example, a display and a speaker. The display functions as a display unit that displays a display image based on output video data input from the video processing unit 228. The speaker functions as a playback unit that plays back audio based on output audio data input from the audio processing unit 226. The presentation unit 240 may also include an output interface instead of, or in addition to, the display and speaker. The output interface may be further connected to one or both of other displays and speakers.

[0030] The input unit 250 receives user input and outputs an operation signal corresponding to the received input to the control unit 220. The input unit 250 may be equipped with general-purpose components such as a mouse or touch panel, or it may be equipped with dedicated components such as buttons, levers, or knobs. The touch sensor used as the input unit 250 and the display used as the presentation unit 240 may be integrated so as to overlap each other and configured as a touch panel. The input unit 250 may include an operation signal sensor that detects operation signals from other devices (for example, a remote control device, a smartphone, etc.). The operation signal sensor outputs the detected operation signal to the control unit 220.

[0031] Next, an example of the functional configuration of the audio processing unit 226 according to this embodiment will be described. Figure 3 is a schematic block diagram showing an example of the functional configuration of the audio processing unit 226 according to this embodiment. The audio processing unit 226 is comprised of an audio decoding unit 226a, a writing unit 226b, a storage unit 226c, a reading unit 226d, a rendering unit 226e, and a mixing unit 226f.

[0032] The audio decoding unit 226a receives the MPT and audio asset from the separation unit 216. The audio decoding unit 226a refers to the MPT and identifies a decoding method corresponding to the audio coding scheme (e.g., AC-4) specified for that audio asset. The audio decoding unit 226a decodes the audio asset using the identified decoding method. The audio decoding unit 226a outputs the audio data obtained by decoding to the rendering unit 226e. The audio decoding unit 226a may be configured to include a separate integrated circuit as a dedicated decoder, distinct from the other units.

[0033] If the MPT input from the separation unit 216 contains object information, the writing unit 226b determines the object configuration indicated by that object information. If the object information contains default values ​​for each object in the object configuration, the writing unit 226b extracts those default values. If the audio asset contains default values ​​associated with each audio component for each object, the writing unit 226b may extract the default values ​​associated with each audio component for each object from the decoded audio data input from the audio processing unit 226. The writing unit 226b stores the determined object configuration and the default values ​​for each audio component in the storage unit 226c.

[0034] Furthermore, the display of the OBA settings screen (described later) on the display unit 240 prompts the user to adjust the characteristics of the audio components for each object that makes up the object configuration according to their operation.Therefore, the writing unit 226b waits for the input of an operation signal from the input unit 250, identifies the user setting value as the setting value of the audio component for the object indicated by the input operation signal, and updates (overwrites) the user setting value identified as the characteristic value of the audio component for that object in the storage unit 226c.

[0035] The storage unit 226c stores the characteristic values ​​of the audio components for each object in each object configuration. The storage unit 226c is set with the most recent characteristic values ​​of the audio components for each object. The storage unit 226c may include non-volatile memory such as SRAM (Static Random Access Memory). If characteristic values ​​for a particular object are set multiple times, the last set characteristic value is stored.

[0036] If the MPT input from the separation unit 216 contains object information, the reading unit 226d identifies the object configuration shown in the object information and reads the characteristic values ​​of the audio components for each object making up the identified object configuration from the storage unit 226c. The reading unit 226d outputs the characteristic values ​​of the audio components for each object that it has read to the rendering unit 226e. The writing unit 226b and the reading unit 226d may each include an input interface and an output interface, or they may be integrated and configured to include a single input / output interface.

[0037] The rendering unit 226e receives audio data decoded from the audio decoding unit 226a. If the MPT input from the separation unit 216 contains object information, the rendering unit 226e performs rendering based on the OBA. More specifically, the rendering unit 226e receives characteristic values ​​of the audio components for each object from the reading unit 226d. The rendering unit 226e adjusts the acoustic characteristics of the audio components for each object shown in the audio data using the characteristic values ​​of that object. The rendering unit 226e outputs audio data showing the adjusted acoustic characteristics of the audio components for each object to the mixing unit 226f. If the MPT input from the separation unit 216 does not contain object information, the rendering unit 226e does not perform rendering based on the OBA and outputs the input audio data to the presentation unit 240 as output audio data.

[0038] The mixing unit 226f mixes (adds) the audio components of each object, as indicated in the audio data input from the rendering unit 226e, between the objects. The mixing unit 226f outputs output audio data, which represents the synthesized speech obtained through mixing, to the presentation unit 240.

[0039] Furthermore, if the MPT input from the separation unit 216 includes object information, the rendering unit 226e may generate an OBA setting screen that shows the object configuration indicated in the object information and the setting value of the audio component input from the reading unit 226d for each object constituting that object configuration. The rendering unit 226e may output display screen data representing the generated OBA setting screen to the presentation unit 240, and the presentation unit 240 may display the OBA setting screen. When a user accesses the OBA setting screen, they are prompted to adjust the characteristics of the audio component for each object. If no setting value has been set by the user, the default value is displayed on the OBA setting screen as the initial value of that characteristic value. In rendering, the default value or the user setting value is used to adjust the acoustic characteristics of the audio component.

[0040] With the above configuration, the audio processing unit 226 can save user settings in association with object configurations. The storage unit 226c saves a user settings table, and stores user settings for each object in the user settings table for each object configuration. When the currently received program is updated, the audio processing unit 226 refers to the user settings table and determines whether user settings corresponding to the object configuration common to the identified object configuration are saved. This determines whether the currently broadcasting program has been changed to a second program that has the same object configuration as the first program that was previously received.

[0041] The audio processing unit 226 can determine whether the currently received program has changed by detecting a channel change or the end of the currently received program. A channel change is determined by whether the programming channel indicated by the operation signal from the input unit 250 is different from the programming channel receiving the broadcast signal at that time. The end of a program is determined by referring to MH-EIT and determining whether the program whose broadcast time includes the current time has been changed.

[0042] If user settings corresponding to a common object configuration are saved, the audio processing unit 226 adopts the saved user settings as the setting values ​​for the audio components of each object for the specified object configuration. If user settings corresponding to a common object configuration are not saved, the audio processing unit 226 adopts the specified default value as the setting value for the audio components of each object for the specified object configuration.

[0043] At any point after the program update, the audio processing unit 226 waits for an operation signal indicating audio characteristic information from the input unit 250, and sets the characteristics relating to the object indicated in the input audio characteristic information as the characteristics of the audio component for that object. The audio processing unit 226 adjusts the acoustic characteristics of the audio components related to each object in the object group according to the setting value set for that object, adds the adjusted audio components together (mixing) the objects, and generates output audio.

[0044] Next, an example of the object information configuration according to this embodiment will be described. Object information is described, for example, using an audio selection descriptor (NGA_Audio_Selection_Descriptor). Figure 4 shows an example of the audio selection descriptor configuration according to this embodiment. As illustrated in Figure 4, the audio selection descriptor contains an audio broadcaster ID (audio_broadcaster_id) and an audio preset selection ID (audio_preset_selection_id). The audio broadcaster ID is identification information indicating the broadcaster (broadcasting station) to which OBA is applied. An integer value that forms a unique ID for each broadcaster is assigned as the audio broadcaster ID. The audio preset selection ID is identification information indicating the object organization related to OBA. An integer value that forms an ID for each predetermined object organization is assigned as the audio preset selection ID.

[0045] The audio selection descriptor is described, for example, in the asset area descriptor (asset_id_byte) of the second loop related to the MPT audio asset. This associates it with the audio asset. This description is parallel to the MH-Audio_Component_Descriptor, which describes the attributes and other parameters of the audio asset. The default values ​​for each object may be included in the object information or in the audio data decoded from the audio asset.

[0046] Next, we will explain an example of the classification of audio broadcaster ID settings. Figure 5 is a diagram showing an example of the classification of audio broadcaster ID settings according to this embodiment. In principle, the audio broadcaster ID settings indicate individual broadcasters. In the example in Figure 5, the settings "0x01", "0x02", and "0x03" indicate "Station A", "Station B", and "Station C", respectively. This is because each broadcaster can independently operate or define an audio preset selection ID, and therefore the same setting for an audio preset selection ID may indicate different object configurations. The setting "0x00" indicates "Common". "Common" indicates that the corresponding audio preset selection ID is common to all broadcasters. Note that the setting "0x04" is reserved, meaning it is not used as identification information to represent any broadcaster.

[0047] Next, we will describe an example of the classification of setting values ​​for the Audio Broadcaster ID. Figure 6 is a diagram showing an example of the classification of setting values ​​for the Audio Preset Selection ID according to this embodiment. The Audio Preset Selection ID indicates the object configuration. The object configuration indicates at least the number of objects related to the audio of the program. The object configuration may include information about the type of audio of each individual object, or it may include information about the language that expresses that audio. In the example in Figure 6, an object configuration with one object and an object configuration with two objects are listed. For example, "0x01" in the second row of Figure 6 indicates that there is one object, the type of that object is "dialogue", and the language is "Ja" (Japanese).

[0048] Depending on the object, a voice multiplexing service may be applied. In a voice multiplexing service, for example, voice components representing multiple languages ​​may be provided, and it may be possible to select any of the voice components of any of the languages. In Figure 6, " / " indicates that the languages ​​written before and after it are languages ​​that can be selected in the voice multiplexing service. For example, "0x06" in the 7th line of Figure 6 indicates that there are two objects, one of which is of type "dialogue" and the language can be selected as either "Ja" (Japanese) or "En" (English). The other object is of type "explanation" and the language can be selected as either "Ja" (Japanese) or "En" (English).

[0049] Therefore, if audio components in multiple languages ​​are provided for a given object, the rendering unit 226e selects an audio component in one of the languages ​​indicated by the operation signal from the input unit 250 and applies the setting value for that object to the selected audio component. The settings "0x00" and "0x09" indicate that they are reserved, meaning they are not used as identification information to represent any object organization. Alternatively, an existing broadcaster ID (broadcaster_id) may be used instead of the audio broadcaster ID.

[0050] Next, we will describe an example of setting object information. Figure 7 shows an example of setting object information according to this embodiment. In Figure 7, the audio broadcaster ID, audio preset selection ID, and the type of setting value as the setting content are shown in each column in that order. Each row shows an example of setting object information for an audio asset provided in an individual program. However, it is assumed that the acoustic characteristic to be set is volume.

[0051] In the example in the second row of Figure 7, the setting values ​​"0x00" and "0x01" are written for the Audio Broadcaster ID and Audio Preset Selection ID items, respectively. The setting values ​​"0x00" and "0x01" indicate "Common" and "Dialogue (Ja)", respectively, instructing an object configuration consisting of one object common to all broadcasters. An object related to dialogue, with Japanese as the language, is identified as the target of the setting value. In the example in the fifth row, the setting values ​​"0x03" and "0x04" are written for the Audio Broadcaster ID and Audio Preset Selection ID items, respectively. The setting values ​​"0x03" and "0x04" indicate "Station C" and "Dialogue (Ja) / (En) / (Cn)", respectively, instructing an object configuration consisting of one object for Station C. One language can be selected from Japanese, English, and Chinese, and an object related to dialogue is identified as the target of the setting value.

[0052] Next, an example of the rendering settings process according to this embodiment will be described. Figure 8 is a flowchart illustrating the rendering settings process according to this embodiment. (Step S102) The audio processing unit 226 determines whether the program being received has changed. More specifically, the audio processing unit 226 determines whether the programming channel instructed by user operation has changed from the programming channel receiving the broadcast signal (channel change), and whether the current time has passed the broadcast end time of the program being received (program end). If it is determined that the program has changed (Step S102 YES), the process proceeds to Step S104. If it is determined that the program has not changed (Step S102 NO), the process in Figure 8 is terminated.

[0053] (Step S104) The audio processing unit 226 obtains object information for the audio asset from the MPT input from the separation unit 216. (Step S106) The voice processing unit 226 identifies the object configuration shown in the acquired object information. The voice processing unit 226 refers to the user setting table stored in its unit and determines whether or not there is a user setting value corresponding to the identified object configuration. If it is determined that there is a user setting value (Step S106 YES), the process proceeds to Step S108. If it is determined that there is no user setting value (Step S106 NO), the process proceeds to Step S110.

[0054] (Step S108) The audio processing unit 226 reads the user setting values ​​for each object corresponding to the object organization identified from the user setting table, and sets the read user setting values ​​as the setting values ​​to be used for rendering. After that, the process shown in Figure 8 is terminated. (Step S110) The audio processing unit 226 extracts default values ​​for each object from the object information or audio data, and sets the extracted default values ​​as settings to be used for rendering. After that, the process shown in Figure 8 is terminated. During rendering, the settings for each object are used to adjust the acoustic characteristics of the audio components for that object. The audio components with adjusted acoustic characteristics are then mixed between objects and synthesized into the output audio.

[0055] Next, an example of user configuration processing according to this embodiment will be described. Figure 9 is a flowchart showing an example of user configuration processing according to this embodiment. (Step S122) The audio processing unit 226 waits for an operation signal input from the input unit 250 and determines whether or not a setting value for the acoustic characteristics of the object's audio component has been specified. If specified (Step S122 YES), the process proceeds to step S124. If not specified (Step S122 NO), the process shown in Figure 9 is terminated.

[0056] (Step S124) The audio processing unit 226 identifies the object configuration indicated by the object information obtained from the MPT. The audio processing unit 226 refers to the user setting table stored in its unit and determines whether there is a setting value for the audio component of the specified object for the identified object configuration. If there is a setting value (Step S124 YES), the process proceeds to step S126. If there is no setting value (Step S124 NO), the process proceeds to step S128.

[0057] (Step S126) The audio processing unit 226 replaces (overwrites) the setting value for the audio component of the specified object in the user setting table with the setting value indicated by the operation signal. After that, the process shown in Figure 9 is terminated. (Step S128) The audio processing unit 226 stores (adds) the setting values ​​of the objects instructed for the identified object configuration in the user settings table. After that, it terminates the process shown in Figure 9.

[0058] While the explanations in Figures 8 and 9 primarily focused on processing default and user-defined values ​​for acoustic characteristics, similar processing may be applied to default and user-defined values ​​for languages ​​in objects that allow selection of one language from multiple languages.

[0059] Next, an example of the rendering setting process according to this embodiment will be described. Figure 10 shows a first example of the rendering setting process according to this embodiment. In the example in Figure 10, it is assumed that initially, program A1 is received at station A, then the channel of station B is selected by channel switching to receive program B1, and then the channel is switched back to station A to resume receiving program A1. In program A1, "0x01" is specified as the audio broadcaster ID, which is a parameter representing object information, and "0x06" is specified as the audio preset selection ID. "0x01" as the audio broadcaster ID indicates station A, and "0x06" as the audio preset selection ID indicates an object configuration consisting of two objects, each of which is of a different type: dialogue and commentary. With "0x06", it is possible to select either "English" or "Japanese" as the language for the dialogue and commentary, respectively. In addition to the default value for volume, "Japanese" is specified as the default language for both the dialogue and commentary.

[0060] In contrast, during the reception of program A1, the user can specify the difference from the default value as the acoustic characteristic of the audio component of each object. In the example in Figure 10, the user-defined values ​​for the volume (Vol) of the dialogue and commentary are set to "-5" and "-1," respectively, and the languages ​​are specified as "English" and "Japanese." These user-defined values ​​are saved in the user-defined table for each object in the object configuration.

[0061] Subsequently, switching to channel B initiates reception of program B1, which has a different object configuration than program A1. In program B1, "0x02" is specified as the audio broadcaster ID, indicating station B, and "0x01" is specified as the audio preset selection ID, indicating a single object consisting of Japanese dialogue. Since no user settings are saved for this object configuration, the default value is applied to the volume of the "dialogue" object.

[0062] Subsequently, channel switching to station A resumes reception of the original program A1. The audio processing unit 226 identifies the object configuration specified by the instructed audio broadcaster ID and audio preset selection ID, refers to the user settings table, and reads the user settings values ​​for each object in the object configuration corresponding to the identified object configuration. The user settings values ​​for each object read are set as follows: for dialogue, volume "-5" and language "English"; for commentary, volume "-1" and language "Japanese".

[0063] Figure 11 shows a second execution example of the rendering setting process according to this embodiment. In the example in Figure 11, it is assumed that initially, station A receives program A1, then program A1 ends and program A2 starts without channel switching, and then program A2 ends and program A3 starts without channel switching. In this example as well, while receiving program A1, the user setting values ​​for the volume (Vol) of dialogue and commentary are set to "-5" and "-1", respectively, and the user setting values ​​for language are set to "English" and "Japanese", and these are saved in the user setting table.

[0064] In program A2, the parameters representing object information are specified as "0x01" for the audio broadcaster ID and "0x06" for the audio preset selection ID. These parameters specify that program A2 will have the same object configuration as program A1. Therefore, the user settings saved for program A1 from the user settings table are set to volume "-5" and "-1" for dialogue and commentary, respectively, and the language is set to "English" and "Japanese".

[0065] In program A3, the parameters representing object information are specified as "0x02" for the audio broadcaster ID and "0x06" for the audio preset selection ID. These parameters identify a different object configuration in program A3 from that in program A2, consisting of a single object of type "dialogue" and language "Japanese". In this example, since no user setting values ​​are set for the object configuration identified in the user setting table, the default value is set for the volume.

[0066] Figure 12 shows a third execution example of the rendering setting process according to this embodiment. In the example in Figure 12, it is assumed that initially, program A1 is received at station A, then the channel of station B is selected by channel switching and program B2 is received, and then the channel of station C, which is different from both station A and B, is selected by channel switching and program C1 is received. In this example as well, while program A1 is being received, the user setting values ​​for the volume (Vol) of the dialogue and commentary are set to "-5" and "-1", respectively, and the user setting values ​​for the language are set to "English" and "Japanese", and these are saved in the user setting table. However, "0x00", which indicates "Common", is set for all of programs A1, B2, and C1. Therefore, it is understood that the object organization indicated by the corresponding audio preset selection ID is common to all stations.

[0067] In program B2, the audio preset selection ID "0x06" is specified, which means that the object configuration for program B2 is the same as the object configuration for program A1. Therefore, the user settings values ​​saved for program A1 from the user settings table are set to "-5" and "-1" for the volume of dialogue and commentary, respectively, and the language is set to "English" and "Japanese".

[0068] In program C1, the audio preset selection ID is set to "0x01," which means that the object configuration for program C1 is the same as the object configuration for program A1. Here, an object configuration consisting of one object of type "dialogue" and language "Japanese" is identified. In this example, since no user setting values ​​are set for the identified object configuration in the user setting table, the default value is set for the volume.

[0069] <Second Embodiment> Next, a second embodiment will be described, focusing primarily on the differences between the broadcasting system 1 according to this embodiment and the above-described embodiment. Common reference numerals are used for parts common to the above-described embodiment, and unless otherwise specified, their descriptions will be referenced.

[0070] In this embodiment, the control information is transmitted via broadcast, including genre information that indicates the program's genre, within the object information that constitutes the control information. Each genre is associated with a pre-configured object arrangement. The audio processing unit 226 of the receiving device 20 stores user-defined settings for each object for the corresponding object arrangement for each program genre. When a program is changed, the audio processing unit 226 applies the previously stored user-defined settings for the same genre as the newly notified genre to the rendering based on the OBA.

[0071] The program genre is described, for example, using an audio selection descriptor. Figure 13 shows an example of the configuration of an audio selection descriptor according to this embodiment. In the example in Figure 13, the audio broadcast genre ID (audio_broadcast_genre_id) is included in the transmission. The audio broadcast genre ID field contains an integer value indicating the program genre. In this embodiment, the audio broadcaster ID and audio preset selection ID may be omitted in the audio selection descriptor. Note that one or a set of existing descriptors, such as genre 1 (content_nibble_level1), genre 2 (content_nubble_level2), and user genre (user_nibble), may be used as the descriptor indicating the genre.

[0072] Figure 14 shows an example of the classification of setting values ​​for the audio broadcast genre ID according to this embodiment. The audio broadcast genre ID indicates the genre of the program to be broadcast and a typical object configuration within that genre. Setting value "0x01" indicates sports and is associated with an object configuration containing two objects. One object is the main audio, and the other is commentary as a secondary audio. Setting value "0x02" indicates documentary and is associated with an object configuration containing two objects. One object is the main audio, and the other is commentary as a secondary audio. Setting value "0x03" indicates news and is associated with an object configuration containing two objects. One object is the main audio, and the other is narration as a secondary audio. Setting value "0x04" indicates drama and is associated with an object configuration containing one object. Regarding language, audio multiplex service is applied, and either Japanese or English can be selected. Setting value "0x05" indicates drama and is associated with an object configuration containing one object. For language support, a multi-channel audio service is applied, allowing selection of either Japanese or Chinese. The setting value "0x06" indicates a drama and is associated with an object organization containing one object. For language support, a multi-channel audio service is applied, allowing selection of either Japanese or Korean. Note that no genre is specifically assigned to the settings values ​​"0x00" and "0x07".

[0073] Next, an example of the rendering setting process according to this embodiment will be described. Figure 15 shows an example of the rendering setting process according to this embodiment. In the example in Figure 15, it is assumed that initially, program A4 is received at station A, then the channel of station B is selected by channel switching and program B4 is received, and then the channel of station C is selected by channel switching and program C4 is received. In program A4, "0x01" is specified as the audio broadcast genre ID, which is a parameter representing object information. "0x01" as the audio broadcast ID indicates sports, and the object composition is indicated as consisting of two objects, the main audio and the commentary. Here, "-1" and "+5" are set as user setting values ​​for the volume of the main audio and commentary, respectively, and these user setting values ​​are stored in the user setting table in association with the genre of sports.

[0074] In program B4, "0x01" is specified as the audio broadcast genre ID, and the genre of program C4 is identified as sports. The user settings table stores user settings values ​​corresponding to sports. Therefore, these user settings values ​​are read from the user settings table, replaced with default values, and used to adjust the volume for each object.

[0075] In program C4, the audio broadcast genre ID is specified as "0x04," identifying the genre of program C4 as drama. The user settings table does not store a user setting value corresponding to drama. Therefore, for program C4, the default value is set as the volume for the audio component that will be used as an object. Although either "Japanese" or "English" can be selected as the language for "0x04," the default value of "Japanese" is applied.

[0076] <Third Embodiment> Next, a third embodiment will be described, focusing primarily on the differences between the broadcasting system 1 according to this embodiment and the embodiments described above. Common reference numerals are used for parts common to the embodiments described above, and unless otherwise specified, their descriptions will be referenced. In this embodiment, the MPT constituting the control information includes object-based audio information indicating the presence or absence of object-specific audio components in the program's audio assets, which is transmitted via broadcast. The object-based audio information is described in association with the audio asset.

[0077] The audio processing unit 226 extracts object-based audio information, which constitutes control information regarding the audio asset, from the MPT, and determines the presence or absence of object-specific audio components in the audio asset based on the extracted object-based audio information. If it is determined that object-specific audio components exist, the audio processing unit 226 uses the object information to perform processing to adjust the acoustic characteristics of the audio components for each object. This processing may include the user setting processing and rendering setting processing described above. If it is determined that there are no object-specific audio components, the audio processing unit 226 does not adjust the acoustic characteristics of the audio components for each object, but instead performs adjustment of the acoustic characteristics of the audio for the entire audio asset.

[0078] By including object-based audio information that indicates the presence or absence of object-specific audio components in the control information, it is possible to determine the necessity of OBA based on object information without waiting for the decoding of the audio assets or analyzing the audio data obtained through decoding. Therefore, the processing time required from acquiring object-specific audio components to receiving the broadcast signal and presenting the output audio can be shortened.

[0079] Object-based audio information is described, for example, using an MH-Audio_Component_Descriptor. Figure 16 shows an example of the configuration of an MH-Audio_Component_Descriptor according to this embodiment. In the example in Figure 16, object-based audio information is transmitted including an object-based audio flag (nga_existence) item that indicates the presence or absence of object-specific audio components. Object-based audio information is represented by the setting value of the object-based audio flag. That is, a setting value of 1 for the object-based audio flag indicates the presence of object-specific audio components, and a setting value of 0 indicates the absence of object-specific audio components. With this arrangement, object-based audio information is associated with audio assets in parallel with object information.

[0080] Next, an example of the execution of the audio processing according to this embodiment will be described. Figure 17 is a flowchart showing an example of the execution of the audio processing according to this embodiment. (Step S132) The audio processing unit 226 extracts object-based audio information from the object information of the program's audio assets. Based on the extracted object-based audio information, the audio processing unit 226 determines whether or not there are object-specific audio components in the audio assets. If it is determined that there are object-specific audio components (Step S132 YES), the process proceeds to Step S134; if it is determined that there are no object-specific audio components (Step S132 NO), the process proceeds to Step S136.

[0081] (Step S134) The audio processing unit 226 adjusts the acoustic characteristics for the audio components of each object based on the object information. This step includes user setting processing and rendering setting processing. After that, the process proceeds to step S138. (Step S136) The audio processing unit 226 performs normal audio processing. That is, the audio processing unit 226 adjusts the acoustic characteristics of the audio across the entire audio asset. After that, the process proceeds to step S138. (Step S138) The audio processing unit 226 determines whether the program being received has changed. Here, the audio processing unit 226 determines whether the programming channel instructed by user operation has changed from the programming channel receiving the broadcast signal, and whether the current time has passed the broadcast end time of the program being received. The processing in this step may be the same as the processing in step S102. If it is determined that the program has changed (Step S138 YES), the process returns to step S132. If it is determined that the program has not changed (Step S138 NO), the process in Figure 17 is terminated.

[0082] As described above, the receiving device 20 according to this embodiment includes a separation unit 216 that separates control information (e.g., MMT-SI) indicating the program structure from the broadcast signal and at least the audio assets of the program, and an audio processing unit 226 that adjusts the characteristics of the audio components for each object when the control information includes object information relating to the object organization of the audio assets. The audio processing unit 226 stores user setting values ​​indicating the characteristics of the audio components set according to the input, and when the program is changed to a second program having the same object organization as the first program (a program previously received), it adjusts the characteristics of the audio components for each object (e.g., acoustic characteristics) according to the user setting values ​​set in the first program. Furthermore, when the program is changed to a third program with a different object configuration from the first program, the audio processing unit 226 may set the characteristics of the audio components for each object according to the default settings (e.g., default values) included in the control information or audio assets. The characteristics of the audio components may be volume. This configuration allows user settings for each audio component that makes up the audio of the first program to be saved. When the program is changed to the second program, which has a common object configuration, the saved user settings are used to adjust the characteristics of the audio components. It is not necessary to set user settings each time the program is changed to obtain the desired characteristics.

[0083] The object information may include a first setting value indicating the object configuration (e.g., an audio preset selection ID) and a second setting value indicating the broadcaster related to the program (e.g., an audio broadcaster ID). The audio processing unit 226 may determine the object configuration based on the first and second descriptors. In this configuration, the object configuration is identified by a pair of a first descriptor and a second descriptor that indicates the broadcaster. Even if the object configuration indicated by the first descriptor differs depending on the broadcaster, the object configuration can be uniquely identified.

[0084] When the second setting value indicates that the object configuration shown by the first setting value is common to all broadcasters (for example, Common), the audio processing unit 226 may determine the object configuration based on the object information, regardless of the broadcaster. This configuration allows for the unique identification of the object configuration based on the object arrangement specified by the first setting value.

[0085] The object information may include a setting value indicating the program genre (for example, an audio broadcast genre ID). The audio processing unit 226 may identify an object configuration corresponding to the genre indicated by the setting value. This configuration allows for the identification of object-based programming based on program genre, regardless of the broadcaster.

[0086] The control information may include object-based audio information (e.g., an object-based audio flag) indicating the presence or absence of object-specific audio components in the audio asset. If the object-based audio flag indicates the absence of object-specific audio components, the audio processing unit 226 does not need to adjust the characteristics of the audio components for each object. This configuration allows the audio processing unit 226 to determine the presence or absence of audio components for each object without analyzing the audio asset to be decoded. It can determine whether preparation for rendering the audio components for each object is necessary without waiting for the audio decoding to be completed. Therefore, processing delays can be reduced.

[0087] Although embodiments of this invention have been described in detail above with reference to the drawings, the specific configurations are not limited to the embodiments described above, and include designs and the like that do not depart from the spirit of this invention. The configurations described in the embodiments described above can be combined in any way.

[0088] For example, the display unit 240 and input unit 250 of the receiving device 20 do not necessarily have to be integrated with other parts of the receiving device 20; they may be separate components as long as they can transmit and receive various types of data. While volume has been primarily described as the acoustic characteristic to be adjusted, other types of acoustic characteristics may be adjusted in place of volume, or in conjunction with volume. For example, one or a combination of frequency response, reverberation time, or the volume ratio between channels in a multi-channel playback system may be applied as the adjustment target. When the adjustment target is the volume ratio between channels, the audio components of the object to be adjusted are provided using multi-channel audio signals.

[0089] Alternatively, the control unit 220 may be implemented by recording a program for implementing some or all of the functions of the receiving device 20, for example, some or all of the functions of the control unit 220, on a computer-readable recording medium, and then loading and executing the program recorded on this recording medium into a computer system. Here, "loading and executing the program recorded on the recording medium into a computer system" includes installing the program into the computer system. Here, "computer system" includes hardware such as a processor, memory, and peripheral devices. Furthermore, "computer system" may include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Also, the program for implementing the functions of the receiving control unit 222 may be a browser. Some or all of the data broadcasting content that forms the program package may be configured as a markup document written in a markup language. The receiving control unit 222 may implement its functions by analyzing the description of the markup document and executing the processing instructed by the commands written in it.

[0090] Furthermore, "computer-readable recording media" refers to portable media such as flexible disks, magneto-optical disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. Thus, the recording media on which the program is stored may also be non-transient recording media such as CD-ROMs. In addition, recording media include internal or external recording media accessible from the distribution server for the purpose of distributing the program. The program code stored on the distribution server's recording media may be different from the program code in a format executable on the terminal device. In other words, as long as it can be downloaded from the distribution server and installed in a format executable on the terminal device, the format in which it is stored on the distribution server is irrelevant.

[0091] Furthermore, the program may be divided into multiple parts, downloaded at different times, and then integrated on the terminal device. The distribution servers for each divided program may also be different. Additionally, "computer-readable recording medium" includes volatile memory (e.g., RAM) within computer systems that act as servers or clients when a program is transmitted over a network, which retains the program for a certain period. Moreover, the program may only implement a portion of the functions described above. Furthermore, the program may be a so-called differential file (differential program) that can implement the functions described above in combination with a program already recorded in the computer system. [Explanation of symbols]

[0092] 1…Broadcasting system, 10…Broadcasting equipment, 20…Receiving equipment, 212…Broadcasting receiving unit, 214…Demodulation unit, 216…Separation unit, 220…Control unit, 222…Receiving control unit, 224…Content decoding unit, 226…Audio processing unit, 228…Video processing unit, 240…Display unit, 250…Input unit

Claims

1. A separation unit that separates control information indicating the program's structure from the broadcast signal and at least the audio assets of the program, The system includes an audio processing unit that adjusts the characteristics of the audio components for each object when the control information includes object information relating to the object organization of the audio asset, The aforementioned audio processing unit The system saves user-defined values ​​that indicate the characteristics of the audio components set according to the input. When the program is changed to a second program that has the same object composition as the first program, The characteristics of the audio components for each object are adjusted according to the user settings set in the first program. Receiving device.

2. When the program is changed to a third program having a different object configuration from the first program, The aforementioned audio processing unit The characteristics of the audio components for each object are set according to the default settings included in the control information or the audio asset. The receiving device according to claim 1.

3. The object information includes a first setting value indicating the object organization and a second setting value indicating the broadcasting company related to the program. The audio processing unit determines the object arrangement based on the first and second setting values. The receiving device according to claim 1.

4. When the second setting value indicates that the object configuration shown by the first setting value is common to broadcasters, The audio processing unit determines the object organization based on the object information, regardless of the broadcasting company. The receiving device according to claim 3.

5. The object information includes a setting value indicating the genre of the program, The aforementioned audio processing unit identifies the object organization corresponding to the genre indicated by the setting value. The receiving device according to claim 1.

6. The control information includes object-based audio information indicating the presence or absence of object-specific audio components in the audio asset. The aforementioned audio processing unit If the object-based audio information indicates that there are no object-specific audio components, the characteristics of the audio components are not adjusted for each object. The receiving device according to claim 1.

7. The characteristic of the aforementioned audio component is volume. The receiving device according to claim 1.

8. A program for causing a computer to function as the receiving device described in claim 1.

9. Multiplexed data is generated by multiplexing control information and at least the audio assets of the program. A broadcasting device that transmits a broadcast signal including the aforementioned multiplexed data, The receiving device is as described in claim 1. Broadcasting system.

10. A receiving method in a receiving device that includes a separation unit for separating control information indicating the structure of a program from a broadcast signal and at least the audio assets of the program, When the control information includes object information relating to the object organization of the audio asset, the first step is to adjust the characteristics of the audio components for each object. A second step involves saving user-defined values ​​that indicate the characteristics of the audio component set according to the input, When the program is changed to a second program having the same object configuration as the first program, a third step is performed in which the characteristics of the audio components for each object are adjusted according to the user setting value set in the first program. Reception method.

Images