Broadcasting system, receiver, receiving method, and program

Abstract

To provide a sound adjustment function in GUI with unified operability and design.SOLUTION: A broadcasting system, which executes broadcasting including MPEG-H audio, comprises a receiving unit for receiving an application for a user to adjust sounds, by data broadcasting.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a broadcast system, a receiver, a reception method, and a program.

Background Art

[0002] In terrestrial digital broadcasting, adjustment of the audio transmitted from a broadcasting station has to be performed by a unique adjustment menu for each receiver. In next-generation terrestrial digital broadcasting, use of an object-based audio signal such as MPEG-H audio is being considered. In an object-based audio signal such as MPEG-H audio, audio parameters adjustable by a user are transmitted from a broadcasting station, and an audio adjustment function is provided to the user using the audio parameters. The audio adjustment function is adjustable by a GUI. Patent Document 1 describes providing the ability to simultaneously and selectively distinguish voices such as multiple pieces of music.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Patent Document 1 discloses providing synthesized voices such as multiple pieces of music, but in an object-based audio signal such as MPEG-H audio, audio adjustment on an object-by-object basis is required. Here, if a GUI for an audio adjustment function is implemented for each receiver, there is a risk that the intention of the content producer may not be accurately reflected, or that the design and operation method of the GUI may change depending on the manufacturer of the receiver or the model of the receiver. Therefore, the convenience for the user regarding the audio adjustment function has sometimes been insufficient.

[0005] The present invention has been made in view of the above points, and provides a broadcasting system, receiver, receiving method, and program that can provide an audio adjustment function with a GUI that unifies operability and design. [Means for solving the problem]

[0006] (1) The present invention has been made to solve the above problems, and one aspect of the present invention is a broadcasting system that broadcasts including MPEG-H audio, comprising a receiving unit that receives an application for the user to adjust the sound via data broadcasting.

[0007] (2) Another aspect of the present invention is a receiver in a broadcasting system that broadcasts including MMPEG-H audio, comprising a receiving unit that receives an application for a user to adjust the audio via data broadcasting.

[0008] (3) Another aspect of the present invention is a receiving method for a receiver in a broadcasting system that broadcasts MPEG-H audio, the receiving method comprising a receiving step in which the receiver receives an application for a user to adjust the audio via data broadcasting.

[0009] (4) Another aspect of the present invention is a program used in a receiver in a broadcasting system that broadcasts MPEG-H audio, which causes the receiver to perform a receiving step of receiving an application for a user to adjust the sound via data broadcasting. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a voice adjustment function with a GUI that unifies operability and design. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows an example of the configuration of a broadcasting system according to an embodiment of the present invention. [Figure 2] This block diagram shows an example of the functional configuration of the receiver according to this embodiment. [Figure 3] This figure shows an example of metadata definition according to this embodiment. [Figure 4] This figure shows an example of an acquisition command according to this embodiment. [Figure 5] This figure shows an example of an acquisition command according to this embodiment. [Figure 6] This figure shows an example of an acquisition command according to this embodiment. [Figure 7] This figure shows an example of an acquisition command according to this embodiment. [Figure 8] This figure shows an example of an update command according to this embodiment. [Figure 9] This figure shows an example of an update command according to this embodiment. [Figure 10] This figure shows an example of an update command according to this embodiment. [Figure 11] This figure shows an example of an update command according to this embodiment. [Figure 12] This flowchart shows an example of the audio adjustment process according to this embodiment. [Modes for carrying out the invention]

[0012] Embodiments of the present invention will be described in detail below with reference to the drawings.

[0013] [System Configuration] Figure 1 shows an example of the configuration of a broadcasting system Sys according to an embodiment of the present invention. The broadcast system Sys includes a broadcast device of Broadcast Station 1, a receiver 2, a broadcast station server 3, and an operator server 4. The broadcast is a broadcast using terrestrial digital broadcasting. However, the present invention is not limited to these broadcasts, and the broadcast may be a broadcast using a broadcast satellite. The broadcast using a broadcast satellite is, for example, high-altitude BS (Broadcasting Satellites) digital broadcasting or high-altitude broadband CS (Communication Satellites) digital broadcasting. Also, the broadcast may be a cable broadcast such as cable TV.

[0014] In the broadcast system Sys, a digital broadcast signal, application control information, control information regarding presentation, etc. are transmitted from Broadcast Station 1 of the broadcast station by a broadcast wave. The service provider provides metadata related to programs, video content, etc. from the operator server 4. The application control information notifies the system-compatible receiver of applications linked to the program and sends commands and control information for startup and termination. The control information regarding presentation sends control information regarding the overlay of the application and the broadcast program on the same TV screen and the permission of the presentation of the application. The broadcast station operates the broadcast station server 3 in the broadcast system Sys. The broadcast station server 3 provides metadata such as program titles, program IDs, program summaries, performers, broadcast dates and times. Information provided by the broadcast station to the service provider is provided through the API (Application Programming Interface) provided in the broadcast station server 3.

[0015] The service provider is a person who provides services by the broadcast system Sys, and performs production and distribution of content and applications for providing services and operation of the broadcast station server 3 for realizing individual services. Here, the services include broadcast communication cooperation services that cooperate broadcast and communication. Broadcast server 3 sends applications to receiver 2 for "application management and distribution." Broadcast server 3, acting as a "service-specific server," provides server functions to implement individual services (MPEG-H service, VOD program recommendation service, multilingual subtitle service, etc.).

[0016] MPEG-H is a set of standards developed by the ISO / IEC Moving Picture Experts Group (MPEG) for digital container standards, video compression standards, audio compression standards, and two adaptation test standards. MPEG-H audio enables object-based audio, for example. In object-based audio, an "object" refers to each individual sound element that makes up a program, such as music or human voices. In object-based audio, an audio signal is recorded for each sound element, allowing for individual sound control. Furthermore, when playing back on receiver 2, it is possible to play the program based on the playback position information of the elements, adjusting it to the actual speaker positions.

[0017] Broadcasting station server 3 not only implements the functional aspects of these services but also transmits the content that makes up the services (MPEG-H audio data, VOD content, subtitle data, etc.). Broadcasting station server 3 acts as a "repository" to register applications for distribution of the broadcasting system Sys and provides and searches a list of available applications in response to inquiries from receiver 2.

[0018] Receiver 2 includes functions for realizing broadcast-communication collaboration services in addition to the function for receiving existing digital broadcasts. In addition to broadband network connectivity, receiver 2 has the following functions: • Function to receive applications in response to application control signals from broadcasts. • Function to execute applications in response to application control signals from broadcasts. • A function that provides information through coordination between broadcasting and telecommunications. • Device linking function Here, the term "terminal" includes, for example, user devices such as smartphones and smart speakers. The terminal connectivity function of receiver 2 accesses broadcast resources such as program information or invokes receiver functions such as playback control in response to requests from other terminals. Furthermore, an example of an application is a digital mixer for MPEG-H audio. The user (also called the "receiver") can use the digital mixer received from the service provider server 4 to adjust the volume or effects of each audio signal, as well as the balance between audio signals. These adjustments can also be made for each speaker.

[0019] More specifically, receiver 2 has the following functions: Receiver 2 has a "broadcast reception and playback" function, which allows it to receive broadcast signals, select a specific broadcast service, and synchronously play back the video, audio, subtitles, and data broadcasts that make up the service. Receiver 2 has a "communication content reception and playback" function, which allows it to access video content stored on a server (e.g., carrier server 4) on the communication network, receive it as VOD streaming, and synchronize playback of the video, audio, and subtitles that make up the content. Receiver 2, as an "application control" function, interacts with the application engine, primarily with respect to managed applications, based on application control information acquired from servers or broadcast signals on the communication network, and has the function of controlling and managing the lifecycle and events of each application. Receiver 2 has the function of acquiring and executing applications as an "application engine." This function is implemented, for example, in an HTML5 browser. Receiver 2 has a "presentation synchronization control" function that controls the presentation synchronization of video and audio streams received from broadcast and video and audio streams received via streaming. Receiver 2 has an "application launcher" function, which is a navigation function that allows the user to select and launch mainly non-broadcast managed applications.

[0020] In the following explanation, unless otherwise specified, broadcasting station 1, broadcasting station server 3, and carrier server 4 will be referred to as broadcasting station 1, including any of these cases.

[0021] Figure 2 is a block diagram showing an example of the functional configuration of a receiver according to this embodiment. Receiver 2 in Figure 2 is a receiver that supports MPEG-H audio.

[0022] Broadcasting station 1 transmits a video signal A11 and an audio signal (also referred to as the "MPEG-H audio signal" A12). Broadcasting station 1 uses object-based audio as an audio component (asset), and transmits the MPEG-H audio signal A12, which is a multiplexed combination of this audio component and the audio components of each channel-based audio, along with the broadcast wave. Furthermore, when broadcasting station 1 transmits the MPEG-H audio signal A12 along with the broadcast wave, it simultaneously transmits an audio adjustment application A13, which is an application for users to adjust the audio, via data broadcasting.

[0023] Receiver 2 is comprised of a tuner 21, a demux (demultiplexer) 22, a video decoder 23, an audio decoder 24, a video adjustment unit 25, an audio adjustment unit 26, a browser API unit 27, and a data broadcasting browser unit 28.

[0024] The tuner 21 receives broadcast waves via the antenna and tunes (selects) to the channel selected based on user input. The tuned signal is demodulated and input as data to the Demux 22.

[0025] Demux22 separates the input data into video data streams, audio data streams, text superimposition data streams, subtitle data streams, etc. The separated audio data streams are output to the audio decoder 24. The separated video data streams are output to the video decoder 23.

[0026] The video data stream output from Demux22 is input to the video decoder 23. The video decoder 23 decodes the input video data sequence.

[0027] Furthermore, the character superdata stream and subtitle data stream separated into Demux22 are decoded by a character superdecoder and a subtitle decoder (not shown), respectively, and the decoded strings are superimposed on the video.

[0028] The audio data streams from each audio component output from Demux22 are output to the audio decoder 24. The audio decoder 24 decodes the audio data sequence of the audio component. The audio decoder 24 also extracts metadata from the audio data sequence input from Demux 22. The audio decoder 24 outputs the metadata to the browser API 27 in response to a request from the browser API 27.

[0029] The video adjustment unit 25 performs color space conversion processing on the decoded video data sequence and uses it for displaying the video on the display.

[0030] The audio adjustment unit 26 synthesizes the audio for each sound material based on the audio data sequence decoded by the audio decoder 24 and the adjustment information output from the browser API unit 27, and performs downmixing. The downmixed audio data sequence is converted back into audio and output from the speaker.

[0031] The browser API unit 27 acquires metadata from the audio decoder 24 and / or the main unit information storage unit 29 using the API, based on the instruction signal from the data broadcasting browser unit 28. Based on the instruction signal from the data broadcasting browser unit 28, the browser API unit 27 outputs adjustment information indicating the adjustment value of the metadata to the audio adjustment unit 26 using the API.

[0032] The data broadcasting browser unit 28 launches the audio adjustment application transmitted from broadcasting station 1 via data broadcasting. The data broadcasting browser unit 28 obtains metadata from the audio decoder 24 and / or the main unit information storage unit 29 via the browser API unit 27. Based on the metadata, the data broadcasting browser unit 28 obtains initial values ​​for parameters that can be adjusted by the user. The data broadcasting browser unit 28 sets the initial values ​​for the audio-adjustable parameters in the audio adjustment application.

[0033] For example, the data broadcasting browser unit 28 displays a GUI by executing an audio adjustment application and obtains audio adjustment parameters through user operations on the GUI. The data broadcasting browser unit 28 outputs adjustment information based on the adjustment parameters to the audio adjustment unit 26 via the browser API unit 27.

[0034] The main unit information storage unit 29 stores main unit information. Main unit information is information that the receiver 2 stores in advance, such as speaker location information and viewing scene setup information such as the direction the viewer is facing.

[0035] As described above, the receiver 2 according to this embodiment is a broadcasting system that broadcasts including MPEG-H audio, and receives an application for the user to adjust the audio via data broadcasting. By executing the received application, the user can adjust the audio via a GUI with unified operability and design, regardless of the manufacturer or model of the receiver, thereby improving user convenience.

[0036] [Metadata Definition] Next, we will explain the definitions of the four metadata types defined in MPEG-H used in this embodiment. Figure 3 shows an example of the metadata definition used in this embodiment. As shown in the figure, the metadata used in this embodiment consists of four types of data: interactive data, individual setting data, overall MPEG-H configuration data, and audio scene placement data. This metadata is described by API functions such as mpegh3daElementInteraction(), mpegh3daLocalSetupInformation(), mpegh3daConfig(), and mpegh3daSceneDisplacement(). Of these, the two metadata types, mpegh3daElementInteraction() and mpegh3daConfig(), are included in the MPEG-H audio data sent from the broadcasting station and can be obtained from the audio decoder 24. The other two metadata types, mpegh3daLocalSetupInformation() and mpegh3daSceneDisplacement(), can be obtained from the receiver 2's main unit information.

[0037] [Retrieve metadata] Next, the acquisition of metadata by the browser API unit 27 will be explained. Figures 4 to 7 show examples of metadata acquisition commands according to this embodiment. In the examples shown in Figures 4 to 7, the method has the name "getMpegh3daElementInteraction()". The return type of the execution result is an "Mpegh3daElementInteraction object". The method has the name "getMpegh3daLocalSetupInformation()". The return type of the execution result is an "Mpegh3daLocalSetupInformation object". The method has the name "getMpegh3daConfig()". The return type of the execution result is an "Mpegh3daConfig() object". The method has the name "getMpegh3daSceneDisplacement()". The return type of the execution result is an "Mpegh3daSceneDisplacement() object".

[0038] The browser API unit 27 executes acquisition commands defined by each "method name" based on instruction signals from the data broadcasting browser unit 28, and acquires metadata from the audio decoder 24 and / or the main unit information storage unit 29.

[0039] [Metadata Update] Next, we will explain how to update metadata using the browser API unit 27. Figures 8 to 11 show examples of metadata update commands according to this embodiment. In the examples shown in Figures 8 to 11, the method has the name "putMpegh3daElementInteraction()". The return type of the execution result is an "Mpegh3daElementInteraction object". The method has the name "putMpegh3daLocalSetupInformation()". The return type of the execution result is an "Mpegh3daLocalSetupInformation object". The method has the name "putMpegh3daConfig()". The return type of the execution result is an "Mpegh3daConfig() object". The method has the name "putMpegh3daSceneDisplacement()". The return type of the execution result is an "Mpegh3daSceneDisplacement() object".

[0040] The browser API unit 27 updates the metadata by executing update commands defined by each "method name" based on instruction signals from the data broadcasting browser unit 28.

[0041] [Process flow] Next, an example of the audio adjustment process according to this embodiment will be described. Figure 12 is a flowchart showing an example of the audio adjustment process according to this embodiment. (Step S101) Receiver 2 receives and activates an audio adjustment application from the data broadcast corresponding to the selected content, in response to user-operated channel selection and power operations. (Step S102) Receiver 2 extracts metadata from the separated audio data. (Step S103) Receiver 2 acquires metadata from the audio decoder 24 and / or the main unit information storage unit 29 in response to an API acquisition command.

[0042] (Step S104) Based on the acquired metadata, receiver 2 sets the initial values ​​of the parameters for each voice-adjustable voice in the voice adjustment application. (Step S105) Receiver 2 receives user input to the voice adjustment application. When Receiver 2 receives user input to the voice adjustment application, it updates the metadata for each voice that was operated on using an API update command. (Step S106) Receiver 2 performs audio adjustments based on the updated metadata.

[0043] Thus, the receiver 2 according to this embodiment is a receiver in a broadcasting system that broadcasts including MPEG-H audio, and receives an application for the user to adjust the audio via data broadcasting.

[0044] This allows for the provision of audio adjustment functions with a unified GUI design and operability, without requiring a GUI to be implemented on each receiver. Furthermore, using a unified GUI regardless of the receiver manufacturer or model improves user convenience.

[0045] Furthermore, some parts of the broadcasting station 1, receiver 2, broadcasting station server 3, and operator server 4 in the above-described embodiment, for example, at least some parts of the receiver 2's Demux 22, audio decoder 24, audio adjustment unit 26, video decoder 23, video adjustment unit 25, browser API unit 27, and data broadcasting browser unit 28, may be implemented by a computer. In that case, the program for implementing this control function may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be loaded into a computer system and executed. Here, "computer system" refers to a computer system built into the broadcasting station 1, receiver 2, broadcasting station server 3, or operator server 4, and includes hardware such as an OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into a computer system. Furthermore, "computer-readable recording media" may include those that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs via networks such as the Internet or communication lines such as telephone lines, as well as those that hold programs for a certain period of time, such as volatile memory within a computer system that acts as a server or client in such cases. In addition, the above-mentioned program may be for the purpose of realizing some of the functions described above, and may also be a program that can realize the above-mentioned functions in combination with a program already recorded in the computer system. Furthermore, some or all of the broadcasting station 1, receiver 2, broadcasting station server 3, and carrier server 4 in the above-described embodiment may be implemented as integrated circuits such as LSIs (Large Scale Integration). Each functional block of the broadcasting station 1, receiver 2, broadcasting station server 3, and carrier server 4 may be individually processorized, or some or all of them may be integrated into a single processor. In addition, the method of implementing integrated circuits is not limited to LSIs; dedicated circuits or general-purpose processors may also be used. Furthermore, if advances in semiconductor technology lead to the emergence of integrated circuit technologies that can replace LSIs, integrated circuits using such technologies may be used.

[0046] Although one embodiment of this invention has been described in detail above with reference to the drawings, the specific configuration is not limited to that described above, and various design changes can be made without departing from the spirit of this invention. [Explanation of Symbols]

[0047] Sys Broadcasting System 1 Broadcasting station 2 receivers 3. Broadcasting station server 4. Service Provider Server 21 Tuners 22 Demux 23 Video Decoder 24 Audio Decoder 25. Video Adjustment Section 26. Audio Adjustment Unit 27 Browser API Section 28 Data Broadcasting Browser Section 29 Main Information Storage Unit

Claims

1. A broadcasting system that broadcasts including MPEG-H audio, a receiving unit that receives an application via broadcast that allows a user to adjust the audio; Equipped with Broadcasting system.

2. an execution unit that executes the application; The execution unit includes a definition unit that defines an API for acquiring metadata of MPEG-H audio; Furthermore, The execution unit performs audio adjustment by transferring the metadata to a browser. The broadcasting system according to claim 1 .

3. The audio adjustment is performed on an object-by-object basis.

3. The broadcasting system according to claim 1 or 2.

4. A receiver for broadcasts including MPEG-H audio, a receiving unit that receives an application via broadcast that allows a user to adjust the audio; Equipped with Receiver.

5. A receiving method for a receiver of a broadcast including MPEG-H audio, comprising: a receiving step of receiving, via broadcast, an application for a user to adjust the audio; A receiving method comprising:

6. A program for use in a receiver of broadcasts including MPEG-H audio, a receiving step of receiving, via broadcast, an application for a user to adjust the audio; A program to execute.

7. A broadcasting system for broadcasting including object-based audio, comprising: a receiving unit that receives an application via broadcast that allows a user to adjust the audio; Equipped with Broadcasting system.

8. A receiver for broadcasts including object-based audio, comprising: a receiving unit that receives an application via broadcast that allows a user to adjust the audio; Equipped with Receiver.

9. A receiving method for a receiver of a broadcast including object-based audio, comprising: a receiving step of receiving, via broadcast, an application for a user to adjust the audio; A receiving method comprising:

10. A program for use in a receiver of broadcasts including object-based audio, comprising: a receiving step of receiving, via broadcast, an application for a user to adjust the audio; A program to execute.

Images