Broadcasting system, receiver, receiving method, and program

Abstract

To provide a sound adjustment function in GUI with unified operability and design.SOLUTION: A broadcasting system, which executes broadcasting including MPEG-H audio, comprises a receiving unit for receiving an application for a user to adjust sounds, by data broadcasting.SELECTED DRAWING: Figure 2

Description

Technical Field

[0004] , , ,

[0005] , , , , ,

[0001] The present invention relates to a broadcast system, a receiver, a receiving method, and a program.

Background Art

[0002] In terrestrial digital broadcasting, adjustment of the audio transmitted from a broadcasting station had to be performed by a unique adjustment menu for each receiver. In next-generation terrestrial digital broadcasting, use of an object-based audio signal such as MPEG-H audio has been considered. In an object-based audio signal such as MPEG-H audio, audio parameters adjustable by the user are transmitted from the broadcasting station, and an audio adjustment function is provided to the user using the audio parameters. The audio adjustment function can be adjusted by a GUI. Patent Document 1 describes providing the ability to selectively distinguish voices of a plurality of pieces of music or the like simultaneously.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Patent Document 1 discloses providing a synthesized voice of a plurality of pieces of music or the like, but in an object-based audio signal such as MPEG-H audio, audio adjustment in units of objects is required. Here, if a GUI for an audio adjustment function is implemented for each receiver, there is a risk that the intention of the content producer may not be accurately reflected, or that the design and operation method of the GUI may change depending on the manufacturer of the receiver or the model of the receiver. Therefore, the convenience for the user regarding the audio adjustment function may not be sufficient.

[0005] The present invention has been made in view of the above points, and provides a broadcasting system, receiver, receiving method, and program that can provide an audio adjustment function with a GUI that unifies operability and design. [Means for solving the problem]

[0006] (1) The present invention has been made to solve the above problems, and one aspect of the present invention is a broadcasting system that broadcasts including MPEG-H audio, comprising a receiving unit that receives an application for the user to adjust the sound via data broadcasting.

[0007] (2) Another aspect of the present invention is a receiver in a broadcasting system that broadcasts including MMPEG-H audio, comprising a receiving unit that receives an application for a user to adjust the audio via data broadcasting.

[0008] (3) Another aspect of the present invention is a receiving method for a receiver in a broadcasting system that broadcasts MPEG-H audio, the receiving method comprising a receiving step in which the receiver receives an application for a user to adjust the audio via data broadcasting.

[0009] (4) Another aspect of the present invention is a program used in a receiver in a broadcasting system that broadcasts MPEG-H audio, which causes the receiver to perform a receiving step of receiving an application for a user to adjust the sound via data broadcasting. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a voice adjustment function with a GUI that unifies operability and design. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows an example of the configuration of a broadcasting system according to an embodiment of the present invention. [Figure 2] This block diagram shows an example of the functional configuration of the receiver according to this embodiment. [Figure 3] This figure shows an example of metadata definition according to this embodiment. [Figure 4] This figure shows an example of an acquisition command according to this embodiment. [Figure 5] This figure shows an example of an acquisition command according to this embodiment. [Figure 6] This figure shows an example of an acquisition command according to this embodiment. [Figure 7] This figure shows an example of an acquisition command according to this embodiment. [Figure 8] This figure shows an example of an update command according to this embodiment. [Figure 9] This figure shows an example of an update command according to this embodiment. [Figure 10] This figure shows an example of an update command according to this embodiment. [Figure 11] This figure shows an example of an update command according to this embodiment. [Figure 12] This flowchart shows an example of the audio adjustment process according to this embodiment. [Modes for carrying out the invention]

[0012] Embodiments of the present invention will be described in detail below with reference to the drawings.

[0013] [System Configuration] Figure 1 shows an example of the configuration of a broadcasting system Sys according to an embodiment of the present invention. The broadcast system Sys includes a broadcast device of Broadcast Station 1, a receiver 2, a broadcast station server 3, and a service provider server 4. The broadcast is a broadcast using terrestrial digital broadcasting. However, the present invention is not limited to these broadcasts, and the broadcast may be a broadcast using a broadcast satellite. The broadcast using a broadcast satellite is, for example, high-altitude BS (Broadcasting Satellites) digital broadcast or high-altitude broadband CS (Communication Satellites) digital broadcast. Also, the broadcast may be a cable broadcast such as cable TV.

[0014] In the broadcast system Sys, a digital broadcast signal, application control information, control information regarding presentation, etc. are transmitted from Broadcast Station 1 of the broadcast station by a broadcast wave. The service provider provides metadata related to programs, video content, etc. from the service provider server 4. The application control information notifies the system-compatible receiver of applications linked to programs and sends commands and control information for startup and termination. The control information regarding presentation sends control information regarding the overlay of an application and a broadcast program on the same TV screen and the permission of application presentation. The broadcast station operates the broadcast station server 3 in the broadcast system Sys. The broadcast station server 3 provides metadata such as program titles, program IDs, program summaries, performers, broadcast dates and times, etc. The information provided by the broadcast station to the service provider is provided through the API (Application Programming Interface) provided in the broadcast station server 3.

[0015] The service provider is a person who provides services by the broadcast system Sys, and performs production and distribution of content and applications for providing services, and operation of the broadcast station server 3 for realizing individual services. Here, the services include broadcast communication cooperation services that cooperate broadcast and communication. Broadcast server 3 sends applications to receiver 2 for "application management and distribution." Broadcast server 3, acting as a "service-specific server," provides server functions to implement individual services (MPEG-H service, VOD program recommendation service, multilingual subtitle service, etc.).

[0016] MPEG-H is a set of standards developed by the ISO / IEC Moving Picture Experts Group (MPEG) for digital container standards, video compression standards, audio compression standards, and two adaptation test standards. MPEG-H audio enables object-based audio, for example. In object-based audio, an "object" refers to each individual sound element that makes up a program, such as music or human voices. In object-based audio, an audio signal is recorded for each sound element, allowing for individual sound control. Furthermore, when playing back on receiver 2, it is possible to play the program based on the playback position information of the elements, adjusting it to the actual speaker positions.

[0017] Broadcasting station server 3 not only implements the functional aspects of these services but also transmits the content that makes up the services (MPEG-H audio data, VOD content, subtitle data, etc.). Broadcasting station server 3 acts as a "repository" to register applications for distribution of the broadcasting system Sys and provides and searches a list of available applications in response to inquiries from receiver 2.

[0018] Receiver 2 includes functions for realizing broadcast-communication collaboration services, in addition to the function for receiving existing digital broadcasts. In addition to broadband network connectivity, receiver 2 has the following functions: • Function to receive applications in response to application control signals from broadcasts. • Function to execute applications in response to application control signals from broadcasts. • A function that provides information through coordination between broadcasting and telecommunications. • Device linking function Here, the term "terminal" includes, for example, user devices such as smartphones and smart speakers. The terminal connectivity function of receiver 2 accesses broadcast resources such as program information or invokes receiver functions such as playback control in response to requests from other terminals. Furthermore, an example of an application is a digital mixer for MPEG-H audio. The user (also called the "receiver") can use the digital mixer received from the service provider server 4 to adjust the volume or effects of each audio signal, as well as the balance between audio signals. These adjustments can also be made for each speaker.

[0019] More specifically, receiver 2 has the following functions: Receiver 2 has a "broadcast reception and playback" function, which allows it to receive broadcast signals, select a specific broadcast service, and synchronously play back the video, audio, subtitles, and data broadcasts that make up the service. Receiver 2 has a "communication content reception and playback" function, which allows it to access video content stored on a server (e.g., carrier server 4) on the communication network, receive it as VOD streaming, and synchronize playback of the video, audio, and subtitles that make up the content. Receiver 2, as an "application control" function, interacts with the application engine, primarily with respect to managed applications, based on application control information acquired from servers or broadcast signals on the communication network, and has the function of controlling and managing the lifecycle and events of each application. Receiver 2 has the function of acquiring and executing applications as an "application engine." This function is implemented, for example, in an HTML5 browser. Receiver 2 has a "presentation synchronization control" function that controls the presentation synchronization of video and audio streams received from broadcast and video and audio streams received via streaming. Receiver 2 has an "application launcher" function, which is a navigation function that allows the user to select and launch mainly non-broadcast managed applications.

[0020] In the following explanation, unless otherwise specified, broadcasting station 1, broadcasting station server 3, and carrier server 4 will be referred to as broadcasting station 1, including any of these cases.

[0021] Figure 2 is a block diagram showing an example of the functional configuration of a receiver according to this embodiment. Receiver 2 in Figure 2 is a receiver that supports MPEG-H audio.

[0022] Broadcasting station 1 transmits a video signal A11 and an audio signal (also referred to as the "MPEG-H audio signal" A12). Broadcasting station 1 uses object-based audio as an audio component (asset), and transmits the MPEG-H audio signal A12, which is a multiplexed combination of this audio component and the audio components of each channel-based audio, along with the broadcast wave. Furthermore, when broadcasting station 1 transmits the MPEG-H audio signal A12 along with the broadcast wave, it simultaneously transmits an audio adjustment application A13, which is an application for users to adjust the audio, via data broadcasting.

[0023] Receiver 2 is comprised of a tuner 21, a demux (demultiplexer) 22, a video decoder 23, an audio decoder 24, a video adjustment unit 25, an audio adjustment unit 26, a browser API unit 27, and a data broadcasting browser unit 28.

[0024] The tuner 21 receives broadcast waves via the antenna and tunes (selects) to the channel selected based on user input. The tuned signal is demodulated and input as data to the Demux 22.

[0025] Demux22 separates the input data into video data streams, audio data streams, text superimposition data streams, subtitle data streams, etc. The separated audio data streams are output to the audio decoder 24. The separated video data streams are output to the video decoder 23.

[0026] The video data stream output from Demux22 is input to the video decoder 23. The video decoder 23 decodes the input video data sequence.

[0027] Furthermore, the character superdata stream and subtitle data stream separated into Demux22 are decoded by a character superdecoder and a subtitle decoder (not shown), respectively, and the decoded strings are superimposed on the video.

[0028] The audio data streams from each audio component output from Demux22 are output to the audio decoder 24. The audio decoder 24 decodes the audio data sequence of the audio component. The audio decoder 24 also extracts metadata from the audio data sequence input from Demux 22. The audio decoder 24 outputs the metadata to the browser API 27 in response to a request from the browser API 27.

[0029] The video adjustment unit 25 performs color space conversion processing on the decoded video data sequence and uses it for displaying the video on the display.

[0030] The audio adjustment unit 26 synthesizes the audio for each sound material based on the audio data sequence decoded by the audio decoder 24 and the adjustment information output from the browser API unit 27, and performs downmixing. The downmixed audio data sequence is converted back into audio and output from the speaker.

[0031] The browser API unit 27 acquires metadata from the audio decoder 24 and / or the main unit information storage unit 29 using the API, based on the instruction signal from the data broadcasting browser unit 28. Based on the instruction signal from the data broadcasting browser unit 28, the browser API unit 27 outputs adjustment information indicating the adjustment value of the metadata to the audio adjustment unit 26 using the API.

[0032] The data broadcasting browser unit 28 launches the audio adjustment application transmitted from broadcasting station 1 via data broadcasting. The data broadcasting browser unit 28 obtains metadata from the audio decoder 24 and / or the main unit information storage unit 29 via the browser API unit 27. Based on the metadata, the data broadcasting browser unit 28 obtains initial values ​​for parameters that can be adjusted by the user. The data broadcasting browser unit 28 sets the initial values ​​for the audio-adjustable parameters in the audio adjustment application.

[0033] For example, the data broadcasting browser unit 28 displays a GUI by executing an audio adjustment application and obtains audio adjustment parameters through user operations on the GUI. The data broadcasting browser unit 28 outputs adjustment information based on the adjustment parameters to the audio adjustment unit 26 via the browser API unit 27.

[0034] The main unit information storage unit 29 stores main unit information. Main unit information is information that the receiver 2 stores in advance, such as speaker location information and viewing scene setup information such as the direction the viewer is facing.

[0035] As described above, the receiver 2 according to this embodiment is a broadcasting system that broadcasts including MPEG-H audio, and receives an application for the user to adjust the audio via data broadcasting. By executing the received application, the user can adjust the audio via a GUI with unified operability and design, regardless of the manufacturer or model of the receiver, thereby improving user convenience.

[0036] [Metadata Definition] Next, we will explain the definitions of the four metadata types defined in MPEG-H used in this embodiment. Figure 3 shows an example of the metadata definition used in this embodiment. As shown in the figure, the metadata used in this embodiment consists of four types of data: interactive data, individual setting data, overall MPEG-H configuration data, and audio scene placement data. This metadata is described by API functions such as mpegh3daElementInteraction(), mpegh3daLocalSetupInformation(), mpegh3daConfig(), and mpegh3daSceneDisplacement(). Of these, the two metadata types, mpegh3daElementInteraction() and mpegh3daConfig(), are included in the MPEG-H audio data sent from the broadcasting station and can be obtained from the audio decoder 24. The other two metadata types, mpegh3daLocalSetupInformation() and mpegh3daSceneDisplacement(), can be obtained from the receiver 2's main unit information.

[0037] [Retrieve metadata] Next, the acquisition of metadata by the browser API unit 27 will be explained. Figures 4 to 7 show examples of metadata acquisition commands according to this embodiment. In the examples shown in Figures 4 to 7, the method has the name "getMpegh3daElementInteraction()". The return type of the execution result is an "Mpegh3daElementInteraction object". The method has the name "getMpegh3daLocalSetupInformation()". The return type of the execution result is an "Mpegh3daLocalSetupInformation object". The method has the name "getMpegh3daConfig()". The return type of the execution result is an "Mpegh3daConfig() object". The method has the name "getMpegh3daSceneDisplacement()". The return type of the execution result is an "Mpegh3daSceneDisplacement() object".

[0038] The browser API unit 27 executes acquisition commands defined by each "method name" based on instruction signals from the data broadcasting browser unit 28, and acquires metadata from the audio decoder 24 and / or the main unit information storage unit 29.

[0039] [Metadata Update] Next, we will explain how to update metadata using the browser API unit 27. Figures 8 to 11 show examples of metadata update commands according to this embodiment. In the examples shown in Figures 8 to 11, the method has the name "putMpegh3daElementInteraction()". The return type of the execution result is an "Mpegh3daElementInteraction object". The method has the name "putMpegh3daLocalSetupInformation()". The return type of the execution result is an "Mpegh3daLocalSetupInformation object". The method has the name "putMpegh3daConfig()". The return type of the execution result is an "Mpegh3daConfig() object". The method has the name "putMpegh3daSceneDisplacement()". The return type of the execution result is an "Mpegh3daSceneDisplacement() object".

[0040] The browser API unit 27 updates the metadata by executing update commands defined by each "method name" based on instruction signals from the data broadcasting browser unit 28.

[0041] [Process flow] Next, an example of the audio adjustment process according to this embodiment will be described. Figure 12 is a flowchart showing an example of the audio adjustment process according to this embodiment. (Step S101) Receiver 2 receives and activates an audio adjustment application from the data broadcast corresponding to the selected content, in response to user-operated channel selection and power operations. (Step S102) Receiver 2 extracts metadata from the separated audio data. (Step S103) The receiver 2 acquires metadata from the audio decoder 24 and / or the main unit information storage unit 29 in response to an API acquisition command.

[0042] (Step S104) Based on the acquired metadata, receiver 2 sets the initial values ​​of the parameters for each voice-adjustable voice in the voice adjustment application. (Step S105) Receiver 2 receives user input to the voice adjustment application. When Receiver 2 receives user input to the voice adjustment application, it updates the metadata for each voice that was operated on using an API update command. (Step S106) Receiver 2 performs audio adjustments based on the updated metadata.

[0043] Thus, the receiver 2 according to this embodiment is a receiver in a broadcasting system that broadcasts including MPEG-H audio, and receives an application for the user to adjust the audio via data broadcasting.

[0044] This allows for the provision of audio adjustment functions with a unified GUI design and operability, without requiring a GUI to be implemented on each receiver. Furthermore, using a unified GUI regardless of the receiver manufacturer or model improves user convenience.

[0045] Furthermore, some parts of the broadcasting station 1, receiver 2, broadcasting station server 3, and operator server 4 in the above-described embodiment, for example, at least some parts of the receiver 2's Demux 22, audio decoder 24, audio adjustment unit 26, video decoder 23, video adjustment unit 25, browser API unit 27, and data broadcasting browser unit 28, may be implemented by a computer. In that case, the program for implementing this control function may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be loaded into a computer system and executed. Here, "computer system" refers to a computer system built into the broadcasting station 1, receiver 2, broadcasting station server 3, or operator server 4, and includes hardware such as an OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into a computer system. Furthermore, "computer-readable recording media" may include those that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs via networks such as the Internet or communication lines such as telephone lines, as well as those that hold programs for a certain period of time, such as volatile memory within a computer system that acts as a server or client in such cases. In addition, the above-mentioned program may be for the purpose of realizing some of the functions described above, and may also be a program that can realize the above-mentioned functions in combination with a program already recorded in the computer system. Furthermore, some or all of the broadcasting station 1, receiver 2, broadcasting station server 3, and carrier server 4 in the above-described embodiment may be implemented as integrated circuits such as LSIs (Large Scale Integration). Each functional block of the broadcasting station 1, receiver 2, broadcasting station server 3, and carrier server 4 may be individually processorized, or some or all of them may be integrated into a single processor. In addition, the method of implementing integrated circuits is not limited to LSIs; dedicated circuits or general-purpose processors may also be used. Furthermore, if advances in semiconductor technology lead to the emergence of integrated circuit technologies that can replace LSIs, integrated circuits using such technologies may be used.

[0046] Although one embodiment of this invention has been described in detail above with reference to the drawings, the specific configuration is not limited to that described above, and various design changes can be made without departing from the spirit of this invention. [Explanation of symbols]

[0047] Sys Broadcasting System 1 Broadcasting station 2 receivers 3. Broadcasting station server 4. Service Provider Server 21 Tuners 22 Demux 23 Video Decoder 24 Audio Decoder 25. Video Adjustment Section 26. Audio Adjustment Unit 27 Browser API Section 28 Data Broadcasting Browser Section 29 Main Information Storage Unit

Claims

1. A broadcasting system that broadcasts including MPEG-H audio, An application for the user to adjust the volume, a receiving unit that receives the broadcast, The system includes an execution unit that runs the aforementioned application, The aforementioned execution unit is a broadcasting system that performs audio adjustment by passing MPEG-H audio metadata to a browser.

2. The execution unit includes a function for obtaining metadata of MPEG-H audio. The broadcasting system according to claim 1.

3. The aforementioned audio adjustment is performed on an object-by-object basis. The broadcasting system according to claim 1 or 2.

4. A receiver for broadcasts including MPEG-H audio, An application for the user to adjust the volume, a receiving unit that receives the broadcast, The system includes an execution unit that runs the aforementioned application, The execution unit is a receiver that performs audio adjustment by passing MPEG-H audio metadata to a browser.

5. A method for receiving broadcasts including MPEG-H audio, The application for the user to adjust the volume is received via broadcast in a reception step, The application has an execution step, The aforementioned execution step is a receiving method that performs audio adjustment by passing MPEG-H audio metadata to a browser.

6. Used in receivers of broadcasts including MPEG-H audio, The application for the user to adjust the volume is received via broadcast in a reception step, A program for causing the execution step of executing the aforementioned application, The execution step described above is a program that performs audio adjustment by passing MPEG-H audio metadata to the browser.

7. A broadcasting system that broadcasts object-based audio, An application for the user to adjust the volume, a receiving unit that receives the broadcast, The system includes an execution unit that runs the aforementioned application, The execution unit is a broadcasting system that performs audio adjustment by passing object-based audio metadata to a browser.

8. A receiver for broadcasts including object-based audio, An application for the user to adjust the volume, a receiving unit that receives the broadcast, The system includes an execution unit that runs the aforementioned application, The execution unit is a receiver that performs audio adjustment by passing object-based audio metadata to the browser.

9. A method for receiving a broadcast containing object-based audio, The application for the user to adjust the volume is received via broadcast in a reception step, The application has an execution step, The aforementioned execution step is a receiving method that performs audio adjustment by passing object-based audio metadata to a browser.

10. Used in receivers of broadcasts including object-based audio, The application for the user to adjust the volume is received via broadcast in a reception step, A program for causing an execution step to execute the aforementioned application, The execution step described above is a program that performs audio adjustment by passing object-based audio metadata to the browser.

Images