Broadcasting system, receiver, receiving method, and program
The broadcasting system and receiver use AC-4 audio signals to deliver a unified dialogue adjustment function via data broadcasting, addressing inconsistent GUI designs across receivers and enhancing user convenience.
Patent Information
- Application Number
- JP2022097417
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-06-16
- Publication Date
- 2026-02-03
- Estimated Expiration
- 2042-06-16
AI Technical Summary
Existing dialogue adjustment functions in terrestrial digital broadcasting systems risk misrepresenting content creators' intentions due to varying GUI designs and operations across different receiver manufacturers and models, leading to insufficient user convenience.
A broadcasting system and receiver that utilize AC-4 audio signals to provide a dialogue adjustment function through a unified GUI by broadcasting an application via data broadcasting, allowing users to adjust dialogue settings consistently across different receivers.
Enables a dialogue adjustment function with unified operability and design, improving user convenience by ensuring consistent GUI operation regardless of receiver manufacturer or model.
Smart Images

Figure 0007810612000001 
Figure 0007810612000002 
Figure 0007810612000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a broadcasting system, a receiver, a receiving method, and a program. [Background technology]
[0002] In terrestrial digital broadcasting, adjustments to the audio transmitted from the broadcasting station had to be made using a unique adjustment menu for each receiver. For the next generation of terrestrial digital broadcasting, the use of object-based audio signals such as MPEG-H audio, or channel-based audio signals such as AC-4 audio, is being considered. In AC-4 audio signals, user-adjustable audio parameters are transmitted from the broadcasting station, and a dialogue adjustment function is provided to the user using the audio parameters. The dialogue adjustment function allows the user to adjust the dialogue audio using a GUI. Patent Document 1 describes providing a plurality of pieces of music or other sounds simultaneously and selectively so that the sounds can be distinguished from one another. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-62652 Summary of the Invention [Problem to be solved by the invention]
[0004] However, if a GUI for the dialogue adjustment function is implemented for each receiver, there is a risk that the intentions of the content creator may not be accurately reflected, or that the GUI design and operation method may vary depending on the receiver manufacturer or model, which can result in insufficient user convenience for the dialogue adjustment function.
[0005] The present invention has been made in consideration of the above points, and provides a broadcasting system, receiver, receiving method, and program that can provide a dialogue adjustment function using a GUI with unified operability and design. [Means for solving the problem]
[0006] (1) The present invention has been made to solve the above-mentioned problems, and one aspect of the present invention is a broadcasting system that broadcasts including AC-4 audio, and that includes a receiving unit that receives an application via data broadcasting that allows a user to adjust dialogue.
[0007] (2) Another aspect of the present invention is a receiver in a broadcasting system that broadcasts including AC-4 audio, the receiver comprising a receiving unit that receives an application via data broadcasting that allows a user to adjust dialogue.
[0008] (3) Another aspect of the present invention is a receiving method for a receiver in a broadcasting system that broadcasts including AC-4 audio, the receiving method including a receiving step in which the receiver receives an application for a user to adjust dialogue via data broadcasting.
[0009] (4) Another aspect of the present invention is a program used in a receiver in a broadcasting system that broadcasts including AC-4 audio, the program causing the receiver to execute a receiving step of receiving, via data broadcasting, an application that allows a user to adjust dialogue. [Effects of the Invention]
[0010] According to the present invention, it is possible to provide a dialogue adjustment function using a GUI with unified operability and design. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is a diagram illustrating an example of a configuration of a broadcasting system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a receiver according to the present embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a definition of metadata according to the embodiment. [Figure 4] FIG. 10 is a diagram illustrating an example of an acquisition command according to the present embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of an update command according to the embodiment. [Figure 6] 10 is a flowchart showing an example of a dialogue adjustment process according to the present embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a GUI displayed by executing a dialogue adjustment application according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0013] [System Configuration] FIG. 1 is a diagram showing an example of the configuration of a broadcasting system Sys according to an embodiment of the present invention. The broadcasting system Sys includes a broadcasting device of a broadcasting station 1, a receiver 2, a broadcasting station server 3, and a broadcaster server 4. The broadcasting is, for example, terrestrial digital broadcasting. However, the present invention is not limited to terrestrial digital broadcasting, and may also apply to broadcasting using broadcasting satellites. Broadcasting using broadcasting satellites is, for example, advanced BS (Broadcasting Satellites) digital broadcasting or advanced wideband CS (Communication Satellites) digital broadcasting. Furthermore, broadcasting may also be wired broadcasting such as cable television.
[0014] In the broadcasting system Sys, a broadcasting station 1 transmits digital broadcasting signals, application control information, presentation control information, etc. via broadcast waves. A service provider provides metadata and video content related to programs from a provider server 4. The application control information notifies receivers compatible with this system of applications that are linked to programs, and also contains control information such as commands for starting and stopping applications. The control information regarding presentation includes information for overlaying an application and a broadcast program on the same screen, and control information regarding whether or not an application can be presented. The broadcasting station 1 operates a broadcasting station server 3 in the broadcasting system Sys. The broadcasting station server 3 provides metadata such as program title, program ID, program summary, cast, broadcast date and time, etc. The information that the broadcasting station 1 provides to the service provider is provided through an API (Application Programming Interface) that the broadcasting station server 3 has.
[0015] A service provider is a party that provides services through the broadcasting system Sys, and operates the broadcasting station server 3 to create and distribute content and applications for the services, and to realize each individual service. Here, the services also include broadcasting and communication integration services that integrate broadcasting and communication. The broadcasting station server 3 manages and distributes applications by transmitting them to the receiver 2. As a server for each service, the broadcasting station server 3 provides server functions for realizing individual services (MPEG-H service, AC-4 service, VOD program recommendation service, multilingual subtitle service, etc.).
[0016] MPEG-H is a set of standards under development by the ISO / IEC Moving Picture Experts Group (MPEG) for digital container standards, video compression standards, audio compression standards, and two conformance testing standards. MPEG-H audio, for example, enables object-based audio. In object-based audio, an "object" is each sound element that makes up a program, such as music or human voice. With object-based audio, an audio signal is recorded for each sound element, allowing for audio control for each element. Furthermore, when playing back on receiver 2, it is possible to play back a program based on the actual speaker position, using playback position information for the element.
[0017] AC-4 is an audio compression technology developed primarily for broadcasting and online distribution. AC-4 audio also allows for object-based audio.
[0018] The broadcasting station server 3 not only realizes the functional aspects of these services, but also transmits the content that makes up the services (MPEG-H audio data, AC-4 audio data, VOD content, subtitle data, etc.) The broadcasting station server 3 is registered as a "repository" to distribute applications of the broadcasting system Sys, and provides and searches for a list of available applications in response to inquiries from the receiver 2.
[0019] In addition to the function of receiving existing digital broadcasts, receiver 2 also includes the function of realizing broadcast and communication integrated services. In addition to the broadband network connection function, receiver 2 has the following functions. - Function to receive applications in response to application control signals from broadcasts - Function to execute applications in response to application control signals from broadcasting - Function to present information through collaboration between broadcasting and communications - Device linking function
[0020] Here, the terminals include, for example, user terminals such as smartphones, smart speakers, etc. The terminal linking function of the receiver 2 can access broadcast resources such as program information in response to requests from other terminals, and can call receiver functions such as playback control. Examples of applications include a digital mixer for MPEG-H audio, a dialogue adjustment application for AC-4 audio, etc. A user (also called a "receiver") can adjust the dialogue using the application received from the provider server 4.
[0021] More specifically, the receiver 2 has the following functions. The receiver 2 has a broadcast reception and playback function that receives broadcast waves. When a specific broadcast service is selected, the receiver 2 has the function of synchronously playing back the video, audio, subtitles, and data broadcast that make up the service. The receiver 2 has a communication content receiving and playback function that accesses video content stored on a server on the communication network (for example, a provider server 4). The receiver 2 has a function that receives video content as VOD streaming and synchronously plays back the video, audio, and subtitles that make up the content.
[0022] The receiver 2 has an application control function that mainly controls the application engine for managed applications based on application control information obtained from a server on the communication network or from broadcast signals. The receiver 2 has the function to control and manage the life cycle and events of each application. The receiver 2 acquires an application as an application engine function. The receiver 2 has a function to execute the application. This function is realized by, for example, an HTML5 browser.
[0023] The receiver 2 has a presentation synchronization control function that controls the stream presentation synchronization of video, audio, etc. received by broadcasting and video, audio, etc. received by streaming. The receiver 2 has an application launcher function, which mainly includes a navigation function for the user to select and launch non-broadcast managed applications.
[0024] In the following description, when there is no particular distinction between the broadcast station 1, the broadcast station server 3, and the provider server 4, they will be described as the broadcast station 1. In other words, the broadcast station 1 described below has any or all of the functions of the broadcast station 1, the broadcast station server 3, and the provider server 4 described above.
[0025] FIG. 2 is a block diagram showing an example of the configuration of the receiver 2 according to this embodiment. The receiver 2 in FIG. 2 is a receiver compatible with AC-4 audio.
[0026] The broadcast station 1 transmits a video signal A11 and an audio signal (also referred to as an "AC-4 audio signal") A12. For example, the broadcast station 1 transmits the AC-4 audio signal A12 by including it in a broadcast wave. Furthermore, when the broadcasting station 1 transmits the AC-4 audio signal A12 included in the broadcast wave, the broadcasting station 1 transmits, via data broadcasting, a dialogue adjustment application A13 that allows the user to adjust dialogue.
[0027] The receiver 2 includes a tuner 21, a Demux (demultiplexer) 22, a video decoder 23, an audio decoder 24, a video adjustment unit 25, an audio adjustment unit 26, a browser API unit 27, and a data broadcasting browser unit .
[0028] The tuner 21 receives broadcast waves via an antenna. The tuner 21 tunes (selects) a channel selected based on a user operation. The tuned signal is demodulated and output to the Demux 22 as data.
[0029] The Demux 22 separates the input data into a video data string, an audio data string, a superimposed text data string, a subtitle data string, etc. The separated audio data string is output to an audio decoder 24. The separated video data string is output to a video decoder 23. The video decoder 23 decodes the input video data stream.
[0030] The superimposed character data string and subtitle data string separated by the Demux 22 are decoded by a superimposed character decoder and subtitle decoder (not shown), respectively, and the decoded character strings are superimposed on the video.
[0031] The audio data string of each audio component output from the Demux 22 is output to the audio decoder 24 . The audio decoder 24 decodes the audio data string of the audio component. The audio decoder 24 also extracts metadata from the audio data string input from the Demux 22. The audio decoder 24 outputs the metadata to the browser API unit 27 in response to a request from the browser API unit 27.
[0032] The image adjustment unit 25 performs color space conversion processing on the decoded image data string, and displays the image on the display.
[0033] The audio adjustment unit 26 adjusts the dialogue and performs downmixing processing based on the audio data string decoded by the audio decoder 24 and the adjustment information output from the browser API unit 27. The audio data string that has undergone the downmixing processing is converted into sound and output from a speaker.
[0034] The browser API unit 27 acquires metadata from the audio decoder 24 using the API based on an instruction signal from the data broadcasting browser unit 28. The browser API unit 27 outputs adjustment information indicating an adjustment value for the metadata to the audio adjustment unit 26 using the API based on an instruction signal from the data broadcasting browser unit 28.
[0035] The data broadcasting browser unit 28 starts the dialogue adjustment application sent from the broadcasting station 1 via data broadcasting. The data broadcasting browser unit 28 acquires metadata from the audio decoder 24 via the browser API unit 27. The data broadcasting browser unit 28 acquires initial values of parameters for which the user can adjust dialogue based on the metadata. The data broadcasting browser unit 28 sets the initial values of the parameters for which the user can adjust dialogue in the dialogue adjustment application.
[0036] For example, the data broadcasting browser unit 28 displays a GUI by executing a dialogue adjustment application, and acquires, as dialogue adjustment parameters, setting values according to user operations on the GUI. The data broadcasting browser unit 28 outputs adjustment information based on the adjustment parameters to the audio adjustment unit 26 via the browser API unit 27.
[0037] As described above, the receiver 2 according to this embodiment is a broadcasting system that broadcasts programs including AC-4 audio, and receives an application via data broadcasting that allows the user to adjust dialogue. By executing the received application, the user can adjust dialogue via a GUI with consistent operability and design, regardless of the manufacturer or model of the receiver 2. This improves user convenience.
[0038] [Metadata Definition] Next, the definition of the metadata defined in AC-4 used in this embodiment will be described. FIG. 3 is a diagram showing an example of the definition of metadata used in this embodiment. As shown in the figure, the metadata used in this embodiment includes two types: data related to dialogue adjustment (emphasis) and control information related to dialogue adjustment (emphasis). These metadata are described by API functions such as dialog_enhancement() and control_dialog_enhancement(). These two types of metadata are included in the AC-4 audio data sent from the broadcasting station and can be acquired from the audio decoder 24.
[0039] [Get Metadata] Next, the acquisition of metadata by the browser API unit 27 will be described. The browser API unit 27 acquires metadata from the audio decoder 24 in response to a command input from the data broadcasting browser unit 28. Specifically, the process is as follows. FIG. 4 is a diagram showing an example of a command to acquire metadata according to this embodiment. 4, the browser API unit 27 executes a command with a method name "getdialog_enhancement()." The browser API unit 27 obtains a return value of "AC4DialogEnhancement object" type as a result of executing the command. The return value is metadata related to the dialogue adjustment (emphasis).
[0040] Update Metadata Next, the update of metadata by the browser API unit 27 will be described. The browser API unit 27 outputs adjustment information (adjustment parameters) to the audio adjustment unit 26 in response to a command input from the data broadcasting browser unit 28. Specifically, this is as follows. FIG. 5 is a diagram showing an example of a metadata update command according to this embodiment. In the example shown in FIG. 5, the browser API unit 27 executes a command with the method name "putAC4ControlDialogEnhancement(Q)" with an argument of type "dialogue emphasis control object" as "argument Q". The browser API unit 27 acquires a return value of type "Boolean" from the audio adjustment unit 26 as the execution result of the command. The argument Q is control information related to dialogue adjustment (emphasis). The argument Q is, for example, G related to gain. DE , p for the parameter vector, and r for the rendering vector.
[0041] [Processing flow] Next, an example of the dialogue adjustment process according to this embodiment will be described. FIG. 6 is a flowchart showing an example of the sound adjustment process according to this embodiment. (Step S101) In response to a channel selection operation and a power supply operation by a user, the receiver 2 receives and starts up a dialogue adjustment application from a data broadcast corresponding to the content currently selected.
[0042] (Step S102) The receiver 2 extracts metadata from the audio data separated by the audio decoder 24.
[0043] (Step S103) The receiver 2 acquires the metadata from the audio decoder 24 by executing an acquisition command via the API.
[0044] (Step S104) The receiver 2 sets the initial values of the dialogue-adjustable parameters in the dialogue adjustment application based on the acquired metadata.
[0045] (Step S105) The receiver 2 accepts a user operation for the dialogue adjustment application. When the receiver 2 accepts a user operation for the dialogue adjustment application, the receiver 2 outputs the operated dialogue adjustment parameter as adjustment information to the audio adjustment unit 26 by executing an update command via the API.
[0046] (Step S106) The receiver 2 performs audio adjustment based on the parameters (metadata) after the dialogue adjustment.
[0047] Next, a GUI displayed by executing the dialogue adjustment application according to this embodiment will be described. The illustrated example is an example of a GUI that is displayed when the data broadcasting browser unit 28 executes a dialogue adjustment application received via data broadcasting. The dialogue adjustment application displays "dialogue" indicating that the parameter adjustment is "dialogue adjustment (emphasis)." The dialogue adjustment application also displays an operator, such as an operation icon, for setting the "dialogue" to "ON" or "OFF." By detecting a user operation, such as a remote control operation, on the operation icon, the "dialogue" can be switched "ON" or "OFF."
[0048] The dialogue adjustment application also displays a volume adjustment icon as an operator for adjusting the volume of the dialogue. The volume of the dialogue can be adjusted by detecting a user operation, such as a remote control operation, on the volume adjustment icon. The dialogue adjustment application also displays a balance adjustment icon that allows adjustment of the output balance between the left and right speakers provided in the receiver 2. By detecting a user operation such as a remote control operation on the balance adjustment icon, it is possible to adjust the output balance of the speakers that output "dialogue." By using such a GUI, the user can perform intuitive operations, thereby improving convenience.
[0049] As described above, the receiver 2 according to this embodiment is a receiver in a broadcasting system that broadcasts including AC-4 audio, and receives an application that allows the user to adjust dialogue via data broadcasting.
[0050] This makes it possible to provide a dialogue adjustment function using a GUI with unified operability and design, without having to implement a GUI on each receiver. Also, by using a unified GUI regardless of the receiver manufacturer or model, user convenience can be improved.
[0051] Note that a portion of the broadcast station 1, receiver 2, broadcast station server 3, and provider server 4 in the above-described embodiment, for example, at least a portion of the Demux 22, audio decoder 24, audio adjustment unit 26, video decoder 23, video adjustment unit 25, browser API unit 27, and data broadcast browser unit 28 of the receiver 2, may be implemented by a computer. In this case, a program for implementing this control function may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be read into and executed by a computer system. Note that the "computer system" referred to here refers to a computer system built into the broadcast station 1, receiver 2, broadcast station server 3, or provider server 4, and includes hardware such as an OS and peripheral devices.
[0052] Furthermore, "computer-readable recording media" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. Furthermore, "computer-readable recording media" may also include devices that dynamically store programs for a short period of time, such as communication lines used when transmitting programs over networks like the Internet or communication lines like telephone lines, or devices that store programs for a fixed period of time, such as volatile memory within computer systems that serve as servers or clients in such cases. Furthermore, the above-mentioned programs may be programs that realize some of the aforementioned functions, or may be programs that can realize the aforementioned functions in combination with programs already stored in the computer system.
[0053] Furthermore, some or all of the broadcast station 1, receiver 2, broadcast station server 3, and provider server 4 in the above-described embodiments may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each functional block of the broadcast station 1, receiver 2, broadcast station server 3, and provider server 4 may be individually implemented as a processor, or some or all of them may be integrated into a processor. Furthermore, the integrated circuit implementation method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit implementation technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used.
[0054] One embodiment of the present invention has been described in detail above with reference to the drawings, but the specific configuration is not limited to that described above, and various design changes and the like are possible within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]
[0055] Sys Broadcasting System 1 Broadcasting Station 2 Receivers 3 Broadcasting station server 4. Operator server 21 Tuner 22 Demux 23 Video decoder 24 Audio Decoder 25 Image adjustment section 26 Audio adjustment section 27 Browser API Section 28 Data Broadcasting Browser
Claims
1. A broadcasting system that broadcasts including AC-4 audio, a receiving unit that receives an application for a user to adjust lines via data broadcasting; Equipped with Broadcasting system.
2. an execution unit that executes the application; The execution unit includes a definition unit that defines an API for acquiring metadata of AC-4 audio; Furthermore, the execution unit adjusts the dialogue by transferring the metadata to a browser; The broadcasting system according to claim 1 .
3. A receiver in a broadcasting system that broadcasts including AC-4 audio, a receiving unit that receives an application for a user to adjust lines via data broadcasting; Equipped with Receiver.
4. A receiving method for a receiver in a broadcasting system that broadcasts including AC-4 audio, the receiver comprising: a receiving step of receiving an application for a user to adjust lines via data broadcasting; having Receiving method.
5. A program for use in a receiver in a broadcasting system that broadcasts including AC-4 audio, the program including: a receiving step of receiving an application for a user to adjust lines via data broadcasting; A program to execute.
Citation Information
Patent Citations
Information processing device, information processing method, and computer program
JP2013062652A
System
JP2017005642A
Decoding Method and Decoder for Dialog Improvement
JP2017534904A
Binaural dialogue improvement
JP2019508947A
Speech extension in audio codecs
JP2022530338A