HbbTV Audio Leveling Across Main and Supplementary Tracks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
HbbTV terminal devices face issues with inconsistent audio levels between main and supplementary audio tracks due to independent volume control by the decoder device, leading to an adverse user experience.
Innovation Solution
The HbbTV terminal device measures the audio level of the main track using a standardized algorithm and compares it to embedded reference metadata, adjusting the supplementary track accordingly to maintain consistent audio levels, regardless of upstream volume control by the decoder.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the decoder device performs independent volume control on the main decoded track, then the audio level of the main track can be adjusted, but the HbbTV enabled TV becomes unaware of the audio leveling performed, causing audio mixing of main and supplementary tracks to be at inconsistent audio levels
Solution Approach 1:
The system embeds reference audio level information in the decoded broadcast feed and uses this feedback to automatically adjust the supplementary audio track levels. The HbbTV terminal device extracts the reference audio level, analyzes the actual audio level, determines a gain factor, and applies it to the supplementary track to maintain consistent audio levels despite independent volume control by the decoder device.
2Adaptability or versatility
If the HbbTV enabled TV processes supplementary audio tracks independently, then it can offer supplementary content/services to the viewer, but it cannot achieve consistent audio level mixing with the main audio track due to lack of awareness about STB audio leveling
Solution Approach 1:
The reference audio level information acts as an intermediary between the decoder device's volume control and the HbbTV terminal device's supplementary audio processing. This embedded metadata enables the terminal device to understand the audio leveling performed by the STB and adjust supplementary tracks accordingly, achieving consistent audio levels while maintaining independent supplementary content delivery capability.
3Device complexity
If audio mixing is performed without reference to original audio levels, then processing is simpler, but the resulting audio mix has inconsistent levels that adversely impact user experience
Solution Approach 1:
The reference audio level information is embedded in the decoded broadcast feed before reaching the HbbTV terminal device. This preliminary action enables the terminal device to perform accurate audio level matching without adding significant processing complexity, as the reference data is already available. The system extracts this reference information, compares it with actual levels, and applies appropriate gain factors to maintain consistent audio levels in the mix.
Data Source
Figure 1~2
Figure 3A
Figure 3B
AI summary
Described is a method of audio processing in a HbbTV terminal device. The method includes receiving a decoded broadcast feed including a first audio track, receiving HbbTV content relating to the broadcast feed, the HbbTV content including a second audio track, extracting level-related information from the decoded broadcast feed, wherein the level-related information is embedded in the decoded broadcast feed and enables to obtain an indication of an original audio level of the first audio track, analyzing the first audio track for determining an actual audio level of the first audio track, determining a gain factor based on the actual audio level and the original audio level, and generating a third audio track for output by the HbbTV terminal device based on the first audio track, the second audio track, and the gain factor. Also described is an apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media.