Audio Bitstream Personalization via Preselection Elements

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for providing personalized audio content in TV sets, particularly through the HTML5 API, lack scalability and efficiency in personalizing audio experiences, leading to limitations in user control and seamless switching between different audio experiences.

Innovation Solution

The solution involves using a device or application that receives a manifest file with adaptation sets and preselection elements to select and mix audio objects, allowing for precise control over audio gain and position, and inserting pointers to modify bitstream elements, enabling flexible and seamless personalization of audio content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple separate audio streams are provided for different audio experiences, then users can switch between different audio content, but system complexity and bandwidth consumption increase significantly

Engineering Contradiction:
Improveaudio experience personalizationVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple audio objects into a single audio bitstream, allowing different audio experiences to be constructed from the same underlying audio data. Instead of providing separate audio streams for different languages or audio profiles, the system combines all audio objects (dialogue, music, effects, different language tracks) into one unified bitstream that can be dynamically mixed and matched based on user preferences and device capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The single audio bitstream serves multiple functions by containing all necessary audio objects that can be configured for different audio experiences. The same bitstream can be used to generate different audio outputs (e.g., 5.1 surround, stereo, mono, different language combinations) without requiring separate streams, making the system universally applicable to various audio configurations and user needs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If audio content is highly personalized with multiple audio objects, then user control over audio experience is improved, but processing complexity and computational requirements increase

Engineering Contradiction:
Improveuser controlVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary organization of audio content by segmenting it into distinct audio objects with unique identifiers and metadata during encoding. This pre-organization allows the client device to efficiently select and mix specific audio objects based on user preferences without having to process or analyze the entire audio stream in real-time, reducing computational complexity while maintaining high user control.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The audio mixing system is designed to be dynamic, allowing real-time selection and configuration of audio objects based on user input, device capabilities, and content metadata. The system can dynamically adjust which audio objects are active, their mixing levels, and their spatial positioning without requiring complex reprocessing, enabling flexible user control with optimized computational requirements.

Inventive Principle:
Principle #15Dynamics

3Reliability

If separate audio streams are used for different experiences, then audio content can be optimized for each experience, but re-buffering issues occur during switching

Engineering Contradiction:
Improveaudio experience qualityVSAvoidre-buffering delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

By merging all audio objects into a single audio bitstream, the system eliminates the need to switch between separate audio streams when changing audio experiences. The client device can selectively activate or deactivate different audio objects within the same stream, enabling seamless transitions between audio profiles (e.g., from English audio to Spanish audio, or from 5.1 surround to stereo) without re-buffering delays.

Inventive Principle:
Principle #5Merging (Combining)

4Adaptability or versatility

If multiple audio streams are provided, then different audio content can be delivered, but bandwidth consumption increases

Engineering Contradiction:
Improveaudio content varietyVSAvoidbandwidth consumption
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The system combines multiple audio objects into a single audio bitstream for transmission, significantly reducing bandwidth consumption compared to transmitting separate audio streams for each audio experience. The single stream contains all necessary audio data (different languages, audio types, spatial information) in an efficient encoded format, allowing the client to extract and mix only the needed audio objects based on user preferences and device capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11838578B2Methods and devices for personalizing audio content
Publication Date: 2023.12.05 DOLBY INTERNATIONAL AB
  • US11838578B2 patent drawing
  • US11838578B2 patent drawing
  • US11838578B2 patent drawing

AI summary

The present document describes a method (400) for personalizing audio content. The method (400) comprises receiving (401) a manifest file (140) for the audio content. The manifest file (140) comprises at least one adaptation set (281, 282) referencing an audio bitstream (121), where the audio bitstream (121) comprises a plurality of audio objects (181), and a plurality of different preselection elements (291, 292, 293) for the adaptation set (281, 282), wherein the different preselection elements (291, 292, 293) specify different combinations of the plurality of audio objects (181). The method (400) further comprises selecting (402) a preselection element (291) from the plurality of different preselection elements (291, 292, 293), and causing (403) rendering of an audio signal which depends on the selected preselection element (291).