Object-Based Audio Rendering With Legacy-Compatible Bed Channels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio decoding and rendering systems struggle to provide a full range audio experience for object-based audio programs, especially when legacy systems are unable to parse object channels and related metadata, limiting the flexibility and personalization of audio content rendering.
Innovation Solution
The implementation of a personalizable object-based audio program that includes a base layer compatible with legacy systems for a default audio experience and an extension layer for personalized mixing, allowing both legacy and advanced systems to render selectable mixes of speaker and object channels using metadata-driven rendering parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a legacy audio decoding system is used, then compatibility with existing systems is maintained, but the ability to provide personalized and flexible audio rendering is limited
Solution Approach 1:
The audio program is divided into a base layer (compatible with legacy systems) and an extension layer (enabling personalization). This segmentation allows the system to maintain backward compatibility while adding advanced features through the extension layer that includes object channels and metadata for selective rendering
Solution Approach 2:
Metadata acts as an intermediary between the audio content and the rendering system. The metadata contains rendering parameters that enable flexible and personalized audio rendering without requiring changes to the core audio decoding architecture, allowing advanced features to be added through data rather than structural complexity
2Adaptability or versatility
If object channels and metadata are included for personalized mixing, then audio rendering flexibility is improved, but compatibility with legacy systems that cannot parse these elements is lost
Solution Approach 1:
The audio bitstream is segmented into a base layer containing traditional speaker channels that legacy systems can decode, and an extension layer containing object channels and metadata for personalized rendering. This ensures that legacy systems receive compatible audio content while advanced systems can utilize the full range of features
Solution Approach 2:
The audio program structure is designed to serve multiple functions: it provides a default mix for legacy systems through the base layer, while simultaneously enabling personalized and object-based rendering for advanced systems through the extension layer. This multi-functionality ensures broad compatibility without sacrificing advanced capabilities
3Ease of operation
If selectable mixes of speaker and object channels are implemented, then user choice and audio experience are enhanced, but processing complexity increases
Solution Approach 1:
Multiple selectable mixes and rendering configurations are prepared in advance during the audio program creation. The metadata contains pre-calculated rendering parameters for different mixing scenarios, allowing users to select from predefined options without requiring complex real-time processing or calculations
Data Source
AI summary
Methods for generating an object based audio program, renderable in a personalizable manner, and including a bed of speaker channels renderable in the absence of selection of other program content (e.g., to provide a default full range audio experience). Other embodiments include steps of delivering, decoding, and/or rendering such a program. Rendering of content of the bed, or of a selected mix of other content of the program, may provide an immersive experience. The program may include multiple object channels (e.g., object channels indicative of user-selectable and user-configurable objects), the bed of speaker channels, and other speaker channels. Another aspect is an audio processing unit (e.g., encoder or decoder) configured to perform, or which includes a buffer memory which stores at least one frame (or other segment) of an object based audio program (or bitstream thereof) generated in accordance with, any embodiment of the method.