Multi-Object Audio Coding with Backward Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional audio coding/decoding technologies are unable to efficiently handle multi-object audio signals with various channels, limiting user control over audio objects with different channels and preventing the combination of multiple audio content methods.
Innovation Solution
An apparatus and method for coding and decoding multi-object audio signals, including an audio object coding unit that creates rendering information with spatial cues, channel information, and identification, and a transcoding apparatus that transforms side information bitstreams to provide backward compatibility with conventional spatial audio coding systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional spatial audio coding (SAC) is used, then multi-channel audio signals can be transmitted at low bit rate, but it cannot code/decode multi-object audio signals with various channels (mono, stereo, 5.1)
Solution Approach 1:
The audio signal is segmented into multiple independent audio objects, each with its own channel configuration (mono, stereo, or multi-channel). This segmentation allows each object to be processed and transmitted independently with appropriate channel handling, enabling support for various channel types while maintaining coding reliability.
Solution Approach 2:
The coding apparatus is designed with universal processing capabilities that can handle multiple channel configurations (mono, stereo, 5.1, etc.) through a unified object-based framework. This multi-functionality allows the same system to adapt to different channel requirements without sacrificing coding reliability.
2Adaptability or versatility
If conventional Binaural Cue Coding (BCC) is used, then multiple audio objects can be code/decoded, but channels are limited to mono only
Solution Approach 1:
The system extends the traditional mono-focused BCC approach by adding channel dimensionality. Audio objects can now exist in multiple channel dimensions (mono, stereo, surround), while preserving the binaural cue coding mechanisms for spatial perception. This dimensional expansion maintains spatial audio information while providing channel configuration flexibility.
3Ease of operation
If multi-object audio coding with various channels is implemented, then user control over audio objects is improved, but system complexity increases
Solution Approach 1:
Channel configurations and spatial parameters are predetermined and encoded into the audio object data structures during content creation. This preliminary action allows playback systems to simply retrieve and render pre-configured objects without requiring complex real-time processing, thus improving user control while managing system complexity.
Solution Approach 2:
A standardized bitstream format and rendering interface act as intermediaries between the complex coding backend and the user-facing control interface. This intermediary layer abstracts the complexity of multi-object, multi-channel processing while providing intuitive user control capabilities.
4Adaptability or versatility
If side information bitstream conversion is implemented, then backward compatibility with conventional SAC is achieved, but processing overhead increases
Solution Approach 1:
The system creates simplified copies of the multi-object bitstream in conventional SAC format when backward compatibility is required. These copied bitstreams maintain the essential audio information while conforming to legacy formats, enabling compatibility without requiring extensive real-time processing of the full multi-object data structure.
Data Source
AI summary
Provided is an apparatus and method for coding and decoding multi-object audio signals with various channels and providing backward compatibility with a conventional spatial audio coding (SAC) bitstream. The apparatus includes: an audio object coding unit for coding audio-object signals inputted to the coding apparatus based on a spatial cue and creating rendering information for the coded audio-object signals, where the rendering information provides a coding apparatus including spatial cue information for audio-object signals; channel information of the audio-object signals; and identification information of the audio-object signals, and used in coding and decoding of the audio signals.